Because no one liked him for his beliefs
So first off he was a strict enforcer of the Navigation Acts. This was what allowed the regulation of colonial trade and allowed England to collect taxes in the colonies. He also made it a requirement that landholders take out new land patents. He also limited the town meetings and rights of local taxation. Colonist also considered him very arrogant and they imprisoned him and sent him back to England.