Jackson's mistrust of the Bank was political as well because he thought a federal organization like the Bank violated the rights of the states. Additionally, he believed that the Bank gave too few individuals — who could use that power against the government — too much power.
hope this helps!