I may be wrong but my answer is
The slave population is high because of all of the growing crops and they need labor to grow more crops and harvest them. so of course there would be more slaves in those areas, with the most crops. So you can say the slave population in the colonies is high