That's called segregation and it was because the white people thought that the black were not as good as them. This led to segregation and hate to all the colored people. There is no specific reason behind it, except the differences in the appearances and skintone.