I would say that prejudice and discrimination can hamper the children's growth and self-esteem.
For example, if they experience discrimination from their teachers due to their skin color, they might not have the self-esteem necessary to try to apply to college and might feel that they're not good enough, even if they're straight A students.