No, it depended on people's beliefs. Some people in the South thought that it was wrong and others didn't. For example, there were people who helped run the underground railroad who were in the South, even though it risked the safety of themselves and their family.
Good Luck! I hoped I helped.