Until the civil war, the protection of civil rights had been left mostly to the States.
Before the Civil War, Federal Influence was smaller, and Civil Rights weren't a priority. For example, at that time, slavery was still legal, which is a clear violation of basic human and civil rights. States have always had lots of authority, and civil rights protections were left mostly to the States