That's a tricky question. The percentage of slave OWNERS in the South was about 4.8% (which would make the percentage uninvolved about 95%). However, if the question is also referring to Southerners who neither owned slaves nor had any economic interest in maintaining slavery/the plantation system, that number is about 75%.