Based on www.britannica.com, There were 14 prominent founding fathers that have slaves. These are; Charles Caroll, Samuel Chase, Benjamin Franklin, Button Gwinnett, John Hancock, Patrick Henry, John Hay, Thomas Jefferson, Richard Lee, James MAdison, Charles Cotesworth, Benjamin Rush, Edward Rutledge and George Washington.
This became an obstacle to employ the basic principles of limited government which is the right to liberty.