It sounds like Fredrick Douglass was pointing out that slave masters didn't want their slaves to have knowledge such as reading and writing, let alone knowing their own ages and such.
Most slave masters wanted this so that they could feel superior over blacks, and they didn't want the slaves to be equal with them.