She is about to disconnet by hanging upon him. The whole poem is about an African person and the landlady who simply inquires how dark the person is, at the end she seems impatient and is simply about hang upon him -- rearing...about my ears. She couldn't be near him to strike him, if she was to scold the speaker there would be silence, the same idea applies if she turned the receiver away.