The poet isn't mad about the bird tapping at the bust of Palas; he understands why Lenore is gone but he doesn't understand why he cannot see her again; the raven didn't fly out of the house - the poet says that the bird 'still is sitting.' What is bugging the narrator is that he will never get to see Lenore again, and the bird confirmed his suspicions.