Jem thinks that Boo stays shut in his house all the time because he wants to. Jem noticed the way that people treat outcasts, as well as black people, like Tom, and he realizes that because Boo has been shut in for such a long time, he hears stuff in town, and knows that everyone talks about him.
~Hope I helped!~