Answer: The town is very small, and everybody can observe and comment on what Turner is doing.
In this excerpt, the author implies that the town is very small. We can see this by the fact that the narrator knows all the streets, the houses, and the people that live in them. Moreover, we also see that because of the size of the town, people can easily know what everybody else is doing. The narrator feels that people will notice him, and will comment on his behaviour.