Answer: to me alone it is a time of pause.
This is the line of the poem that best states how the speaker feels. He tells us that everyone has different ideas as to what a city is. He states that the city , for some people, represents a kind of prison house. They get pleasure and relaxation from nature (or by "conversing with the hills"). However, the author is different in this, as what he likes to do is to be in the city, and he thinks of this as a "time of pause."