This town is Warm Springs, Georgia.
Roosevelt came to Warm Springs for the first time in 1924 to receive treatment for polio. He took a liking to the place, and felt that it was easing his symptoms. As a result, Roosevelt built a polio treatment center there, as well as a house for himself, during this governorship. He continued using the residence even once he became President, hence its nickname "Little White House."