In about 1859, after his health began to fail, he went to San Francisco to live with his family who had moved there from Lebanon (NH) at the beginning of the gold-rush. After Phineas regained his health he was anxious to work and found it on a farm in Santa Clara County, south of San Francisco.