Smith reportedly spent time in California during the Gold Rush of 1849. In 1878, he moved to 86 Pinckney Street, where he lived until 1893. From there, he moved to Jamaica Plain, and around 1900 moved in with his two daughters at 45 Wellesley Park in Dorchester.