The house was built c. 1847 by Tilley Raymond, who, along with Horatio Tower, became one of Worcester's leading builders of the 1840s and 1850s. Raymond eventually left for California, apparently to capitalize on the gold rush, and the house was taken over by his son Edward. Edward Raymond was a veteran of the American Civil War, and served locally as the chief of police and clerk of the district court. He was admitted to the bar in 1880 after studying with George Hoar. The house was converted into apartments in 1898.