Saratoga, New York
On November 4, 1861, in Saratoga, New York, he married Catherine Newton "Kate" Lee (c. 1819–1894), widow of William Little Lee, the first Chief Justice of the Supreme Court of the Kingdom of Hawaii. They didn't have any children.