The House was built in 1825 in Federal-style architecture by the Scottish Merchant Charles Edmonston. It was revamped a decade later into its famous Greek Revival style by Charles Alston after Charles Edmonston was forced to sell.