It moved to its present location on Oyster Point in 1680 from a location on the west bank of the Ashley River known as Albemarle Point.