The fort was begun in 1623, in the wake of a major Native American attack the previous year. Potential attacks by the Spanish were also a consideration. The original fort, called The Castle or the Fort at Warraskoyack (an early name for Isle of Wight County), would have had a triangular shape and been surrounded by a ditch. It was also called Roger Smith's Fort. The earthworks would have been topped by palisade walls. As those threats became less of a concern, the fort was eventually abandoned.