During the American Revolutionary War (1775–1783), the buildings and grounds were used to house British and German prisoners of war. The barracks were put to a variety of uses during the 19th century including a state armory, silkworm production site, and military hospital after the nearby Battle of South Mountain and subsequent Battle of Antietam in September 1862. The parade field served as the Agricultural Fairgrounds from 1853 to 1860. In 1867, it was chosen as the site for the Maryland Institution for the Deaf and Dumb (present-day Maryland School for the Deaf). The western barracks building was demolished in 1871 for the construction of a new Victorian style large central school building, which in turn was razed in the late 1960s, and replaced by individual brick cottages.