In 1779, during the Battle of New Haven, British soldiers captured Black Rock Fort and burned the barracks to the ground