then they eventually circled fort mary which was the site of andros' confinement