The building on the present site was pre-dated by Saxon ane perhaps earlier structures. A Norman Adulterine castle was constructed approximately 300 meters to the north-east of the hall during the Anarchy in the early 1100s.