Within 50 years of Domesday, Brightwell Castle was involved in the civil war between King Stephen and his cousin Matilda. The exact site of this castle is unknown, but it probably lay within the moated areas of what later contained St Agatha's/Brightwell manor house in Brightwell or Stonor Hayes manor house in Sotwell.