Originally a wooden Anglo-Saxon castle, the present castle was built by Normans around 1070 of red sandstone.