As the defence of his lands became paramount during the civil war of 1135-53, it is likely that Robert Bossu began the fortification of Shilton Hill. The Earl of Leicester’s new motte and bailey castle would protect the vale of Kirkby, along with Beaumont’s lines of communication to the South and West. Earl Shilton's castle was built around the site of an existing twelfth-century chapel called Saint Peter's that lies between Church Street and Almey’s Lane. This area is known locally as 'Hall Yard'. Nearby are the springs, from which the castle drew its water, now known as Spring Gardens.