It was sold to James Gwynne in 1896 and was where his children Rupert, Roland and Violet grew up. The property remained in private hands into the 20th century, when it was restored by the Sussex architect and antiquarian, Walter Godfrey. It was used as a base for Canadian troops during the winter of 1941-42 while they prepared for the Dieppe Raid. Later it was the East Sussex headquarters of the Auxiliary Territorial Service.