His boyhood was spent in the family home in London and at his grandfather 's Somerset country home , Brympton d'Evercy which he inherited after the deaths of both his grandfather and father .
As a youth , he lived in London and at his grandfather 's country home , Brympton d'Evercy in Somerset .