He and his sister grew up in Notting Hill until the Second World War, when, fearing a Nazi invasion after the Dunkirk, they moved with their mother to America. He spent two years at Phillips Academy in Andover, before returning home in 1942 to finish his schooling at Eton.