The son of Christopher James, 5th Baron Northbourne, he was educated at Eton College and Magdalen College, Oxford, where he was a member of the Bullingdon Club with former Conservative Prime Minister David Cameron, and Boris Johnson. He is a family friend of David Cameron. The two were on holiday together in Italy in August 2011 when Cameron had to return to deal with the London riots. James was given a job in government on 5 July 2010, by Education Secretary Michael Gove, reviewing state school spending. He earned an MBA from INSEAD in 1991.