In later life, however, she told biographer Tim Heald that Philip was "an English gentleman"