But when I resigned from the Cabinet in the middle of the Westland affair in 1986 I was much cheered when I almost immediately received an invitation to lunch at the Athenaeum from Graham Leonard ( obituary , Jan 7 ) , at the time Bishop of London .