When the Conservatives returned to power at the 1979 general election, he became Parliamentary Under-Secretary of State for Foreign Affairs for the Foreign and Commonwealth Office. In 1981, he was promoted to Minister of State for Foreign Affairs within the same department. In 1982, he followed his Secretary of State, Lord Carrington, in resigning over Argentina's invasion of the Falkland Islands. He returned to office in 1983, again as a minister of state in the Foreign and Commonwealth Office. In 1985, he was moved to the Privy Council Office as Minister for the Arts and Minister for the Civil Service, which was his last ministerial office. He resigned in 1990.