Following Labor's win at the December 1972 election, he was appointed to the Whitlam ministry as Minister for Housing. In October 1973, he was appointed to the additional portfolio of Works. In November the two portfolios were combined as Housing and Construction. In June 1975 he was moved to the Minister for Aboriginal Affairs. He lost this position as a result of the dismissal of the Whitlam Government in November 1975. He subsequently became the Opposition Whip.