Fine Gael lost power following the first general election in early 1982, however, Noonan subsequently joined the party's new front bench as Spokesperson for Education. A second general election in late 1982 following the collapse of the Fianna Fáil government, saw another Fine Gael-Labour Party coalition come to power. Just eighteen months after entering the Dáil, Noonan was appointed to the highly sensitive position of Minister for Justice. After a few weeks in office he revealed the illegal phone-tapping of journalists' phones, carried out by the previous Fianna Fáil administration that preceded it in power. That government had authorised illegal phone tapping of the journalists Geraldine Kennedy, Bruce Arnold and Vincent Browne. Seán Doherty signed warrants for the taps while serving as Minister for Justice. Noonan quickly earned a reputation as a tough and uncompromising Minister, regarded by many as one of the best incumbents of the position. His successes included the introduction of a new Criminal Justice Bill while also bringing in reforms in the Garda Síochána, the courts and the prison service and the facing down of a difficult prison officers' dispute. He also dealt with the wording of the controversial abortion referendum in 1983. Noonan, however, also presided over the justice ministry when inmates in an overcrowded and understaffed Spike Island prison set fire to the building.