In 1979 , Governor Hugh Carey , a prominent Irish-American , invited Secretary of State for Northern Ireland , Humphrey Atkins , and the Irish foreign minister to New York to discuss the Troubles - much to the PM 's annoyance .