Following the suppression of the newspaper, O'Leary joined the IRB's Ladies' Committee, in order to help in the preparations for the 1867 Fenian Rising. However, the rising failed. She decided to return to her home in Tipperary, where she would live until her brother's return in 1885. There, she kept herself busy by writing poetry and volunteering for Catholic charities.