Byrne was active in several civic organizations, including the YMCA and Elks. After attending the 1896 Democratic National Convention and hearing William Jennings Bryan speak, Byrne developed a lifelong interest in oratory. In addition to honing his own speaking skills through study and practice, Byrne instructed a course on public speaking for the Albany-area YMCA. He also taught public speaking at Albany Law School. Byrne spoke frequently at public events and developed a nationwide reputation as an orator on behalf of these and other organizations. In 1922 and 1924, Byrne nominated Al Smith for governor at the state Democratic convention. In 1938, he was called upon to nominate Herbert H. Lehman for reelection as governor.