Levy was a member of the New York State Assembly (New York Co., 4th D.) in 1908, 1909, 1910, 1911, 1912 and 1913. He was Chairman of the Committee on the Judiciary in 1911; and Majority Leader in 1913. He was also the chairman of the managers on behalf of the Assembly (i.e. the prosecution team) at the impeachment trial of Governor William Sulzer in 1913. He was an alternate delegate to the 1912 Democratic National Convention.