A Democrat, Sheppard served as district attorney of the fifth judicial district from 1882 to 1888, and district judge from 1888 to 1896. He was temporary chairman of the state Democratic convention in 1892, and a delegate to the 1893 Bimettalist convention. He was also a delegate to the 1896 Democratic National Convention.