Joseph served as a delegate to the Republican National Convention in 1868 and 1872, and in early 1872 served as a Mobile postal clerk and as a clerk in the Mobile custom house. In 1870 he began his journalism career founding the Mobile "Republican". He would come to found and edit four newspapers in Mobile and Montgomery from 1870 until 1884