The influence of his father secured Small a position as secretary to former President Andrew Johnson. In 1878, President James Garfield appointed Small secretary to the United States commissioner general of the Paris Exposition of 1878. Despite his other interests, Small retained an "obsession for politics," and near the end of his life he boasted of having "clasped hands with every president from James Buchanan to Herbert Hoover."