Harmer was born in Germantown section of Philadelphia. Began work as a shoe manufacturer. He became a member of the Philadelphia City Council, serving from 1856–1860 and then a recorder of deeds for Philadelphia 1860–1863. He was a delegate to the 1868 Republican National Convention.