Herzog was born in New York City, December 27, 1859, the son of Philip and Henrietta (Benedict) Herzog. He was a graduate of Columbia University (A.B., 1881, LL.B., 1882. A.M., Ph.D., 1883). He wrote for press, and "The Railroad Transportation Problem". He was engaged in practice as patent attorney and electric engineer since 1883. He was the inventor of electrical devices, telephone accessories, automatic switch-boards, the teleseme, police call systems, elevator signals, chemical annunciator as well as other devices, receiving medals at Paris Exposition, 1900 and the Pan-American Exposition, Buffalo, 1901). He was the president of Herzog Teleseme Company, and other corporations.