Høgh-Guldberg grew up in Copenhagen to wealthy, well-connected parents. In 1792 he became a second lieutenant à la suite in the Danish army, in 1794 first lieutenant à la suite in the 1. Jutland Infantry Regiment, in 1798 Captain, in 1803 her served as a staff officer and in 1806 he was given his own company. He served during the English Wars and was on 28 January 1809 awarded the Order of the Dannebrog and was in the same year promoted to major and made a battalion chief. In 1816 he was promoted to lieutenant colonel and in 1823 he was promoted to colonel and relocated to Aarhus to take charge of the forces there. 9 years later he retired from the army but remained in Aarhus.