Soeparmin entered the military during the Japanese occupation of the Dutch East Indies and served in the Japanese-sponsored Defenders of the Homeland. After Indonesia proclaimed its independence in 1945, Soeparmin entered the newly formed Indonesian Army and served as a company commander from 1951. He was promoted afterward and commanded several battalions from 1951 until 1957.