Levin was born on 10 January 1902 to a peasant family of Russian ethnicity in the village of Antsir in Yeniseysk Governorate. He graduated from seven classes in 1919. Levin was drafted into the Red Army in 1921. In December 1922, he graduated from the 26th Krasnoyarsk Infantry School. He became a junior commander in the 3rd Shock Regiment of the Pacific Corps at Vladivostok. In 1923, Levin entered the Vladivostok Infantry School, graduating in 1926. He became a platoon commander and machine gun company commander in the 76th Rifle Regiment of the 26th Rifle Division at Nikolsk-Ussurisky. He fought in the Sino-Soviet conflict of 1929. Levin was demobilized in April 1932.