Provalov was drafted into the Red Army in September 1928. In 1929, he graduated from the regimental school of the 39th Rifle Division's 117th Rifle Regiment. Provalov became an assistant platoon commander and fought in the Sino-Soviet conflict over the Chinese Eastern Railway between September and November. He was wounded during the fighting. In 1930, he joined the Communist Party of the Soviet Union. Provalov graduated from the Irkutsk Infantry School in 1931. In December of that year, he became a platoon leader in the regiment. He then became a company commander and later commanded the division's separate machine gun company. In 1933, he graduated from the Omsk Military School. In November 1937, Provalov became chief of staff of the 40th Rifle Division's 120th Rifle Regiment. He became the regimental commander in July 1938.