After the German defeat of the 10th Army in the Second Battle of the Masurian Lakes, Radkevich relieved Thadeus von Sivers as commander of the 10th Army on 25 April 1915. According to the Russian military historian A. A. Kersnovsky in "History of the Russian Army", “An excellent corps commander, General Radkevich felt insecure at the head of the army and needed a mentor.” Radkevich commanded the 10th Army during the Battle of Vilna in August–September 1915, the Sventiany Offensive in September–October 1915, the Lake Naroch Offensive in March 1916, and the Baranovichi Offensive in July 1916. On 4 October 1916, Radkevich was appointed a member of the Military Council of the Russian Empire.