Varonka was born in Sokółka County, Grodno Governorate on 4 April 1891. From 1909 to 1914, Varonka studied at the Saint Petersburg State University and published various Belarusian and Russian newspapers. In 1917, he joined the Belarusian Socialist Assembly and co-initiated the First All-Belarusian Congress. From 21 February to May 1918 he was the first Chairman of the People's Secretariat (i.e. Prime Minister) of the Belarusian Democratic Republic. He was succeeded by Jan Sierada. From 19 April, he was also Minister of Foreign Affairs. When Soviet Russia began its westward offensive of 1918–19 and captured Minsk, the government of the Belarusian Democratic Republic went into exile.