Born in Mittau (now Jelgava), Courland to a family of local Baltic Germans, von Rüdiger graduated from a local college in Mittau and in 1799 he joined the Semenovsky Regiment of Life Guards. Throughout his career he served in a number of other units and occupied a number of posts, including Warrant Officer of the Sumy Hussar Regiment (1800) and adjutant to General Peter von der Pahlen (1801). During the Napoleonic Wars he took part in the Battle of Guttstadt-Deppen of 1806. Transferred to Grodno Hussar Regiment, he fought in Battle of Friedland of 1807. For his part in the war he was awarded the Order of St. Anna, 3rd Class.