Prior to his senior debut, Starodubtsev had much success at competitions in the younger age categories. At the 2003 World Youth Championships in Athletics he cleared a personal best of 5.10 m to take the silver medal behind Argentina's Germán Chiaraviglio. He then went on to claim consecutive gold medals at the 2004 World Junior Championships in Athletics and the 2005 European Athletics Junior Championships.