In 2002 Olsen won the silver medal at the European Championships outdoor as well as indoor. In 2003 a hand injury held him back, but a revised training plan removed the pain in his wrist. Thus Olsen was ready for a comeback in 2004, and at the 2004 IAAF World Indoor Championships he won a Bronze medal - a placement he repeated at the Olympic Games in Athens. But because of a positive doping of the gold medalist Yuri Bilonog (Ukraine), which caused the cancellation of the medal, Olsen inherited the silver medal after the announcement of redistributing medals.