Elmander was born in Alingsås, Alingsås Municipality. He started his career as a striker for Swedish clubs but changed to a centre midfielder Holmalunds IF and Örgryte, before making the move to Dutch club Feyenoord at the age of 18, where he continued to be used as a midfielder. Although never a first team regular, he came on as a substitute in the 2002 UEFA Cup Final 3–2 win against Borussia Dortmund.