Born in Fiesch in the canton of Valais, Albrecht made his World Cup debut at age 19 in January 2003 in a slalom at Schladming, Austria. A few weeks later, he competed in the slalom at the 2003 World Championships at St. Moritz. That March, he won three gold medals and a silver at the Junior World Championships at Serre Chevalier, France.