As an amateur, Kuziemski for Astoria Bydgoszcz won a bronze medal at the 2003 World Amateur Boxing Championships in the light heavyweight division, and another bronze at the 2004 European Amateur Boxing Championships. He then participated in the 2004 Summer Olympics, where he lost in the first round of the light heavyweight division to Beibut Shumenov.