Born in Glasgow, Kelly fought out of the Holyrood ABC. He won the ABA flyweight title in 1982 and the same year fought for Scotland at the Commonwealth Games in Brisbane, taking the silver medal at flyweight after losing in the final to Kenyan Michael Mutua.