Born in Launceston, Tasmania, Goss started in the sport competing in track cycling. In 2005, he won a bronze medal in the Team Pursuit at the World Championships in Los Angeles along with Ashley Hutchinson, Mark Jamieson and Stephen Wooldridge. Then the following year he won the gold medal in Bordeaux with Peter Dawson, Mark Jamieson and Stephen Wooldridge.