Choge graduated from Kabikwen Secondary School in 2004. At the 2004 World Junior Championships in Athletics he won 5000 metres race. At the 2004 IAAF World Athletics Final he was third in 5000 metres. At the 2005 IAAF World Cross Country Championships he won the junior race and junior team race. At the 2005 IAAF World Athletics Final he finished third in 3000 metres.