In 2003, the National Council for the Defense of Democracy – Forces for the Defense of Democracy political coalition reached a ceasefire with the other combatants in the Burundian Civil War. From 2004 until 2005, Bunyoni served as the equivalent of the Inspector General of the new police force. From 2005 until 2007, he served as the Chief of Police of Burundi.