On 2 May 2015, during the 2015 Burundian unrest, Gaciyubwenge urged the armed forces of Burundi to remain neutral and act in accordance with the Arusha Agreements that ended the Burundian Civil War. He also stated that "all political actors" should avoid the use of violence. On 18 May 2015, after a failed coup d'état took place, he was fired. He was replaced as Minister by Emmanuel Ntahomvukiye.