Fix set_color crash on 'ignore' and 'reset'
https://github.com/fish-shell/fish-shell/issues/996