vi-mode.fish: Suppress errors from set_color

This can happen if TERM is unset, such as if fish is being used as the
remote shell for an application such as scp, rsync, git, etc.

Signed-off-by: Ian Munsie <darkstarsword@gmail.com>