Add some config for vim-signify.

Clear highlight to sign column and line number.