Only force once

This fixes mainly the "buffer autocommands exist?" check and improves the initial setup.

Without this, color_highlight is behaving very bad - setting up colors much too often.