Decide if the buffer is colourable at open time, not every iteration.

This fixed the hjkl character splurging bug :D