Stop trying to color bits before the character.