Make the color assignments more terminal consistent