Attempt to fix the color hashing problem, also clients no longer send
color data with the message