When switching between HSB & RGB color modes, translate the color values as well.