Always set colors, so we have default palette if none is set