Don't trim special colormap values