Be a good citizen and put the colormap back where we found it.