Explicitly sets the color on spectrum when closing the color chooser modal

This resolves an issue where the most recently selected colors were not present.