Toggling a color while paint mode is active will remove the toggled state on the paint button