Don't remove colour when clicking the same region twice

Under most circumstances, this is nothing less than a slight user
improvement.
However, if the vote type mode is final_scores then it can be quite
annoying! Need to make a workaround for this.