Also handle concurrency in the cancel vote codepath