CacheThreadScheduler Evictor should Check Removal

Before unsubscribing the worker, the Evictor should check that it actually removed the worker from the queue.

FIxes #1826