Allow worker handlers to unregister from the work queue.

When unregister requests are made, they are put on a queue. Right before putting the worker back to the work queue  verify the unregister queue. If the worker is found on the queue then simply don't put him back on the work queue.