[Processor] Prevent potential bug when a queue is cancelled or removed.

* Call the finally callback directly when the queue is removed
* Prevent multiple cancel() calls