[Processor] Prevent potential bug when a queue is cancelled or removed.

Signed-off-by: Regis Merlino <regis.merlino@intel.com>