Allow removing current and queued listeners.