Assume NX Jobs w/o listener are removed.

As there is a "window" currently, where this might happen.
We will probably need to revisit this, maybe GC the jobs
instead removing them directly from NexusTaskInfo.