fix job removal in cleanup

No longer attempts to remove jobs from jobq that may not have been added
previously.
interrupt sleep when batch clients are waiting

This improves performance of closing (shutdown) and when the queue gets
full.
skip tests that fail when a bot is running
small refactor and fix problems with ordering of jobs