actually reap after idling in worker threads

We don't exit this loop unless we have a job or unless we're shutting
down, so we should reap inside it.