fix bug with long running jobs and external pools

If an external process pool is used, a long running job at the end of a
run resulted in some debug code triggering which detected a race
condition. The code was removed and a timeout was added to
process_waiter so that long running jobs are allowed to run up to a
certain point (0.5 hour for now)