utility for processing a work queue with a backoff triggered by system resources