Keep a max number of queued job run requests, to mitigate DoS