Add the ability to specify max concurrency and a little bit more logging info when requeuing requests