Fix delay to subtract out the time that the request took

* If a request took 10 seconds, we don't need to wait for another 10
seconds