If all queues were closed, we'll give a grace period to try to fix it before closing the server