avoid too early thread shutdown in ResponderWorkerScheduler