Detach test pool thread only if we have a blocking startup