processing of batch pool'd tweets before shutdown