Improved support for shipping to S3; translate files into batch specific and general biodata S3 buckets