adding s3 streaming, various fixes