Project: duracloud
Issue DURACLOUD-410: Use Amazon multi-part upload for large files
This task is to update the S3StorageProvider to make use of Amazon's multi-part upload option for S3 when content is large enough to require chunking. This would mean that rather than storing our chunked file parts (and associated manifest) in S3, we would use the multi-part tools to push up the pieces and assemble them again in S3. Since the MD5 for the entire chunked file is not available from S3, we will need to calculate it on transfer and store it as metadata.
Story points: 5