Optimized for more cores, larger datasets, higher io.

Increased number of simultaneous threads to take advantage of EC2's cluster compute instances. Revert from 20 to 4 threads for instances with less cores.

Added code to pick a chunk size to avoid exceeding S3's limit of 10,000 chunks.

Parameterized the S3 endpoint to avoid unwanted balancing between regions.