mtigas/dotfiles — pull request #2 by SebastianStadil (2013-01-01 02:53:27+00:00)
Title: Optimized for more cores, larger datasets, higher io.

Increased number of simultaneous threads to take advantage of EC2's cluster compute instances. Revert from 20 to 4 threads for instances with less cores.

Added code to pick a chunk size to avoid exceeding S3's limit of 10,000 chunks.

Parameterized the S3 endpoint to avoid unwanted balancing between regions.