snowplow/snowplow — pull request #48 by mtibben (2012-09-28 06:54:19+00:00)
Title: Execute S3 copy operations concurrently

The S3 copy operations are a big bottleneck

This change allows us to execute the S3 copy operations concurrently using Ruby threads.

I've also refactored move_files into it's own function and created a simple class to handle S3 locations