snowplow/snowplow — pull request #50 by mtibben (2012-10-01 06:35:49+00:00)
Title: Page through S3 results using marker

S3 returns 1000 results per request.

We need to page through these results to be able to handle more files, using the 'marker' option