rumblelabs/asset_sync — Issue #16: Files that already exist on S3 are still uploaded
Author: jasonhutchens
Created: 2011-11-08 07:45:37+00:00
State: open

We have many more than 1000 files in our S3 bucket, but the default value for max-keys in fog is 1000. This means that AssetSync::Storage::get_remote_files only returns the first 1000 files found, meaning that, although local_files_to_upload should be empty, it ends up containing many thousands of files.