scrapy/scrapy — pull request #370 by loucash (2013-08-16 16:56:49+00:00)
Title: FilesPipeline extracted and separated from ImagesPipeline

- ImagesPipeline interface has not changes
- ImagesPipeline has been built on top of FilesPipeline
- tests for FilesPipeline and ImagesPipeline has been separated

FilesPipeline functionality is:
- file downloading
- minimize network transfers and file processing, doing stat of the files and determining if file is new, uptodate or expired.

ImagesPipeline functionality is:
- converting images to JPG
- image thumbnail generation logic