sunlightlabs/scrapelib — pull request #20 by kaitlin (2014-06-27 19:18:53+00:00)
Title: updated file caching to check last modified headers 

I updated the file cache so that it will re-download a file if the last modified headers of the cached response and head response match. If there is no last-modified header on the head request, then it also re-downloads the file.