kovidgoyal/calibre — pull request #350 by spacekpe (2014-12-23 20:32:17+00:00)
Title: news: Extend BasicNewsRecipe with ability to skip articles which were downloaded in the past.

This function has to be explicitly activated by
ignore_downloaded_articles = True in recipe definition.

When activated, the recipe stores hashes of downloaded articles in file named
/'recipes'/'recipe_storage'//.
Articles which already has hash stored in the file are not downloaded again.

The idea is taken from
http://www.mobileread.com/forums/showpost.php?p=1295505&postcount=10
but the code was changed significantly to improve integration.