ChemicalRascal/Dungeons-and-Dragons-Insider-Compendium-Downloader — pull request #1 by radmike (2014-12-31 20:37:26+00:00)
Title: skips files that are already downloaded

first off this was great to grab a backup of the compendium stuff, thanks!!

full compendium grab was timing out for me, so I wanted to update the code to skip files it already had grabbed, and just get the missing ones (so I could run it multiple times + get it all)

for this pull request:
* added checks to skip downloads for files that already exist in the target dir
* also added a couple of output print statements around this functionality
* added settings.py to gitignore since that would have credentials in it
* ended up having to switch the BeautifulSoup import to bs4 to get it to work on OS X