Adds configurable symlink following and image file detection to the scraper.
This should take care of #7 and #10.