Add support for reading from sitemap.xml
Merge pull request #152 from pmuir/sitemap_xml

Add support for reading from sitemap.xml
Add support for an external spidering skip list
Merge pull request #150 from pmuir/user_specified_skips

Add support for an external spidering skip list
Remove puts, which appear to generate blank lines in console log
Merge pull request #158 from pmuir/remove_blank_lines

Remove puts, which appear to generate blank lines in console log