Fix bug and improve reporting

Deep spidering wasn't working properly and it was difficult to search for broken links in multiple output files.
Merge branch 'kc-par-spider'