#6404: Adjust how we test URLS.
#6404: Finetune 404 check.
Merge pull request #6466 from openscholar/6404-dealing_with_links

Adjust how we test URLS.