Make sure we only record one copy of each linked `URL`
Fixes issue with the root `URL` and relative links.
Have `Faraday` follow redirects for us.
`Nokigiri::XML` does not parse wild HTML files correctly.
Tweaks to `Crawler::Config`

* Expose original domain.
* Improve parameter naming.