added and fixed support for <link ahref=xxx rel=canonical>.
treat those as simplified meta redirects.
updated spider dedup documentation in developer.html file.