link improvements

* remove dupes
* use http_get (for redirects)
* support https
* support no path query (by adding a /)