Supports https links, and adds option to disable regex restriction on hosts

Adds support for following https URLs. Adds `:short_hosts => false` option to disable pattern matching restriction on URL hosts.