skipping dead hostnames, expand_urls improvements