Fix robots.txt fetching for -Efilter