improved in case of redirects + head requests for non-html files