allow crawling without proxy