option to disable ajax crawling