disallowing "beta" folder for crawlers to crawl