Add robots.txt to not crawl rest data