implemented cookies to crawlers