Added restrictions in robots.txt