added robots.txt usage