changed robots.txt to allow robots