changed robots.txt to allow all