created allow-all robots.txt file.