Robots.txt is not considered