Removed robots.txt restrictions