Adding robots.txt for allowing all automated user agents to access anything on site.