Adding basic robots.txt file to project, with "User-agent: *", no further restrictions.