Removed robots.txt files. Added automatic system to show dev or prod robots.txt file.