Also adding main/prod to disallow (root will still be crawled)
Merge pull request #1057 from geoadmin/dev_fix_robots2

Also adding main/prod to disallow