robots.txt is now server by MainController, some minor tuning