Managament on robots.txt file on staging servers reorganised (use of robots.exclude.txt file and rewriting rule in .htaccess.