Reduce number of ssh calls when creating robots.txt file