Serves a robot.txt which can be modified programatically