Changed robots.txt to be dynamic.