Added dynamic robots.txt generation