Capture and store a number of real-world example robots.txt from high-profile sites