I want to know the answer to the following question:
When was the program necessary to crawl and archive the web created?
All the background I'm provided with is that "To overcome inconsistencies in partially cached web sites, Archive-It.org was developed in 2005 by the Internet Archive as a means of allowing institutions and content creators to voluntarily harvest and preserve collections of digital content, and create digital archives.". Is that enough to answer the question?
Answer: no