An intelligent online search agent endeavoring to more efficiently crawl the web