This section describes the survey and evaluation methods used to quantify the size of the deep Web and to characterize its contents. Data for the study were collected between March 13 and 30, 2000. In actuality, data storage from deep Web documents will therefore be considerably less than the figures reported herein.
Web is presented in the same manner.
HTML included Web page comparisons provide the common denominator for comparing deep and surface Web sources. All retrievals, aggregations and document characterizations in this study used BrightPlanet 's LexiBot technology. The LexiBot uses multiple threads for simultaneous source queries and then document downloads. All rights reserved. Privacy and site use policies.