Inc. The Web Characterization Project conducts an annual Web sample to analyze trends in the size and content of the Web.
Analysis based on the sample is publicly available.
The sample is obtained by creating a list of randomly generated IPv4 addresses, and then attempting to connect to Port 80 at each address to identify the presence of public Web services. If an HTTP service is identified, harvesting software captures the site and stores it for future analysis. The scope of the sample is confined to publicly available Web content only. If our sampling interferes with your network operations, or you have questions about our activity, please contact us at one of the addresses below.