It then adds all pages that link to, or are linked to by, one of those 200 pages. This step typically swells the set of pages to 1,000 or more. Clever initially assigns each page a hub score of one and an authority score of one. It sums up all the authority scores to get a page's hub score, and sums up all the hub scores to get a page's authority score. TO WORK One implementation of Clever, called TaxMan, for Taxonomy Manager, is a user interface for people who want to build and maintain a taxonomy for a particular field.
TaxMan adds search features specific to that field and acquires and updates pages automatically.
GP is using TaxMan to set up commodity profiles to search for pertinent sites on the Web for their commodity teams. Current searches yield far more information than the teams can sort through and GP is hoping that TaxMan will help build profiles more efficiently. Clever is also the backbone of two other Almaden projects. The other project, Focused Crawler, is a high-end version of Clever that uses an automatic document categorizer to recognize pages relevant to a particular topic. A system administrator feeds the categorizer exemplary documents and trains it to recognize documents that are similar.