Patent ID: 8489643

Claim:
A method for automatically generating domain knowledge bases based on deep Web sources, the method being performed by a computer, comprising: training a knowledge base constructor on a plurality of selected web sites according to a domain to detect a plurality of fields defined by said domain; locating a first plurality of deep web sources according to said domain; analyzing said first plurality of deep web sources to detect said plurality of fields by said knowledge base constructor; selecting at least one frequently appearing field for said domain to form a first selected field; creating a first knowledge base for said first plurality of deep web sources; locating a second plurality of deep web sources according to said domain; analyzing said second plurality of deep web sources to detect said plurality of fields by said knowledge base constructor; selecting a second frequently appearing field according to said domain to form a second selected field; creating a second knowledge base for said second plurality of deep web sources; combining said first and second knowledge bases by said knowledge base constructor to form a combined knowledge base; refining said combined knowledge base by: determining a new frequency of appearance for said first selected field according to frequency in said first and said second plurality of deep web sources; determining said frequency of appearance for said second selected field according to frequency in said first and said plurality of deep web sources; and performing statistical analysis of said frequency of appearance of said first and second selected fields according to said new frequency of appearance for said first selected field and according to said frequency of appearance for said second selected field to refine said combined knowledge base; and aggregating content provided by a plurality of deep web sources through at least one selected field according to said combined knowledge base.