Patent ID: 6973446

Claim:
A data mining system with a CPU for finding knowledge by using a lower-order learning algorithm for performing learning on a data set to obtain hypotheses, wherein the data set comprises label values indicating classification results and sets of attribute values indicating keys for classification, and for predicting a label value for one datum within said data set by using said hypotheses, and a higher-order algorithm for finding knowledge by means of selective sampling repeatedly reading a part of data selected from a database stored in a large-capacity data storage device into a main memory and performing learning again by using said lower-order learning algorithm, the data mining system comprising: input means for inputting said lower-order learning algorithm and data on which said lower-order learning algorithm performs learning; learning means for inputting a plurality of partial data sets, generated by sampling from data stored in said main memory, as training data to said lower-order learning algorithm, and causing said lower-order learning algorithm to perform learning on said data so as to obtain plural hypotheses; data selection means for predicting label values for a plurality of sample candidate points read from said large-capacity data storage device by using said hypotheses obtained by said lower-order learning algorithm and said learning means, estimating information amounts of the sample candidate points based on obtained predicted values, selecting one or more sample candidate points in large information amounts, and additionally storing the selected candidate points into said main memory; control means for repeating processing for obtaining a plurality of hypotheses and corresponding data in said main memory by using said learning means and said data selection means until a predetermined stoppage condition is satisfied, and storing a plurality of resulted hypotheses as final hypotheses into said main memory; and prediction means for predicting a label value of unknown-labeled data based on an average or weighted average among said plurality of hypotheses.