Patent ID: 9183275
Filing Date: 2015-11-10
Classification: G06F

Abstract:
1. A non-transitory computer program storage device storing computer program product comprising program codes for performing the steps of a data profiling method for profiling new input data entries not previously processed for data profiling and data integration, wherein said method comprises the steps of: an automatic data processing step of reading a new free-text input data entry set, extracting fragments of each input data entry, assigning semantic features to the fragments, and labeling semantic fragments of each of said input data entries according to said fragments and semantic features of said fragments, wherein said fragment comprises a token sequence representing an independent semantic concept and information unit; and an automatic data analyzing step of, based on said labeled semantic fragments, performing a semantic-level data analysis on the input data entry set to obtain analysis results; wherein the data processing step comprises: a semantic feature extracting step of extracting the fragments of each input data entry and the semantic features of said fragments; a scoring step of scoring said fragments according to the semantic features of said fragments; and a fragment labeling step of labeling semantic fragments according to the scores of said fragments, and wherein said scoring step further comprises: clustering the data entries into a multi-aspect data entry community based on clustering of the fragments; and scoring headwords of each data entry community of the multi-aspect data entry community, wherein said scoring comprises, for a given word unit W where, Weight(W