Patent ID: 7849049
Filing Date: 2010-12-07
Classification: G06F,Y10S

Abstract:
1. A system comprising: a core server computer comprising a data capture schema comprising: a set of tables to store linguistically-extracted data parsed from a plurality of source documents having unstructured data by one or more natural-language processing transformation tools, wherein the linguistically-extracted data is extracted using linguistic natural-language processing-based routines in one or more linguistic processing transformation tools; wherein the linguistically-extracted data is stored and associated with a particular source document at a sentence level; wherein the linguistically-extracted data comprises linguistically-extracted relationships and linguistically-extracted entities at the sentence level, wherein the linguistically-extracted entities are at least noun phrases; wherein at least one of the set of tables stores the linguistically-extracted entities; wherein at least one of the set of tables stores linguistically-extracted entity information, the linguistically-extracted entity information comprising linguistically-extracted entity identification, linguistically-extracted entity attributes, and linguistically-extracted data categorizations from one or more categorization tools at the sentence level; wherein the one or more categorization tools determine a confidence level for each linguistically-extracted data categorizations, wherein the linguistically-extracted data categorizations are based on the linguistically-extracted entities and the linguistically-extracted relationships, and are placed within predetermined categories, wherein the confidence level for each linguistically-extracted data categorizations combines one or more data points linked to the linguistically-extracted entities and the linguistically-extracted relationships to create a statistically-oriented calculation of confidence assigned to each linguistically-extracted data categorizations; wherein at least one of the set of tables stores the linguistically-extracted relationships, the linguistically-extracted relationships comprising associations between linguistically-extracted entities at the sentence level; wherein at least one of the set of tables comprises a mapping table between the linguistically-extracted entities, the linguistically-extracted entity information, and the linguistically-extracted relationships at the sentence level; wherein each of the plurality of source documents and included sentences are assigned a unique key that identifies a particular source document and included sentence throughout a software system allowing (i) cross-analysis, (ii) linking of results for further analysis, (iii) drill-down from analytical reports back to the particular source document and included sentence or (iv) drill-down from analytical reports back to transformation information stored in the data capture schema; wherein the confidence level for at least one of the linguistically-extracted data categorizations is output for use in structured data tools; and wherein the one or more data points are selected from the group consisting of: confidence score of value provided by the one or more transformation tools, number of relationships found in the source of unstructured data compared to the size of the source of unstructured data, average number of relationships per kilobyte for relationships of the same type as a selected relationship, number of entities found to be associated with a relationship compared to an average number of entities for relationships in a same hierarchy, number of times similar relationships have been found in the past, number of entities that are grouped together to form a master entity, a number of times an entity occurred in the source of unstructured data compared to the average number of occurrences for entities in the same hierarchy, weighted confidences based on hierarchy of a relationship or entity, measures of data extraction confidence integrated with the system via an analysis schema, measures based on a fullness of a relationship's attributes, measures based on the confluence of a same finding by multiple transformation tools, measures based on the source of the unstructured data, and combinations thereof.