Patent ID: 11921676
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 17:
18. A system comprising:
at least one processor; and
a memory storing an application program, which, when executed on the at least one processor, performs an unstructured document processing operation that enables block-based text analytics, the operation comprising:
identifying a plurality of deduplicated data blocks associated with a collection of unstructured documents;
sorting the plurality of deduplicated data blocks in descending order based upon at least one block frequency metric;
selecting a highest sorted unprocessed deduplicated data block;
applying text analytics to the selected deduplicated data block facilitating application of at least one natural language processing technique; and
applying at least one result of the text analytics to any document among the collection of unstructured documents including the selected deduplicated data block, wherein applying the at least one result comprises labelling document data based upon data attributes determined from the text analytics and characterizing the labelled document data based upon application of at least one machine learning technique.