Patent ID: 11921676
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 13:
14. A computer program product comprising a computer readable storage medium having unstructured document processing program instructions embodied therewith that enable block-based text analytics, the unstructured document processing program instructions executable by a computing device to cause the computing device to:
identify a plurality of deduplicated data blocks associated with a collection of unstructured documents;
sort the plurality of deduplicated data blocks in descending order based upon at least one block frequency metric;
select a highest sorted unprocessed deduplicated data block;
apply text analytics to the selected deduplicated data block by facilitating application of at least one natural language processing technique; and
apply at least one result of the text analytics to any document among the collection of unstructured documents including the selected deduplicated data block, wherein applying the at least one result comprises labelling document data based upon data attributes determined from the text analytics and characterizing the labelled document data based upon application of at least one machine learning technique.