Patent Document ID: 8577155
Application ID: 12619690

Base Claim:
1. A system for duplicate text recognition comprising: a first means for dividing an electronic text into a plurality of phrase segments; a second means for converting each of the phrase segments into a unique and fixed-length bit string; a third means for storing a plurality of groups of the bit strings, each group of bit strings (string group) comprising a plurality of bit strings respectively corresponding to the phrase segments in a particular electronic text; and a fourth means for determining whether a predefined similarity between any two string groups in the third means reaches a first threshold, and for determining the two electronic texts corresponding to the two string groups are duplicate texts if the predefined similarity between the two string groups reaches the first threshold.

---

Claim 7:
7. The system for duplicate text recognition of claim 1 further comprising: a seventh means for further dividing the phrase segments into individual terms; an eighth means for calculating a term weighing parameter for each term based on the location where the term appears in the text and the frequency of the term's appearance; a ninth means for calculating a phrase weighing parameter for each phrase segment based on the calculated term weighing parameters for the terms contained in the phrase segment; and a tenth means for clearing any bit string corresponding to a phrase segment with the calculated phrase weighing parameter less than a third threshold from the string group that contains the bit string.