Patent Document ID: 8812949
Application ID: 13242337

Base Claim:
1. A computer-implemented method for automatically outputting semantically significant text from a markup language document, comprising: storing a set of markup language documents, the set of documents including a first markup language document; parsing the first markup language document to produce a parse tree; segmenting the parse tree into a set of segments including a first segment, each segment included in the set of segments representing a unique path in the parse tree; determining the total number of documents included in said set of documents that include said first segment; determining the percentage of said documents included in said set of documents that include said first segment based on said determined total number and the total number of documents included in said set of documents; determining whether said determined percentage meets or exceeds a threshold; and flagging the first segment for search index exclusion in response to determining that the determined percentage meets or exceeds the threshold.

---

Claim 20:
20. The method according to claim 1 , wherein: said set of documents includes a second markup language document, and the method further includes: parsing the second markup language document to produce a second parse tree, the second markup language document being included in said set of markup language documents; segmenting the second parse tree into a second set of segments; determining that said second set of segments includes a segment that matches said first segment that has been flagged for search index exclusion; in response to determining that said second set of segments includes a segment that matches the first segment that has been flagged for search index exclusion, removing from the second markup language document at least a portion of the segment that matches the first segment; and indexing the second markup language document after removing said at least a portion of said segment from the second markup language document.