Patent Document ID: 8600973
Application ID: 13342560

Base Claim:
1. A computer-implemented method comprising: determining a no-match score, a click score, and a query count for a query term substitution rule that is used to revise queries that include a query term, to include a substitute term for the query term, wherein the no-match score for the query term substitution rule indicates a quantity of revised search queries that (i) were generated using the query term substitution rule to include the query term and the substitute term, and (ii) were each used in identifying a respective set of search results that (I) were associated with text that did not include the substitute term, and (II) were included on a respective initial search engine results page, wherein the click score for the query term substitution rule indicates a quantity of revised search queries that (i) were generated using the query term substitution rule to include the query term and the substitute term, and (ii) were each used in identifying a respective set of search results, one or more of which were (I) associated with text that included the substitute term, (II) were selected by a user, and (III) were included on a respective initial search engine results page, wherein the query count for the query term substitution rule indicates a quantity of revised search queries that were generated using the query term substitution rule to include the query term and the substitute term; and determining whether to remove the query term substitution rule from a query revision model based on the no-match score, the click score, and the query count.

---

Claim 8:
8. The method of claim 1 , wherein the respective set of search results comprises top N search results of the search results.