Patent Document ID: 7558787
Application ID: 11481735

Base Claim:
1. A method comprising a computer system implementing a testing interface that allows testing of a loss in variety of a set of results returned by a specific search query, wherein implementing the testing interface comprises the steps of: identifying a set of one or more terms related to the specific search query; wherein the set of one or more terms are not part of the specific search query; obtaining a plurality of search results for the specific search query; determining a first number of results of the plurality of search results; determining a second number of results for each term of the set of one or more terms related to the specific search query, wherein the second number is the number of results that contain said each term; determining, for said each term, a third number of historical search queries, and adding said third number to a running total; wherein said third number is based on a count of those historical search queries that include both the specific search query and said each term; determining a first ratio of said third number to the running total; determining a second ratio of the second number to the first number; determining a relevance of the set of results; wherein the set of results includes the plurality of search results, and wherein determining the relevance of the set of results is based at least in part on: (a) said second ratio, for one or more related terms, of the second number to the first number; and (b) said first ratio, for one or more related terms, of said third number to the running total.

---

Claim 8:
8. The method of claim 1 , wherein determining the relevance of a set results includes: determining the relevance of each search result in the plurality of search results based on each term in the set of one or more terms; generating a total relevance for the set of results based on all the terms in the set of one or more terms; and the steps further comprise: generating a value representing the relevance of the set of results; and reporting the total relevance for the set of results.