Patent ID: 8041710

Claim:
A system for diagnosis of search relevance failures, the system comprising: memory; at least one processor communicatively coupled to the memory; a dissatisfaction report generator component to automatically generate search result dissatisfaction reports, the dissatisfaction report generator component including: a human judgment component stored in the memory and executed by the at least one processor to: determine a difference in relevance of search results provided by multiple search engines in response to an associated query; and generate one or more search result dissatisfaction reports based in part on the difference; and a click log component stored in the memory and executed by the at least one processor to: analyze recorded clicks on search results in one or more query click logs; determine if one or more portions of the search results are irrelevant to the associated query based in part on the analyzing of the recorded clicks; and generate one or more search result dissatisfaction reports if one or more portions of the search results are determined to be irrelevant; a collection component that acquires the search result dissatisfaction reports; and a diagnostic component that automatically identifies one or more potential causes of reported dissatisfaction to facilitate resolution thereof.