Patent ID: 7937340

Claim:
A method for obtaining predicted user satisfaction data regarding the performance of a search mechanism for a computer which provides search results in response to user queries, the method comprising: storing interaction of users with the search results obtained in response to a query; determining at least one predictive pattern model for predicting user-satisfaction with the search results from the stored interaction of multiple users with the search results to improve the quality of search results, wherein determining at least one predictive pattern model comprises: running a pre judged set of results through the search mechanism; applying a candidate predictive pattern to context-based user behavior data for the pre-judged set of results; comparing resulting predicted user satisfaction data with judged satisfaction for the pre judged set of results; and if the candidate predictive pattern is successful at determining a predicted user satisfaction corresponding to the pre-judged user satisfaction, selecting the candidate predictive pattern as one of the at least one predictive pattern model; storing the at least one predictive pattern model; and applying said predictive pattern model to context-based user behavior data to determine a satisfaction value for the users with queries that indicate the satisfaction of the users with the search results, wherein the context-based user behavior data comprises user feedback data and context data associated with users feedback data, the context-based user behavior data acquired after receipt by users of the search results of said application of said predictive pattern model further comprises isolating a set of said performed queries which are unsatisfactory and which share a common characteristic in order to identify problems which appear for multiple users or queries.