Patent ID: 8762310

Claim:
A computer-implemented method for evaluating recommendations, the method comprising: generating a first set of recommendations including a first plurality of items, wherein the first plurality of items is identified by a first technique using a first set of inputs; generating a second set of recommendations including a second plurality of items, wherein the second plurality of items is identified by a second technique using a second set of inputs; determining a first set of end user actions, wherein each of the first set of end user actions corresponds to an action taken by an end user in response to a display corresponding to at least one item of the first set of recommendations; determining a second set of end user actions, wherein each of the second set of end user actions corresponds to an action taken by an end user in response to a display corresponding to at least one item of the second set of recommendations; and associating a performance value with the first set of recommendations based at least in part on a comparison of the first set of end user actions and the second set of end user actions.