Patent Document ID: 8732528
Application ID: 13345378
Patent Flag: 1

Claim One:
1. A method comprising: under control of one or more servers configured with executable instructions, collecting test data and control data, the control data being collected from user interaction with a user interface and the test data being collected from user interaction with a modified version of the user interface during a test; determining a cutoff point that defines outlier data in the control data and the test data; identifying data that is below the cutoff point by less than a threshold distance, the data used to predict an effect of the test data above the cutoff point; calculating an observed effect below the cutoff point; calculating an adjusted effect above the cutoff point based at least in part on the data that is below the cutoff point by less than the threshold distance; calculating a total effect of the test by combining the observed effect and the adjusted effect; and determining whether to implement the modified version of the user interface based at least in part on the total effect of the test.