Patent ID: 11940903
Assignee: KING.COM LTD.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 13:
14. A computer implemented method for modifying a computer executable application delivered by an application server to a population of users, the method comprising:
allocating one of multiple test options for a test for the application, the allocated test option modifying the application prior to delivery to the population of users by carrying out a sequence of steps at the application server to select a test option for the test, the steps comprising:
(a) selecting a test associated with the requested application,
(b) combining a user identifier associated with a user at a user device configured to execute the application, and the test identifier associated with the selected test, to form a per-user-per-test identifier,
(c) performing a hash on the per-user-per-test identifier to generate a hash of the per-user-per-test identifier,
(d) processing the hash to generate an index value,
(e) comparing said index value with a distribution of numbers divided into multiple ranges, each range being associated with a test option, and
(f) selecting a test option associated with the range into which the index value falls,
the method further comprising
storing in an event database event data generated from executing the modified application, the event database storing a data structure storing at least one user identifier associated with a user, application data and event data associated with the user, said event data generated by the user executing the application modified by the selected test option of multiple test options; and determining which test option was allocated at an analytics server remote from the application server, the analytics server being configured to analyse event data associated with the application under test by executing the same sequence of steps (a) to (f) for determining which test option was allocated for analysing event data, wherein the application server and the analytic server do not share data defining the allocated test options, wherein modifying the user interface feature of the application based on the selected test option is performed prior to the application returning the event data based on the determined test option.