Patent ID: 8996497
Filing Date: 2015-03-31
Classification: G06F,G06Q

Abstract:
1. A method performed by a computing system, comprising: accessing a data file indicative of an experiment structure comprising a plurality of layers, with a first layer referencing a first experiment defined by one or more data files including one or more protocol messages in a pre-defined format, with the first experiment to be performed on a first search query, a second layer referencing a second experiment to be performed on the first search query or a second search query that differs from the first search query, with an experiment adjusting a value of a parameter associated with search queries or associated with processing of the search queries to determine an effectiveness of the adjusted value of the parameter, and with a launch layer specifying a first adjusted value for a first parameter of the first experiment and a second adjusted value for a second parameter of the second experiment; selecting the first experiment from the first layer in the experiment structure; selecting the second experiment from the second layer in the experiment structure; diverting, by a diversion library of the computing system, a same received search query to the first and second experiments; transforming, at the computing system, the diverted search query for each of the first and second experiments by adjusting the first and second parameters to be the first and second adjusted values specified by the launch layer; and performing, by the computing system based on the transforming, the first experiment and the second experiment on the same diverted search query, with the first experiment using a first experiment value that is the same as or is based on the first adjusted value, and with the second experiment using a second experiment value that is the same as or is based on the second adjusted value.