Patent ID: 7823138

Claim:
A computer-implemented method comprising: distributing a feature testing tool to one or more client computing systems; distributing one or more computing feature builds from a managing computing system to the client computing systems; distributing one or more data sets from the managing computing system to the client computing systems, wherein the data sets are selected for distribution based on their priority in a cyclical queue of data sets, wherein the managing computing system responds to erroneous results received from a first client computing system by assigning a mandate for a data set associated with the erroneous results to be sent to a second client computing system which has a different hardware-software configuration than that of the client computing system that originally reported the erroneous results, wherein the different hardware-software configuration comprises at least one of a different type of central processing unit, a different clock speed, a different amount of random access memory (RAM), a different operating system, a different operating system version, a different set of concurrently loaded software, a different set of concurrently running software, and a different set of concurrently running processes, wherein the managing computing system receives results from the second client computing system, and, if the erroneous results were not reproduced on the second client computing system, responds by sending the data set associated with the erroneous results back to the client computing system that originally reported the erroneous results, and wherein the managing computing system responds to receiving a reproduction of the erroneous results by providing the data set associated with the erroneous results, along with information about how the erroneous results were produced and reproduced, including whether the erroneous results could be reproduced with the different hardware-software configuration, to an investigation queue; running the feature testing tool on a given one of the client computing systems during times when the feature testing tool determines that the client computing system is not otherwise in active use, wherein the feature testing tool prompts the computing feature build to process one of the data sets, and collects results from the processing of the data set, including any erroneous results; and providing to the managing computing system the results from the computing feature build processing the data sets on the client computing systems.