Patent ID: 7293202

Claim:
In a computer system that includes a results evaluation sub-system for evaluating test results generated by a test of an object that typically produces different resulting output for different test environments, a method for creating consistent evaluation of the object across multiple testing environments without having to generate or maintain new or additional test instructions for varying environments, the method comprising the following: an act of receiving actual test results, the actual test results being generated as a result of performing a test in a test environment; an act of receiving environmental data that defines the test environment under which the actual test results are generated; in response to receiving environmental data when attempting to find a match therewith, an act of comparing the received environmental data with a set of test entry environments stored in a results retrieval sub-system, wherein each test entry environment of the set corresponds to a particular environment for which the test was previously executed; based on the comparing, an act of selecting a specific test entry environment from among the set of test entry environments stored in the results retrieval sub-system, wherein one or more environmental conditions for the selected specific test entry environment have increased commonality with one or more environmental conditions of the environmental data; based on the selection of the specific test entry environment, an act of identifying one or more expected test results from the results retrieval sub-system, the identified one or more expected test results being keyed to the selected specific test entry environment and resulting from one or more of previous executions of the test in the specific test entry environment; and an act of evaluating the actual test results against the identified one or more expected test results to determine if the test was successfully performed in the test environment.