Patent ID: 7260503
Filing Date: 2007-08-21
Classification: G06F

Abstract:
1. A method for testing a target system, comprising: identifying a test to perform on the target system in at least one configuration of the target system; applying the test to the target system and collecting plural actual results that characterize the operation of the target system in performing the test; and applying a policy to the actual results to generate an output verdict, wherein the policy maps a subset of the actual results to the output verdict using a selected mapping paradigm, wherein the policy is selected from a group of policies, wherein at least two of the policies apply different subsets of the actual results to generate respective output verdicts; wherein collecting of plural actual results comprises: collecting at least one function-related actual result that defines whether the target system produces a result identified as correct; and collecting at least one performance-related actual result that characterizes the performance of the target system while it is executing the test, wherein the performance defines an aspect of the target system other than whether the target system produces a result identified as correct; wherein the policy applied to the actual results maps at least one performance-related actual result into the output verdict.