Patent ID: 7339891

Claim:
A method for evaluating a wireless system comprising the steps of: modeling application user behavior for a system under test using an application model builder that is independent from the system under test, wherein modeling application user behavior comprises: creating an application-specific event profile that defines the relative probability of events that are expected to produce a response from the system under test; creating an event model that defines inputs and outputs of each of the events, wherein the event model specifies a domain of outputs for a particular input condition; and defining allowed event sequences; providing at least one of the application-specific event profile the event model, and the allowed event sequences to a simulator to generate test run inputs; using an application-specific trusted source derived from a trusted source framework to generate expected test results from the test run inputs; executing an end-to-end test run of the system under test using the test run inputs and a plurality of test agents controlling wireless mobile user devices under a test controller, wherein the end-to-end test run generates actual test results; and using an application-specific comparator derived from a comparator framework to compare the actual test results to the expected test results to determine a test verdict.