Patent ID: 8464219

Claim:
A system for managing a plurality of distributed test engines to test at least one device under analysis (DUA), the system comprising: at least one computer device comprising a processor and associated memory, wherein the at least one computer device is programmed to execute a controller; and a control database stored on a data storage device in communication with the at least one computer device, wherein the control database is also in communication with the controller and with at least a portion of the plurality of test engines via an application program interface (API), and wherein the control database comprises stored thereon: a plurality of configuration documents, wherein each configuration document is associated with at least one of the plurality of test engines, and wherein each configuration document indicates an execution group of the associated at least one test engine; a plurality of instruction documents, wherein each instruction document is associated with an execution group, wherein each execution group comprises a portion of the plurality of distributed test engines, and wherein each instruction document comprises an indication of a testing task to be performed by the execution group associated with the instruction document; at least one statistics document for storing output from the plurality of test engines; wherein the controller application is configured to: write to the plurality of configuration documents to assign each of the plurality of test engines to an execution group; and write to the plurality of instruction documents to provide, for each execution group, a testing task to be performed by test engines of the execution group on the at least one DUA; and wherein the control database is configured to receive via the API and from at least a portion of a plurality of test engines an update to the at least one statistics document.