Patent ID: 8843341

Claim:
A method for identifying a faulty algorithm, comprising: a) categorizing messages output by at least one algorithm into a plurality of different output message categories, the at least one algorithm comprising at least one of an algorithm to be tested and a reference algorithm, b)during a reference phase, determining by a processor a reference frequency for each of the different output message categories for the algorithm to be tested or reference algorithm, by operating the algorithm to be tested or reference algorithm and counting a reference number of occurrences of each different output message, c) during a test phase subsequent to the reference phase, determining by the processor a test frequency for each of the different output message categories for the algorithm to be tested by operating the algorithm to be tested and counting a test number of occurrences of each different output message, d) for each of the different output message categories, determining by the processor a difference between the test frequency for that output message category determined during the test phase and the reference frequency for that output message category determined during the reference phase, and e) for each of the different output message categories, outputting an error message by the processor if the difference exceeds a predetermined threshold.