Patent ID: 7440895

Claim:
A method of testing a speech recognizer, the method comprising: receiving a plurality of digital audio data files, each audio file comprising audio recorded in response to a first prompt by a speech recognition application; receiving a grammar associated with the first prompt, the grammar comprising a plurality of concepts, each concept having a set of phrases organized under a single idea, the idea representing an expected response to the first prompt; producing a first recognition result for each audio data file based at least in part on the grammar using the speech recognizer; receiving a user-defined transcript of each audio file, and scoring the first recognition results for each audio data file based at least in part on the transcript of each audio file; modifying the grammar based on the scoring of the first recognition result of each audio data file; producing a second recognition result for each audio data file based on the modified grammar using the speech recognizer; using the user-defined transcript of each audio data file to score the second recognition result for each audio data file; comparing the scoring of the first recognition result with the second result for each audio data file; and outputting the first or second recognition result for each audio data file based on the comparison.