Source: http://www.google.com/patents/US20030195739?dq=6,163,776
Timestamp: 2015-01-30 05:08:31
Document Index: 96674687

Matched Legal Cases: ['art 11', 'art 12', 'art 13', 'art 14', 'art 12', 'art 15', 'art 21', 'art 15', 'art 22', 'art 15', 'art 23', 'art 21', 'art 12', 'art 21', 'art 21', 'art 22', 'art 21', 'art 15', 'art 23', 'art 15', 'art 31', 'art 11', 'art 16', 'art 24', 'art 21', 'art 25', 'art 25', 'art 21', 'art 21', 'art 22', 'art 22', 'art 16', 'art 26', 'art 21', 'art 16', 'art 23', 'art 21', 'art 23', 'art 23', 'art 26', 'art 21', 'art 23', 'art 31', 'art 17', 'art 27', 'art 17', 'art 21', 'art 27', 'art 12', 'art 12', 'art 18', 'art 16', 'art 19', 'art 18', 'art 16', 'art 28', 'art 19', 'art 24', 'art 22', 'art 26', 'art 24', 'art 18', 'art 25', 'art 25', 'art 21', 'art 21', 'art 22', 'art 16', 'art 21', 'art 21', 'art 21', 'art 21', 'art 21', 'art 22', 'art 23', 'art 23', 'art 23', 'art 29', 'art 29', 'art 30', 'art 29', 'art 41', 'art 41', 'art 42', 'art 29', 'art 41', 'art 29', 'art 30', 'art 30', 'art 41', 'art 41', 'art 41']

Patent US20030195739 - Grammar update system and method - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign inAdvanced Patent SearchPatentsA grammar update method for storing grammar data for speech interaction used for recognizing speech data and newly recognizing the speech data without using the grammar data, includes determining whether or not a new-recognition result in the newly-recognizing operation can be accepted, and in the case...http://www.google.com/patents/US20030195739?utm_source=gb-gplus-sharePatent US20030195739 - Grammar update system and methodAdvanced Patent SearchPublication numberUS20030195739 A1Publication typeApplicationApplication numberUS 10/347,320Publication dateOct 16, 2003Filing dateJan 21, 2003Priority dateApr 16, 2002Also published asUS7603279Publication number10347320, 347320, US 2003/0195739 A1, US 2003/195739 A1, US 20030195739 A1, US 20030195739A1, US 2003195739 A1, US 2003195739A1, US-A1-20030195739, US-A1-2003195739, US2003/0195739A1, US2003/195739A1, US20030195739 A1, US20030195739A1, US2003195739 A1, US2003195739A1InventorsNobuyuki WashioOriginal AssigneeFujitsu LimitedExport CitationBiBTeX, EndNote, RefManReferenced by (52), Classifications (7), Legal Events (3) External Links: USPTO, USPTO Assignment, EspacenetGrammar update system and methodUS 20030195739 A1Abstract A grammar update method for storing grammar data for speech interaction used for recognizing speech data and newly recognizing the speech data without using the grammar data, includes determining whether or not a new-recognition result in the newly-recognizing operation can be accepted, and in the case where the new-recognition result cannot be accepted, specifying a portion to be added and updated from the stored grammar data, thereby adding and updating the grammar data. Images(10) Claims(10)
DESCRIPTION OF THE PREFERRED EMBODIMENTS [0035] Hereinafter, a grammar update system of an embodiment according to the present invention will be described with reference to the drawings. [0036]FIG. 1 is a diagram showing a configuration of the grammar update system of the embodiment according to the present invention. In the present embodiment, an update portion of grammar data is detected while recognition processing of speech data using grammar data and recognition processing of speech data without using grammar data are performed in parallel. [0037] In FIG. 1, a generally used IVR system 1 is composed of a speech input/output part 11 for basically inputting speech data and outputting response speech data, a speech recognizing part 12 for recognizing speech data, an interaction managing part 13 for determining a response based on the recognition result, and a speech synthesizing part 14 for synthesizing response speech data to be output. The speech recognizing part 12 uses grammar data stored in an update original grammar recording part 15 so as to enhance recognition precision. [0038] A grammar update system 2 of the present embodiment includes a speech newly-recognizing part 21 for obtaining speech data and the like in the IVR system 1, and recognizing the speech data without using the grammar data stored in the update original grammar recording part 15, a new-recognition result determining part 22 for determining whether or not the new-recognition result is acceptable using the grammar data stored in the update original grammar recording part 15, and a grammar adding and updating part 23 for specifying an update portion and adding it to the grammar data so as to update the data. [0039] Herein, the present embodiment is predicated on the fact that the recognition precision of the speech recognition in the speech newly-recognizing part 21 is higher than that in the speech recognizing part 12. More specifically, the speech newly-recognizing part 21 adopts a recognition method that places weight on the performance rather than the recognition time, using, for example, a large vocabulary dictation system or the like having a sufficient number of acceptable sentences and sufficient vocabulary. The recognition method in the speech newly-recognizing part 21 is not particularly limited thereto, and any method with sufficient recognition precision may be used. [0040] Furthermore, the new-recognition result determining part 22 determines whether or not the new-recognition result in the speech newly-recognizing part 21 can be accepted based on the grammar data stored in the update original grammar recording part 15. [0041] In the case where it is determined that the new-recognition result cannot be accepted based on the grammar data, the grammar adding and updating part 23 specifies such an unaccepted portion as an update portion, and adds the update portion to the, grammar data stored in the update original grammar recording part 15 so as to update the data, and outputs the updated grammar data to an updated grammar recording part 31. [0042] More specifically, the following application is considered. FIG. 2 is a diagram illustrating the configuration of a grammar update system of an example according to the present invention. In FIG. 2, the case will be described where a grammar being used is updated in real time using a speech log, an interaction state log, and a recognition result log in the IVR system 1. [0043] In FIG. 2, the WR system 1 includes a speech input/output part 11 for inputting/outputting speech data to be subjected to speech recognition, and a grammar to be updated recording part 16 for storing grammar to be updated. [0044] First, a speech data obtaining part 24 obtains speech data and gives it to the speech newly-recognizing part 21 via a speech analyzing part 25. The speech analyzing part 25 converts the obtained speech data to a feature value suitable for speech recognition by acoustic analysis processing such as FFT, and gives the feature value to the speech newly-recognizing part 21. [0045] The speech newly-recognizing part 21 recognizes the obtained speech data without using the grammar data, and gives the new-recognition result to the new-recognition result determining part 22. [0046] The new-recognition result determining part 22 obtains the grammar data recorded in the grammar to be updated recording part 16 in a grammar obtaining part 26, and determines whether or not the new-recognition result in the speech newly-recognizing part 21 can be accepted, by using the grammar data. Then, in the case where the new-recognition result can be accepted, it is determined that the grammar data of the new-recognition result has already been contained in the grammar data recorded in the grammar to be updated recording part 16. Therefore, an instruction signal indicating that it is unnecessary to update the grammar data is sent to the grammar adding and updating part 23. [0047] In the case where the new-recognition result cannot be accepted, the new-recognition result in the speech newly-recognizing part 21 and an instruction signal indicating that the grammar data should be updated are sent to the grammar adding and updating part 23. [0048] Only upon receiving the instruction signal for updating the grammar data, the grammar adding and updating part 23 matches the grammar data obtained in the grammar obtaining part 26 with the new-recognition result in the speech newly-recognizing part 21, and determines an unmatched portion as an update portion of the grammar data. Then, the grammar adding and updating part 23 complements the grammar data with the update portion so as to update the grammar data, thereby outputting the updated grammar data to the updated grammar recording part 31. [0049] In the present embodiment, the following is also considered: a grammar portion to be updated is extracted based on log data containing speech data stored in a log data recording part of the generally used IVR system 1, so that tuning of the grammar data can be executed at any time. [0050] In this case, as shown in FIG. 3, a log data recording part 17 for recording an interactive log is provided in the generally used IVR system 1. [0051] A log obtaining part 27 for obtaining a speech log and the like stored in the log data recording part 17 in the IVR system 1 is added to the grammar update system 2, and the speech newly-recognizing part 21 newly recognizes the obtained speech log. [0052] The log obtaining part 27 obtains speech data as a speech log, log data representing an interaction state and a circumstance, and information on a recognition result in the speech recognizing part 12, reliability of the recognition result in the speech recognizing part 12, and the like. Furthermore, there is no particular limit to a data structure of log data. An example thereof includes a data structure in which the state of interaction, grammar to be used, an interaction time, a caller No., a user ID, speech data, and the like are organized hierarchically. [0053] More specifically, the following application is considered. FIG. 4 shows a configuration of a grammar update system of another example according to the present invention. In FIG. 4, the case will be described where grammar being used is updated in real time, using a speech log, an interaction state log, and a recognition result log in the IVR system 1. [0054] Referring to FIG. 4, the IVR system 1 includes a speech log data recording part 18 for storing a log of speech data, an interactive log data recording part for storing a log regarding an interaction state, and the grammar to be updated recording part 16 for storing grammar data to be updated. [0055] The interaction log data recording part 19 stores, together with time stamp information, an input speech data ID uttered by a user, a recognition result corresponding to the input speech data ID, a system response, an interaction state (n an interaction scenario), and a grammar ID used at that time. The speech data and the grammar data to be updated, stored respectively in the speech log data recording part 18 and the grammar to be updated recording part 16, are also managed based on the input speech data ID and the grammar ID. [0056] First, in an interaction log obtaining part 28, interaction logs are read in the order of a time sequence by referring to the interaction log data recording part 19, and input speech data IDs are obtained successively. Then, the obtained input speech data ID is given to the speech data obtaining part 24. Simultaneously, a recognition result corresponding to the input speech data ID is extracted to be given to the new-recognition result determining part 22, and the grammar ID used at this time is given to the grammar obtaining part 26. [0057] The speech data obtaining part 24 obtains speech data corresponding to the specified input speech data ID from the speech log data recording part 18 in the IVR system 1 and gives it to the speech analyzing part 25. The speech analyzing part 25 converts the obtained speech data to a feature value suitable for speech recognition by performing acoustic analysis processing such as FFT, and gives the feature value to the speech newly-recognizing part 21. The speech newly-recognizing part 21 recognizes the obtained speech data without using the grammar data and gives the new-recognition result to the new-recognition result determining part 22. The subsequent processing is the same as described above, so that the detailed description thereof will be omitted here. [0058] Furthermore, it is also considered to set restriction matter regarding the update of grammar. The purpose for this is to allow special dialect, the difference between male and female colloquial expressions, and the like to be reflected. For example, in the case where a unique phrase of particular dialect is not set as any restriction matter, a phrase in accordance with the standard language may be accepted using the grammar data, whereas a unique phrase of dialect may not be accepted. In such a case, there is no guarantee that a system manager is always familiar with the special phrase of dialect. Therefore, by previously preparing the special phrase of dialect as restriction matter in the grammar data, it becomes possible to prevent the recognition precision with respect to the special phrase of dialect from decreasing. [0059]FIG. 5 illustrates grammar data stored in the grammar to be updated recording part 16. As shown in FIG. 5, the relationship between �#action� and �#object� is recorded one by one based on an exemplary sentence structure as shown in FIG. 6. According to the method for updating grammar, for example, unrecorded �#action� is added, and a method for connecting an article to a noun in �#object� is newly defined. For example, it is considered to add �copy� to �#action�, and the like. [0060] Furthermore, the reliability of the new-recognition result in the speech newly-recognizing part 21 can be obtained with respect to an update portion of the grammar data. Therefore, a method for determining whether or not the grammar data should be automatically updated in accordance the reliability is also considered. Such reliability can be determined, for example, as follows. [0061] First, speech data for evaluation is prepared, and a new-recognition result is obtained by processing the speech data in the speech newly-recognizing part 21. Then, an evaluation score on the basis of one utterance or one word during use of speech data for evaluation is calculated. [0062] Then, the contents of utterance of the speech data for evaluation are compared with the evaluation score on the basis of one utterance or one word during use of the new-recognition result and the speech data for evaluation to presume a relationship formula of the evaluation score and the correct answer ratio (criterion representing to which degree correct answers are obtained), whereby the reliability of the new-recognition result is obtained. Therefore, the reliability may be obtained with respect to the input entire speech data or on the basis of a word contained in the speech data. [0063] Furthermore, low reliability means that the new-recognition result in the speech newly-recognizing part 21 is not reliable. Therefore, by determining whether or not the grammar data is updated in accordance with the reliability, the grammar data can be updated with good precision. FIG. 7 shows a configuration of a grammar update system of the present example. Hereinafter, only the difference with respect to FIG. 2 will be described. [0064] In FIG. 7, the speech newly-recognizing part 21 provides reliability to the new-recognition result with respect to the entire result or on the basis of a word and outputs the resultant new-recognition result. Furthermore, in the case where the reliability of the entire new-recognition result in the speech newly-recognizing part 21 is low, even if the new-recognition result cannot be recognized by the grammar to be updated, the new-recognition result determining part 22 sends an instruction signal indicating that it is not necessary to update the grammar data to the grammar adding and updating part 23. [0065] The grammar adding and updating part 23 calculates the reliability of a grammar portion to be updated based on the reliability of a word that has not been matched with the obtained grammar data. Then, the grammar adding and updating part 23 sends an update original grammar ID, updated grammar data, an update portion of the grammar data, and the reliability of the grammar portion to be updated to an automatic/manual determining part 29. [0066] In the case where the reliability of the grammar portion to be updated is equal to or higher than a predetermined threshold value, the automatic/manual determining part 29 sends the update original grammar ID, the updated grammar data, and a replacement order signal to a grammar replacing part 30. In the case where the reliability of the grammar portion to be updated is less than the predetermined threshold value, the automatic/manual determining part 29 sends an update portion of the grammar data and the reliability of the grammar portion to be updated to an update information presenting part 41 of a system manager terminal 3, and is placed in an input stand-by state. [0067] The update information presenting part 41 outputs the received information on a display or the like, receives an input of the system manager from an update instruction input part 42, and sets the contents of the instruction (update/non-update) as a response signal to the automatic/manual determining part 29. In the case where the response signal from the update information presenting part 41 indicates update, the automatic/manual determining part 29 sends an instruction signal for updating the grammar data as well as the updated grammar data to the grammar replacing part 30. [0068] Furthermore, in the grammar replacing part 30 receiving the instruction signal for updating the grammar data, the following configuration is also considered: in the case where it is determined that the grammar to be updated specified by the update original ID is manually replaced by the updated grammar data received together with the instruction signal, speech data based on which the grammar data is updated is sent to the update information presenting part 41, and which contents of utterance is determined not to be recognized to necessitate updating of the grammar data is presented in the update information presenting part 41 together with the grammar update portion. In this case, related information accompanying the speech data can contain personal information on a user. Therefore, the system manager can change setting based on the determination of whether or not the user is member having the right to access the personal information. [0069] Furthermore, in the update information presenting part 41, signals (containing update information and the like) requesting an input by the system manager can be accumulated and processed as a single unit when the system manger accesses the system manger terminal 3. [0070] Furthermore, in the case of a configuration connectable to the network, a mobile phone, a PDA, or the like may be adopted as the system manager terminal 3, and the system manager may be notified of the arrival of an instruction stand-by case via mail or the like. [0071] Furthermore, in the case of an IVR system and the like in which grammar data is discriminated on the user basis, a user is considered to be suitable for determining whether or not the grammar data should be updated. In this case, it may also be possible to allow a user to update the grammar data by using a mobile phone or a web page. [0072] In the present embodiment, a method for updating grammar data every time an update portion of grammar data is extracted has been described. However, a method for processing log data as a single unit to detect update portions as a single unit may also be used. [0073] Next, a processing flow of a program for realizing the grammar update system of the embodiment according to the present invention will be described. FIG. 8 shows a flow diagram of the processing of a program for realizing the grammar update system of the embodiment according to the present invention. [0074] In FIG. 8, first, input speech data is successively obtained (Operation 801). Grammar data used for recognizing the obtained input speech data is obtained (Operation 802). [0075] Then, the speech data obtained without using the grammar data is converted to a feature value suitable for speech recognition by acoustic analysis processing such as FFT for new-recognition (Operation 803). [0076] Then, it is determined whether or not the new-recognition result can be accepted based on the obtained grammar data (Operation 804). In the case where it is determined that the new-recognition result can be accepted (Operation 804: Yes), an instruction signal indicating that it is not necessary to update the grammar data is sent (Operation 805). In the case where it is determined that the new-recognition result cannot be accepted (Operation 804: No), the new-recognition result in the speech newly-recognizing part and an instruction signal indicating that the grammar data should be updated are sent (Operation 806). [0077] Finally, only in the case where an instruction signal for updating the grammar data is received, the grammar data obtained based on a grammar ID is matched with the new-recognition result in the speech newly-recognizing part (Operation 807). The unmatched portion is determined to be a grammar update portion (Operation 808). The grammar data is complemented with the update portion to be updated (Operation 809). [0078] A program for realizing the grammar update system of the embodiment according to the present invention can be stored not only in a portable recording medium 92 such as a CD-ROM 92-1 and a flexible disk 92-2, but also another storage apparatus 91 provided at the end of a communication line and a recording medium 94 such as a hard disk and a RAM of a computer 93, as shown in FIG. 9. In execution, the program is loaded and executed on a main memory. [0079] Furthermore, various log data used by the grammar update system of the embodiment according to the present invention, generated updated grammar data, and the like may be stored not only in a portable recording medium 92 such as a CD-ROM 92-1 and a flexible disk 92-2, but also another storage apparatus 91 provided at the end of a communication line and a recording medium 94 such as a hard disk and a RAM of a computer 93, as shown in FIG. 9. Such data is read by the computer 93 when the grammar update system of the present invention is used. [0080] As described above, according to the present invention, a grammar creation/tuning operation in an IVR system, of which recognition precision has been difficult to enhance while requiring a considerable number of processes in a conventional example, can be executed at an arbitrary timing in accordance with a use situation by a user. Because of this, an IVR system can be configured and operated at a low cost with high performance, and at the same time, high recognition precision to a user can be realized easily. [0081] The invention may be embodied in other forms without departing from the spirit or essential characteristics thereof. The embodiments disclosed in this application are to be considered in all respects as illustrative and not limiting. The scope of the invention is indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are intended to be embraced therein. Referenced byCiting PatentFiling datePublication dateApplicantTitleUS7043435Sep 16, 2004May 9, 2006Sbc Knowledgfe Ventures, L.P.System and method for optimizing prompts for speech-enabled applicationsUS7110949Sep 13, 2004Sep 19, 2006At&T Knowledge Ventures, L.P.System and method for analysis and adjustment of speech-enabled systemsUS7653549Aug 6, 2007Jan 26, 2010At&T Intellectual Property I, L.P.System and method for facilitating call routing using speech recognitionUS7676371Jun 13, 2006Mar 9, 2010Nuance Communications, Inc.Oral modification of an ASR lexicon of an ASR engineUS7689420 *Apr 6, 2006Mar 30, 2010Microsoft CorporationPersonalizing a context-free grammar using a dictation language modelUS7752152Mar 17, 2006Jul 6, 2010Microsoft CorporationUsing predictive user models for language modeling on a personal device with user behavior models based on statistical modelingUS7801728Feb 26, 2007Sep 21, 2010Nuance Communications, Inc.Document session replay for multimodal applicationsUS7809575Feb 27, 2007Oct 5, 2010Nuance Communications, Inc.Enabling global grammars for a particular multimodal applicationUS7822608Feb 27, 2007Oct 26, 2010Nuance Communications, Inc.Disambiguating a speech recognition grammar in a multimodal applicationUS7827033Dec 6, 2006Nov 2, 2010Nuance Communications, Inc.Enabling grammars in web page framesUS7840409Feb 27, 2007Nov 23, 2010Nuance Communications, Inc.Ordering recognition results produced by an automatic speech recognition engine for a multimodal applicationUS7848314May 10, 2006Dec 7, 2010Nuance Communications, Inc.VOIP barge-in support for half-duplex DSR client on a full-duplex networkUS7917365Jun 16, 2005Mar 29, 2011Nuance Communications, Inc.Synchronizing visual and speech events in a multimodal applicationUS7945851Mar 14, 2007May 17, 2011Nuance Communications, Inc.Enabling dynamic voiceXML in an X+V page of a multimodal applicationUS7957976Sep 12, 2006Jun 7, 2011Nuance Communications, Inc.Establishing a multimodal advertising personality for a sponsor of a multimodal applicationUS8032375Mar 17, 2006Oct 4, 2011Microsoft CorporationUsing generic predictive models for slot values in language modelingUS8055504Apr 3, 2008Nov 8, 2011Nuance Communications, Inc.Synchronizing visual and speech events in a multimodal applicationUS8069047Feb 12, 2007Nov 29, 2011Nuance Communications, Inc.Dynamically defining a VoiceXML grammar in an X+V page of a multimodal applicationUS8073697Sep 12, 2006Dec 6, 2011International Business Machines CorporationEstablishing a multimodal personality for a multimodal applicationUS8073698Aug 31, 2010Dec 6, 2011Nuance Communications, Inc.Enabling global grammars for a particular multimodal applicationUS8082148Apr 24, 2008Dec 20, 2011Nuance Communications, Inc.Testing a grammar used in speech recognition for reliability in a plurality of operating environments having different background noiseUS8086463Sep 12, 2006Dec 27, 2011Nuance Communications, Inc.Dynamically generating a vocal help prompt in a multimodal applicationUS8090584 *Jun 16, 2005Jan 3, 2012Nuance Communications, Inc.Modifying a grammar of a hierarchical multimodal menu in dependence upon speech command frequencyUS8117030Sep 13, 2006Feb 14, 2012At&T Intellectual Property I, L.P.System and method for analysis and adjustment of speech-enabled systemsUS8121837Apr 24, 2008Feb 21, 2012Nuance Communications, Inc.Adjusting a speech engine for a mobile computing device based on background noiseUS8145493Sep 11, 2006Mar 27, 2012Nuance Communications, Inc.Establishing a preferred mode of interaction between a user and a multimodal applicationUS8150698Feb 26, 2007Apr 3, 2012Nuance Communications, Inc.Invoking tapered prompts in a multimodal applicationUS8214242Apr 24, 2008Jul 3, 2012International Business Machines CorporationSignaling correspondence between a meeting agenda and a meeting discussionUS8229081Apr 24, 2008Jul 24, 2012International Business Machines CorporationDynamically publishing directory information for a plurality of interactive voice response systemsUS8239205Apr 27, 2011Aug 7, 2012Nuance Communications, Inc.Establishing a multimodal advertising personality for a sponsor of a multimodal applicationUS8290780Jun 24, 2009Oct 16, 2012International Business Machines CorporationDynamically extending the speech prompts of a multimodal applicationUS8332218Jun 13, 2006Dec 11, 2012Nuance Communications, Inc.Context-based grammars for automated speech recognitionUS8355918 *Jan 5, 2012Jan 15, 2013Nuance Communications, Inc.Method and arrangement for managing grammar options in a graphical callflow builderUS8374874Sep 11, 2006Feb 12, 2013Nuance Communications, Inc.Establishing a multimodal personality for a multimodal application in dependence upon attributes of user interactionUS8380513May 19, 2009Feb 19, 2013International Business Machines CorporationImproving speech capabilities of a multimodal applicationUS8416714Aug 5, 2009Apr 9, 2013International Business Machines CorporationMultimodal teleconferencingUS8494858Feb 14, 2012Jul 23, 2013Nuance Communications, Inc.Establishing a preferred mode of interaction between a user and a multimodal applicationUS8498873Jun 28, 2012Jul 30, 2013Nuance Communications, Inc.Establishing a multimodal advertising personality for a sponsor of multimodal applicationUS8510117Jul 9, 2009Aug 13, 2013Nuance Communications, Inc.Speech enabled media sharing in a multimodal applicationUS8515757Mar 20, 2007Aug 20, 2013Nuance Communications, Inc.Indexing digitized speech with words represented in the digitized speechUS8521534Sep 12, 2012Aug 27, 2013Nuance Communications, Inc.Dynamically extending the speech prompts of a multimodal applicationUS8566087Sep 13, 2012Oct 22, 2013Nuance Communications, Inc.Context-based grammars for automated speech recognitionUS8571872Sep 30, 2011Oct 29, 2013Nuance Communications, Inc.Synchronizing visual and speech events in a multimodal applicationUS8600755Jan 23, 2013Dec 3, 2013Nuance Communications, Inc.Establishing a multimodal personality for a multimodal application in dependence upon attributes of user interactionUS8670987Mar 20, 2007Mar 11, 2014Nuance Communications, Inc.Automatic speech recognition with dynamic grammar rulesUS8706490Aug 7, 2013Apr 22, 2014Nuance Communications, Inc.Indexing digitized speech with words represented in the digitized speechUS8706500Nov 1, 2011Apr 22, 2014Nuance Communications, Inc.Establishing a multimodal personality for a multimodal applicationUS8713542Feb 27, 2007Apr 29, 2014Nuance Communications, Inc.Pausing a VoiceXML dialog of a multimodal applicationUS8725513Apr 12, 2007May 13, 2014Nuance Communications, Inc.Providing expressive user interaction with a multimodal applicationUS8744861Mar 1, 2012Jun 3, 2014Nuance Communications, Inc.Invoking tapered prompts in a multimodal applicationUS8788620Apr 4, 2007Jul 22, 2014International Business Machines CorporationWeb service support for a multimodal client processing a multimodal applicationUS20120209613 *Jan 5, 2012Aug 16, 2012Nuance Communications, Inc.Method and arrangement for managing grammar options in a graphical callflow builder* Cited by examinerClassifications U.S. Classification704/1International ClassificationG06F17/27, G10L15/22, G10L15/06, G10L15/18Cooperative ClassificationG06F17/2765European ClassificationG06F17/27RLegal EventsDateCodeEventDescriptionMar 6, 2013FPAYFee paymentYear of fee payment: 4Oct 5, 2010CCCertificate of correctionJan 21, 2003ASAssignmentOwner name: FUJITSU LIMITED, JAPANFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:WASHIO, NOBUYUKI;REEL/FRAME:013683/0122Effective date: 20021218RotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services