A system and method for providing multi-modal messaging for a wireless communication system. A wireless terminal is connected to a wireless access network, wherein the wireless terminal is capable of generating a voice request. A multi-modal message server is connected to the wireless access network for receiving the voice request generated by a user of the remote terminal. A voice recognition application is operable to identify words contained in the voice request. A response generation application uses the identified words to generate a response to the voice request. A unified messaging application is operable to interpret the response and generate a first and second response that is based on the contents of the response generated by the response generation application. The first and second responses are then transmitted to the wireless terminal in different communication formats.

FIELD OF THE INVENTION

The present invention relates to mobile communication and more particularly, to a method and system for communicating with a terminal over an access network using multiple communication modes during a single business transaction or interaction.

BACKGROUND OF THE INVENTION

Wireless communication devices have recently evolved from a technology used by an elite segment of the population to a technology that is used by the masses. Worldwide, the number of wireless communication device users has reached a staggering number and is growing all of the time. In the near future, it is envisioned that almost everyone will own or use some sort of wireless communication device that is capable of performing a variety of functions. In addition to traditional wireless communication devices, many different types of portable electronic devices are in use today. In particular, notebook computers, palm-top computers, and personal digital assistants (PDA) are commonplace.

Users of wireless telephones and other wireless devices have recently been able to place a phone call to an automated system to request information by speaking to a basic automated speech recognition system. The basic automated speech recognition system typically responds to the caller using text-to-speech and/or recorded speech prompts. This method of information delivery is cumbersome and challenging for the caller as well as very time consuming, thereby causing callers unnecessary frustration. In some cases, the system returns too much information and the caller must listen to the entire response in order to get the information they want. In other systems the caller must verbally navigate through a deep hierarchy of prompts to get to the specific piece of information they seek.

As such, a need exists for a system that is capable of providing a structured response to a user request that takes advantage of voice and text enabled wireless communication devices to provide easy user interaction.

SUMMARY OF THE INVENTION

The present invention discloses a multi-modal messaging system that preferentially takes advantage of text messaging enabled wireless terminals, but may also be used with computer terminals. The multi-modal messaging system accepts simple speech requests from wireless terminals and provides verbose a text response. In this case the user can quickly scan the message for the specific information they desire. Further, the information provided in the text response persists after the voice call has been terminated, which is advantageous compared to speech-only systems that rely on the users memory or require jotting notes on paper to store the information provided. The present invention enables users of voice and text enabled wireless terminals connected to a wireless network to communicate with a business system also connected to the wireless network via both voice and text messages during the course of a single interaction.

A preferred embodiment of the present invention discloses a multi-modal messaging system for a wireless communication system. The multi-modal messaging system includes a wireless terminal connected to a wireless access network. The wireless terminal is operable to generate a voice request for information. A multi-modal message server is connected to the wireless access network for receiving the voice request for information from the wireless terminal. A voice recognition application of the multi-modal messaging server is operable to identify a plurality of words contained in the voice request for information. A response generation application is operable to generate a first and second response to the voice request for information. Preferentially, the first and second responses are in a first and second message format. Once generated by the multi-modal message server, the first and second responses are transmitted to the wireless terminal.

In the preferred embodiment of the present invention, the voice request for information is in the form of a natural language statement A natural language processing application is included that is operable to interpret an intent associated with the voice request for information. In other embodiments, a location information application for generating a geographic location indication of the wireless terminal is included in the multi-modal messaging system. The first and second responses are based at least in part on the geographic location indication of the wireless terminal.

A virtual customer database may also be connected to the multi-modal message server for providing a profile associated with the user of the wireless terminal. The profile preferentially includes a customer identification and a device characteristic indication. The device characteristic indication allows the first and second responses to be generated in a format that is compatible with the wireless terminal. A transcoding application may also be included for formatting the text-based responses into a protocol capable of being displayed on a display of the wireless terminal in a format that is compatible with the display of the wireless terminal. This allows the text-based information to be displayed in an optimal fashion on the display of the wireless terminal.

As set forth above, the preferred embodiment of the present invention allows users of wireless terminals to receive responses to requests for information that include more than one mode of communication. This provides users with ease of access to the information that is provided as well as a record of what information they received, thereby allowing users to not have to remember through the use of memory each item stated during an interaction with the multi-modal messaging system. The first and second responses that are provided to users may be selected from a group of responses consisting of a voice-based response, a text-based response, a voice-mail response, an instant message response, an email response or a fax response.

Another preferred embodiment of the present invention discloses a method of providing multi-modal messages in a wireless communication system. In this preferred embodiment, a voice request for information is generated using a wireless terminal. The voice request for information is then transmitted to a multi-modal message server. The multi-modal message server then identifies a plurality of words contained in the voice request for information. A first and second response is then generated to the voice request for information that is based at least in part on the identity of the words. After the first and second responses are generated, they are transmitted to the wireless terminal by the multi-modal message server.

The first response to the request for information is preferentially a voice-based response. A text-to-speech application associated with the multi-modal message server is used to generate the voice-based responses that are sent to the wireless terminals. In addition, the first and second responses that are generated can be predefined by a user preference indication contained in a virtual customer database that is associated with the multi-modal message server. The virtual customer database may be located on the multi-modal message server or located on a server that is connected with the multi-modal message server.

Another preferred embodiment of the present invention discloses a method of providing multi-modal messages in a wireless communication system. In this embodiment of the present invention, a natural language voice request for information is generated using a wireless terminal. The natural language voice request for information is then transmitted to a multi-modal message server. A plurality of words contained in the natural language voice request for information is then identified by the multi-modal message server. An intent associated with the plurality of words contained in the natural language voice request for information is then determined by the multi-modal message server. A response to the voice request for information is then generated based at least in part on the identity and intent of the words. The response is then transformed into a first and second message format and then transmitted to the wireless terminal.

Yet another preferred embodiment discloses a multi-modal messaging system for a wireless communication system. The multi-modal messaging system includes a wireless terminal connected to a wireless access network, wherein the wireless terminal is operable to generate a natural language voice request for information. A multi-modal message server connected to the wireless access network for receiving the natural language voice request for information from the wireless terminal. A voice recognition application associated with the multi-modal message server is operable to identify a plurality of words contained in the natural language voice request for information. A natural language processing application associated with the multi-modal message server is operable to determine an intent associated with the words identified in said natural language voice request for information. A response generation application is operable to generate a response to the natural language voice request for information that is based at least in part on the identity of the words and the intent of the words. A unified messaging application associated with the multi-modal message server is operable to interpret the response and generate a first response in a first message format and a second response in a second message format that are transmitted to the wireless terminal.

Another preferred embodiment discloses a method of providing multi-modal messages in a communication system. In this preferred method, a request for information is generated with a terminal, which is then transmitted via an access network to a multi-modal message server. A response to the request for information is then generated by the multi-modal message server. The response is then formatted into a first message format and a second message format and then transmitted to the terminal using an access network.

Yet another preferred embodiment discloses a multi-modal messaging system for a communication system. The preferred multi-modal messaging system includes a terminal that is connected to an access network, wherein the terminal is operable to generate a request for information. A multi-modal message server is connected to the access network for receiving the request for information once sent by the terminal. A response generation application located on the multi-modal message server is operable to generate a first and second response to the request for information. The first and second responses are then transmitted to the terminal via the access network.

Further objects and advantages of the present invention will be apparent from the following description, reference being made to the accompanying drawings wherein preferred embodiments of the invention are clearly illustrated.

DETAILED DESCRIPTION OF THE PRESENTLY PREFERRED EMBODIMENTS OF THE INVENTION

Referring toFIG. 1, the present invention discloses a multi-modal messaging system10for a wireless communication system12. The wireless communication system12includes at least one wireless terminal14that is connected to at least one wireless access network16. Although not illustrated, the wireless access network16generally includes a base station transceiver that is connected to a base station server. The base station server is connected to a network connection that may be a publicly switched telephone network or a private network. In the embodiment illustrated inFIG. 1, the wireless access network16is connected to at least one switch18, thereby connecting the wireless terminal14to a multi-modal message server20. However, as further illustrated inFIG. 1, the wireless access network16could also be connected to a router19in an IP-based wireless access network as the function of transferring data between the wireless terminal14and the multi-modal message server20is provided by both types of devices.

The multi-modal messaging system10discloses a method of communicating with a wireless terminal14using multiple modes of communication including, but not limited to, human speech and text-based messages during a single transaction or call. As set forth in detail below, wireless terminals14that are connected to the wireless access network16preferentially communicate with the multi-modal message server20via the wireless access network16to which the wireless terminal14is connected. Preferentially, the multi-modal messaging system10also includes an automated speech recognition application with which the user of the wireless terminal14interacts to request and receive information from various databases containing information from a plurality of businesses.

Referring toFIG. 1, during operation the wireless terminal14is capable of transmitting and receiving messages that may come in several formats. The preferred formats include human speech, which is produced using a speaker and a microphone, and text and graphic formats that are generated on a display of the wireless terminal14. In the preferred embodiment of the present invention, the wireless terminal14preferentially transmits a tailored request for information to the multi-modal message server20in either human speech or text based message formats. Speech-based tailored requests for information are transmitted by means of a wireless telephone call as known in the art. Text-based tailored requests for information are transmitted in the form of a text message that is transmitted using a wireless communication protocol, including but not limited to a short message service (“SMS”), any wireless application protocol (“WAP”), or any email protocol.

In one preferred embodiment of the present invention, a user of the wireless terminal14establishes a connection with the multi-modal message server20by dialing a phone number that is associated with a participating company that operates the multi-modal message server20. The act of dialing a predefined phone number associated with the multi-modal message server20causes the wireless access network16to connect the call to the multi-modal message server20. In yet another preferred embodiment, the user of the wireless terminal14is capable of establishing a connection with the multi-modal message server20from an interactive menu that is generated on the wireless terminal14through a wireless application protocol or by predefined user or factory settings. Selecting a link or prompt to a respective multi-modal message server20contained in the interaction menu thereby establishes the connection between the remote terminal14and the multi-modal message server20. In yet another preferred embodiment, the user may enter an address or universal resource locator (“URL”) of the multi-modal message server20to establish the connection between the wireless terminal14and the multi-modal message server20.

Although not specifically illustrated, the operator of the multi-modal message server20may or may not be the actual company from which data is sought by the user of the wireless terminal14. The company operating the multi-modal message server20may be a third-party that is licensed or granted permission to provide certain types of data to consumers having remote terminals14that are associated with the company operating the multi-modal messaging system10. For example, the provider of the wireless communication system12may have a contract with the operator of the multi-modal message server20and in turn, another company from which the user is seeking information may also have a contract with the operator of multi-modal message server20. The cooperation of all parties in these embodiments enables the multi-modal messaging system10to function properly despite the varying types of contractual arrangements made between respective parties. Further, the multi-modal message server20may house the data files that contain the information requested by the user or the multi-modal message server20may be connected to several different company file servers that contain the desired information that is responsive to the requests for information that are generated by the wireless terminals14.

In response to the requests for information that are generated by the wireless terminal14, the multi-modal message server20generates structured responses that contain data that is responsive to the requests for information. In transmitting the structured responses to the wireless terminal14, the multi-modal messaging system10can select from a group of modes of communication including, but not limited to, text modes, graphic modes, animation modes, multi-media modes, pre-recorded and synthesized sounds including synthesized human speech modes, music modes, and noise modes. In particular, the preferred multi-modal messaging system10uses at least two of the above-referenced modes to transmit responses to the wireless terminals14during a single transaction or user interaction.

As set forth above, the methods and protocols for transmitting information in the form of text from the multi-modal messaging system10to the wireless terminal14include, but are not limited to, SMSs, WAPs, and email protocols. In the case of audible information, the response is preferentially transmitted from the multi-modal message server20to the remote terminal14during a wireless telephone call that may be initiated by either the remote terminal14or the multi-modal message server20. In yet another preferred embodiment of the present invention, the audible information contained in a response may be transmitted in an automated fashion using applications capable of synthesizing human speech and directing the synthesized human speech to a voice mail system associated with the intended recipient's wireless terminal14. As used herein, the term voice mail system includes any system that is capable of receiving, storing and retrieving audible messages in an automated fashion either autonomously or on-demand via a telephone network. These include voice mail servers and both analog and digital answering machines.

As set forth above, the present invention discloses the use of more than one mode of communication during the course of a single interaction between the wireless terminal14and the multi-modal message server20. A single interaction is defined as a set of messages required to meet the needs of a consumer or user of the wireless terminal14that is requesting a specific service, specific content, or specific information from the multi-modal message server20and the response or responses that are delivered by the multi-modal message server20in response to the requests for information from the wireless terminal14. The present invention discloses methods of using multiple modes of communication between a respective remote terminal14and a respective multi-modal message server20during a single interaction, thereby allowing the multi-modal message server20to respond to the demands of the user using both voice and text-based messages, for example.

As set forth above, during operation the wireless terminal14is operable to generate tailored requests for information about a particular product or service. In the preferred embodiment, the multi-modal message server20responds to the wireless terminal14by sending content responsive to the tailored requests for information via messages that are formatted as a text-based message and a voice-based message. In other embodiments, the wireless terminal14may only be capable of conducting a wireless telephone call or the transmission or receipt of text messages, but not both operations at the same time. As such, in these embodiments of the present invention the multi-modal messaging system10is designed to provide the wireless terminal14with text-based messages that are responsive to the requests for information after the wireless telephone call has been disconnected and the user has already received the voice-based messages that are responsive to the requests for information. In addition, the voice call connection between the wireless terminal14and the multi-modal message server20and the text-based messages that are sent to the wireless terminal14may be transmitted from the multi-modal message server20using a dissimilar wireless communication protocol.

The multi-modal messaging system10preferentially also includes a voice recognition application22. The voice recognition application22is preferentially located on the multi-modal message server20, but may also be located on a separate server that is connected with the multi-modal message server20. The voice recognition application22determines the identity of or recognizes respective words that are contained in voice-based requests for information that are generated by users of the wireless terminal14. The words that are identified by the voice recognition application22are used as inputs to a response generation application28in one preferred embodiment of the present invention. As set forth in greater detail below, the response generation application28is capable of generating multi-modal responses that contain data responsive to the requests for information that are generated by the users of the wireless terminal14. As further set forth in detail below, the words that are identified may also be used as an input to a natural language processing application26that determines the intent of the words contained in the requests for information and not just the identity of the words.

In another preferred embodiment of present invention, the multi-modal messaging system10includes a voice print application24that provides security to users of the wireless terminals14by analyzing voice prints of the user that are obtained by sampling segments of the user's speech. If the user is authenticated, access to the multi-modal messaging service10is provided to the user and if the user is not authenticated access is denied. Further, if the user desires to limit access to the multi-modal messaging system10to only themselves or select individuals, then a preference setting may be set by the owner of the wireless terminal14that restricts access to only pre-authorized users. The voice print application24can also be used to limit use of the wireless terminal14so that if the remote terminal14is stolen it will not be able to be used by the person who steals the wireless terminal14. The voice print application24can also be used to determine if the user is an authorized user that can be provided with information related to a specific account by providing authorization and authentication. The voice print application24can be located on the multi-modal message server20or on a voice print application server that is connected to the multi-modal message server20.

As briefly set forth above, in yet another preferred embodiment of the present invention the multi-modal messaging system10includes a natural language processing application26. The natural language processing application26works in conjunction with the voice recognition application22to ascertain the meaning of natural language requests for information that are received from the wireless terminals14. The natural language processing application26processes the identified words contained in the voice signals to ascertain the meaning or intent of the words that are contained in the voice signals. As such, during operation the voice recognition application22identifies or recognizes the particular words that are contained in the voice signals and the natural language processing application26interprets the meaning or intent of the recognized words contained in the voice signals. The natural language processing application26provides functionality to the multi-modal messaging system10that allows users to enter requests for information using natural language that is normally used in conversations between two human subjects.

The natural language processing application26may be located on the multi-modal message server20, but, in an effort to increase the level of performance, could also be located on a separate server or a separate set of servers connected with the multi-modal message server20. For a more detailed discussion of the preferred natural language processing application please refer to U.S. application Ser. No.: 10/131,898 entitled Natural Language Processing for a Location-Based Services System filed on Apr. 25, 2002 which is hereby incorporated by reference in its entirety.

As illustrated inFIG. 1, the natural language processing application26is connected to a response generation application28that uses a plurality of programmed rules in combination with the command or word contained in the request to determine what information should be retrieved and returned to the wireless terminal14. The response generation application28uses the words identified by the voice recognition application22and the intent or meaning of the words determined by the natural language processing application26to generate a search query that retrieves the appropriate information from a content database34. In other preferred embodiments, only the words identified from the voice recognition application22are used by the response generation application28to generate a response to the tailored requests for information.

In another preferred embodiment of the multi-modal messaging system10, a location information application30is used to determine a geographic location of the wireless terminal14. The location information application30may be located on the multi-modal message server20or on another server that is connected to the multi-modal message server20. The geographic location of the user can be used to focus or narrow responses that are generated by the response generation application28to a specific geographic area that is appropriate to the user of the wireless terminal14. Certain types of requests for information generated by users of the wireless terminals14will be dependent on the current geographic location of the wireless terminal14and the location information application30is used to provide the response generation application28with location data that is needed to generate a geographically tailored response to requests for information that are dependent on the geographic location of the wireless terminal14.

The response generation application28may also be connected to a virtual customer database32that may use application and customer proprietary information to determine user preferences for modes of communication. In addition, the virtual customer database32may include customer data that includes information about the wireless terminal14that the user is using such as limitations for the amount or type of data content that the wireless terminal14can receive or the type of display used by the wireless terminal14so that responses can be structured in a format that is compatible with the display. In addition, the user may choose not to receive certain types of large files, such as multimedia files and so forth, and these settings may be found in the virtual customer database32in the profile of the user.

As set forth above, the response generation application28is used to generate structured responses to the tailored requests for information that are generated by the wireless terminal14. Once the customer preferences and identification have been determined using the virtual customer database32and possibly the geographic location of the wireless terminal14has been determined using the location information application30, a query is generated and sent to the content database34that is connected to the response generation application28. The query is used to retrieve data that is responsive to the request for information from the content database34. The content database34may be located locally on the multi-modal message server20or housed on other servers that are connected to the multi-modal message server20. For example, if the wireless terminal14is connected to a multi-modal message server20provided by an airline company, the details of a flight that a user is booked on may be retrieved from the content database34if so desired.

Expanding on the example set forth above, let's say that the user of the wireless terminal14is a regular customer of the airline company and is registered with the airline company. The virtual customer database32will know this fact and will assist the response generation application28by providing detailed information to the response generation application28about that particular user. For example, the virtual customer database32may contain a customer identification number and a virtual key that is associated with that particular user. This information can be added to the query that is generated by the response generation application28, which allows the response generation application to more accurately generate responses. The airline company multi-modal messaging system will be able to use this information to more accurately provide responses to the user that contain accurate data related to that particular user's account and status. Further, this information can be used for authorization and authentication purposes.

Once the data for the response to the user's request has been located by the response generation application28, the multi-modal messaging system10prepares this data for transmission to the wireless terminal14. A unified messaging application36preferentially combines the information retrieved into a unified response that can be sent to the wireless terminal14if the response generation application28does not format the response into the predefined message formats. In a preferred embodiment, the unified response that is generated contains a text-based response and a voice-based response that is created using the data that is provided by the response generation application28. In essence, the unified message application36prepares the multi-modal response by generating a response in at least two formats that are suitable for the wireless terminal14. As set forth above, these formats may include a text-based message, a graphics-based message, a voicemail message, and an email message.

After the unified message is created, a transcoding application38may be used to format the unified message into a format that is suitable for the wireless terminal14using information already known about the wireless terminal14, which is preferentially retrieved from the virtual customer database32. For example, for a text-based message, the transcoding application38may convert the text-based response into an SMS or WAP format For a voice-based message, the transcoding application38may use a voice synthesis application to convert the speech-based response into a format suitable for the wireless terminal14. The response is then sent to the wireless access network16, which thereby transmits the multi-modal response to the wireless terminal14.

Users of the wireless terminals14can define how they want the multi-modal messaging system10to send responses to them, or the multi-modal messaging system10may contain information, preferably stored in the virtual customer database32, about each user of the multi-modal messaging system10and their respective remote terminals14. This allows the multi-modal messaging system10to generate and transmit responses that are in the preferred format of the user. The multi-modal messaging system10allows users to determine what types of services and modes of communication will be used to transmit responses to the wireless terminal14.

Referring toFIG. 1, in the preferred embodiment of the present invention a call is placed on the wireless access network16from the wireless terminal14to the multi-modal message server20. In other preferred embodiments, a connection may be established between the wireless terminal14and the multi-modal message server20through the selection of a menu item or the entry of an address on the wireless terminal14. The wireless terminal14also preferentially passes information to the multi-modal message server20about the wireless terminal14using SS7, ISDN, or other in-band or out-of-band messaging protocols. A calling number identification (“CNI”) is preferentially passed as well as a serial number for the wireless terminal14. This information can be used to determine the identity of the user to which the wireless terminal14belongs.

In one preferred embodiment, the multi-modal message server20uses an interface to detect the call and ‘answers’ the call from the wireless terminal14using text-to-speech messages or recorded speech prompts. The prompts can ask the user to speak the request for information using some set of predefined commands or may ask the user to utter the request for information using natural language, which will later be processed by the voice recognition application22and the natural language application26. The text-to-speech messages or recorded speech prompts are transmitted across the wireless access network16to the wireless terminal14.

During operation, the user speaks the request for information into the wireless terminal14and the wireless terminal14and wireless access network16transmit the voice signal representing the request for information to the multi-modal message server20. Under one mode of operation, the user speaks one of a pre-defined command phrases or words, which is then interpreted and used by the voice recognition application22to generate a response. The user's speech is converted to text using the voice recognition application22, which is then used as an input to a search query that interprets the user's command. As set forth below, based on the user's command, a response is generated by the responses generation application28that is sent to the user.

In one embodiment of the present invention, the multi-modal messaging system10incorporates a voice printing application24in conjunction with the database of proprietary customer information34to determine if the caller using the wireless terminal14is the owner of (or assigned to) the wireless terminal14. If the caller is not the owner of the wireless terminal14, (which may occur if someone borrows the wireless terminal14from the owner) the multi-modal messaging system10proceeds with the call but does not personalize any of the services based on proprietary customer information associated with the assigned user. Therefore, at any point in the process where the multi-modal messaging system10would use customer proprietary information, the multi-modal messaging system10could use additional prompts to request this information from the caller. The multi-modal messaging system10could also restrict access to the multi-modal messaging system10and the wireless terminal14altogether if the assigned user has preset a user preference indicating the restriction of access to unauthorized users.

In another preferred embodiment of the present invention, the multi-modal messaging system10can handle requests for information that are entered using natural speech. In this embodiment, the multi-modal messaging system10passes the text identified from the voice recognition application22to a natural language processing application26that is used to determine the intent or meaning of the words contained in the request. The interpreted intent is processed by the multi-modal messaging system10in the same way the pre-defined commands are processed. This is made possible because the natural language processing application26is programmed to generate search queries based on the words identified in the request and the intent of the words contained in the request.

The response generation application28uses programmed rules in combination with the commands to determine what information should be retrieved and returned to the wireless terminal14. These rules are stored in executable code or in a content database34. In one preferred embodiment of the present invention, if the multi-modal messaging system10determines that location information about the wireless terminal14is necessary to generate an appropriate response to the request for information, the multi-modal messaging system10uses the location information application30to determine the geographic location of the wireless terminal14. The wireless access network16can use several location determining applications that are designed to sufficiently determine the geographic location of the wireless terminal14to the accuracy necessary to successfully generate a response that is responsive to the request for information. The location information that is generated by the location information application30is used as part of the search query that is used to locate the desired information.

Upon determining the data to be returned to the wireless terminal14and retrieving this data from a content database34, the response generation application28of the multi-modal messaging system10prepares the content to be sent to the wireless terminal14. The multi-modal messaging system10may use an application and customer proprietary information to determine the customer's preferences for modes of communication. Additionally, this customer data may include information about the wireless terminal14assigned to the user such as limitations for the amount or type of data content the device can receive. These methods for storing and accessing the customer proprietary data include those disclosed in a co-pending application entitled Virtual Customer Database, which was filed on the same day as the present application and assigned application Ser. No.: 10/264,219, which is hereby incorporated by reference in its entirety.

The multi-modal messaging system10formats the content contained in the response for the wireless terminal14using available information about the wireless terminal14and individual preferences of the users. A unified messaging application36preferentially formats the content into multiple messages, if necessary, to respond to the wireless terminal14in the most informative way that is compatible with the wireless terminal14to which the user is assigned or has purchased. The multi-modal messaging system10preferentially uses a transcoding application38to format the content contained in the response into a suitable format for the user's wireless terminal14and is capable of generating responses using formats such as WML, HTML, and plain text.

The multi-modal messaging system10then transmits the content to the wireless access network16operated by the carrier and indicates the recipient and the method for transferring the message(s) to the recipient or user. Preferably, the messages are sent as a text message to the wireless terminal14using any of (but not limited to) the following: SMS, CPDP, Mobitex. The wireless terminal14receives the message(s) and the user is allowed to interact with the content contained in the response from the multi-modal messaging system10.

In yet another preferred embodiment of the present invention, the multi-modal messaging system10is used in combination with a location-based services system where the content of the messages between the system and the wireless terminal14contain information that is based on the current geographic location of the wireless terminal14. The location-based services system may be of the type by which the indicator of the location of the wireless terminal14is generated by the wireless terminal14and transmitted to the multi-modal messaging system10, determined by the multi-modal messaging system10, or by some combination there of. For a more detailed description of location-based service systems, refer to U.S. application Ser. No.: 09/946,111, which was filed on Sep. 4, 2002 entitled Location-Based Services and is hereby incorporated by reference in its entirety.

Referring toFIG. 2, an illustrative example of a preferred embodiment of the present invention is set forth below. As an example, let's say that a user of wireless terminal14is planning a trip and would like to check with his or her airline to determine their flight itinerary. At step40the user of wireless terminal14connects to the multi-modal messaging system10of the airline through the wireless access network16. At step42, the multi-modal messaging server20transmits a command prompt to the user requesting information from the user of the wireless terminal14. In response, at step44the user states a voice request for information, which in this example is illustrated as “Flight itinerary please”, which is transmitted to the multi-modal messaging server20at step46.

At step48, the multi-modal messaging system10takes this voice request for information and uses automated speech recognition, which in the preferred embodiment includes processing the voice request for information with a voice recognition application22and a natural language processing application26, to generate a plurality of responses to the request for information. As an example, in the preferred embodiment illustrated inFIG. 2, a voice-based response is generated that states “It will be sent to your phone” and a text-based response is generated that provides the user with the appropriate itinerary information that is tailored for that particular user. At step50, the multi-modal message server20transmits the multi-modal response to the user, which inFIG. 2is represented as a voice-based response and a text-based response.

To generate the response, the preferred embodiment uses customer information that is received from the virtual customer database32to determine that the user of the wireless terminal14has a profile with the airline. The profile is capable of providing the user's customer ID and possibly a virtual key that is associated with that customer that authorizes the wireless terminal14to receive data from the airline's database. This information allows the multi-modal messaging system10to authenticate and identify the user of the wireless terminal14in order to generate an appropriate response from the airline's data files.

The wireless terminal14is also capable of responding to the multi-modal message. The user of the wireless terminal14can respond to the multi-modal message using several different response methods including voice, keypad selections, touchscreen selections and so forth. In response to the user's response, the multi-modal message server20is capable of generating another multi-modal message that may be sent to the wireless terminal14. For example, a text response sent to the wireless terminal14states “Your flight leaves at 5 pm and your seat is 45B. An upgrade to 1 st class is available. Reply to this message for more information.” By replying to the message, the multi-modal message server20can generate another multi-modal message that provides the details of upgrading to first class. Other scenarios are available and the above-referenced example should be construed as illustrative and not in a restrictive sense.

While the invention has been described in its currently best-known modes of operation and embodiments, other modes, embodiments and advantages of the present invention will be apparent to those skilled in the art and are contemplated herein.