# Patent

## Title
Adaptable communication techniques for electronic devices

## Abstract

Improved approaches for users of electronic devices to communicate with one another are disclosed. The electronic devices have audio and/or textual output capabilities. The improved approaches can enable users to communicate in different ways depending on device configuration, user preferences, prior history, etc. In one embodiment, the communication between users is achieved by short audio or textual messages.

## Background
CROSS-REFERENCE TO RELATED APPLICATIONS
This application is a continuation application of U.S. patent application Ser. No. 12/987,018, filed Jan. 7, 2011, now U.S. Pat. No. 8,112,104, and entitled “ADAPTABLE COMMUNICATION TECHNIQUES FOR ELECTRONIC DEVICES,” which is hereby incorporated herein by reference, and which is a continuation application of U.S. patent application Ser. No. 12/074,961, filed Mar. 7, 2008, now U.S. Pat. No. 7,890,128, and entitled “ADAPTABLE COMMUNICATION TECHNIQUES FOR ELECTRONIC DEVICES,” which is hereby incorporated herein by reference, and which is a continuation application of U.S. patent application Ser. No. 11/497,651, filed Aug. 2, 2006, and entitled “ADAPTABLE COMMUNICATION TECHNIQUES FOR ELECTRONIC DEVICES,” now U.S. Pat. No. 7,376,434, which is hereby incorporated herein by reference, and which is a divisional application of U.S. patent application Ser. No. 11/006,343, filed Dec. 7, 2004, and entitled “ADAPTABLE COMMUNICATION TECHNIQUES FOR ELECTRONIC DEVICES,” now U.S. Pat. No. 7,116,976, which is hereby incorporated herein by reference, and which claims priority to U.S. Provisional Patent Application No. 60/527,565, filed Dec. 8, 2003, and entitled “ADAPTABLE COMMUNICATION TECHNIQUES FOR ELECTRONIC DEVICES,” which is hereby incorporated herein by reference.


FIELD OF THE INVENTION
The present invention relates to electronic devices and, more particularly, to communication techniques for electronic devices.
BACKGROUND OF THE INVENTION
Typically, to participate in wireless communications, a user holds a mobile phone (e.g., wireless or a cellular phone) against his ear to hear an audio communication received in a wireless manner. The user usually also speaks towards a microphone embedded in the mobile phone to participate in the audio communication, again in a wireless manner. More recently, to facilitate hands-free operation of mobile phones, head-sets have been produced and utilized. Typically, a headset clips over or into an ear of the user to provide a speaker and a microphone in proximity to the ear and the mouth, respectively, of the user. Traditionally, the head-set was connected to the mobile phone by a cord (i.e., wire). In recent times, head-sets have been developed to operate in a wireless manner, without the need of a cord connected to the mobile phone. For example, one popular type of wireless head-set uses Bluetooth wireless transmissions to communicate between the head-set and the corresponding mobile phone.
Mobile phones often support both voice calls and text messaging. When the user does not make use of a head-set, the user often holds the mobile phone against their ear when participating in a voice call. One problem this presents is that the user is not able to see the screen of the mobile phone. As a result, the user has difficultly interacting with the keypad or screen of the mobile phone when the mobile phone is held against the user's head. Alternatively, when the user of a mobile phone makes use of a head-set, the user can receive and participate in voice calls in a hands-free manner. Unfortunately, however, the user would need to view a screen of the mobile phone to participate in text messaging.
Accordingly, there is a need for improved wireless communication techniques for users of mobile communication devices.
SUMMARY OF THE INVENTION
The invention pertains to improved approaches for users of electronic devices to communicate with one another. The electronic devices have audio and/or textual output capabilities. The improved approaches can enable users to communicate in different ways depending on device configuration, user preferences, prior history, etc. In one embodiment, the communication between users is achieved by short audio or textual messages.
According to a first aspect, improved approaches to respond to incoming voice calls are disclosed. The improved approaches enable a called party to provide some information to a calling party without directly engaging in a voice call with the calling party. The called party can choose not to take the voice call from the calling party. Instead, the called party can provide the calling party with some limited information. The limited information can be provided in an audio or textual format. In one embodiment, the limited information provides the calling party with feedback as to why the voice call was not taken.
According to a second aspect, improved approaches to respond to an incoming text message are disclosed. The improved approaches enable a recipient to provide a reply message to an initiator. The incoming text message can be presented to the recipient with an audio or textual presentation. Thereafter, a reply text message can be sent back to the initiator. The recipient can form the reply text message by recording a brief audio message or entering a text message. In the case in which a brief audio message is used, the audio message can be automatically converted to a text message before being transmitted to the initiator.
The electronic device can be a computing device, such as a personal computer, a personal digital assistant, or a communications device. One example of a communications device is a mobile telephone.
The invention can be implemented in numerous ways, including as a method, system, device, apparatus, and a computer readable medium. Several embodiments of the invention are discussed below.
In accordance with one embodiment, a mobile electronic device can be configured to support wireless communication, including messaging, for a first user. The mobile electronic device can be capable of wirelessly communicating with a wireless headset. The mobile electronic device can include at least a data storage device for storing at least computer program code, and hardware for performing at least a portion of the computer program code. The computer program code can include at least: computer program code for receiving an incoming text message for the first user, the incoming text message being associated with a second user; computer program code for converting the incoming text message to an incoming audio message; computer program code for presenting the incoming audio message for the first user via the wireless headset; computer program code for recording a reply audio message from the first user via the wireless headset; computer program code for converting the reply audio message into a reply text message; and computer program code for transmitting the reply text message to the second user.
In accordance with another embodiment, a wireless communication device can support wireless communication, including messaging, for a first user. The wireless communication device can be capable of wirelessly communicating with a wireless headset. The wireless communication device can be configured to perform the method of: receiving an incoming text message for the first user, the incoming text message being associated with a second user; converting the incoming text message to an incoming audio message; presenting the incoming audio message for the first user via the wireless headset; recording a reply audio message from the first user via the wireless headset; converting the reply audio message into a reply text message; and transmitting the reply text message to the second user.
Other aspects and advantages of the invention will become apparent from the following detailed description taken in conjunction with the accompanying drawings which illustrate, by way of example, the principles of the invention.



BRIEF DESCRIPTION OF THE DRAWINGS
The invention will be readily understood by the following detailed description in conjunction with the accompanying drawings, wherein like reference numerals designate like structural elements, and in which:
FIG. 1 is a communication system according to one embodiment of the invention.
FIG. 2 is a flow diagram of a personal call response process according to one embodiment of the invention.
FIG. 3 is a flow diagram of an audio message response process according to one embodiment of the invention.
FIG. 4 is a flow diagram of a text message response process according to one embodiment of the invention.
FIG. 5 is a flow diagram of an automated call response process according to one embodiment of the invention.
FIG. 6 is a flow diagram of a message presentation process according to one embodiment of the invention.
FIG. 7 is a flow diagram of a reply message process according to one embodiment of the invention.



DETAILED DESCRIPTION OF THE INVENTION
The invention pertains to improved approaches for users of electronic devices to communicate with one another. The electronic devices have audio and/or textual output capabilities. The improved approaches can enable users to communicate in different ways depending on device configuration, user preferences, prior history, time or other criteria. In one embodiment, the communication between users is achieved by short audio or textual messages.
The electronic device can be any computing device having communication capabilities. Such computing devices can be referred to as communication devices. Examples of electronic devices include personal computers, personal digital assistants, pagers or mobile telephones.
Embodiments of the invention are discussed below with reference to FIGS. 1-7. However, those skilled in the art will readily appreciate that the detailed description given herein with respect to these figures is for explanatory purposes as the invention extends beyond these limited embodiments.
FIG. 1 is a communication system 100 according to one embodiment of the invention. The communication system 100 can support different communication devices, including mobile telephones 102, computers 104 (e.g., personal computers) and/or wireless personal digital assistants (PDAs) 106. Users of the communication devices 102-106 can communicate with like or different communication devices. Each communication device 102-106 offers one or both of audio or textual communication capabilities. These communication devices 102-106 can inter-communicate with one another through a network 108. The network 108 can include one or more of voice networks and data networks. For example, one network is a data network providing a slow speed data channel for transmission of Short Message Service (SMS) messages (which are typically limited to 160 text characters) to a Short Message Service Center (SMSC) and then forwarded on to the destination. Besides short messages (e.g., SMS messages), the network 108 can also support other messaging protocols for sending and receiving enhanced messages (EMS), multimedia messages (MMS), email and fax messages. Other networks support faster data channels and voice channels, such as GPRS, UMTS, G4, GSM, CDMA and various protocols, such as UDP, TCP, WAP, PDP other protocols.
According to one embodiment of the invention, one of the communication devices 102-106 can send a short message to another of the communication devices 102-106. The short message can be text-based or audio-based. The sending communication device allows its user to create the short message as the user desires and/or as the device permits. For example, the user might interact with a keypad or keyboard to enter the short message, or the user might record audio inputs (e.g., speech) for the short message. The short message can then be sent to the receiving communication device. The sending of the short message may involve converting the short message from an audio message to a text message, or vice versa. Also, the receiving communication device can further convert the short message from audio-to-text or from text-to-audio. In any case, the short message is presented (e.g., displayed or played) to the user of the receiving communication device. The presentation can vary as the user desires or as the device permits.
A first aspect of the invention pertains to improved approaches to respond to incoming voice calls. The improved approaches enable a called party (i.e., a party being called) to provide some information to a calling party without directly engaging in a voice call with the calling party. The called party can choose not to take the voice call from the calling party. Instead, the called party can provide the calling party with some limited information. The limited information can be provided in an audio or textual format. In one embodiment, the limited information provides the calling party with feedback as to why the voice call was not taken.
FIG. 2 is a flow diagram of a personal call response process 200 according to one embodiment of the invention. The personal call response process 200 is performed by an electronic device, such as a mobile communication device (e.g., mobile telephone). The personal call response process 200 begins with a decision 202 that determines whether there is an incoming voice call. When the decision 202 determines that there is no incoming voice call, then the personal call response process 200 awaits such a call. Once the decision 202 determines that there is an incoming voice call, a decision 204 determines whether the incoming voice call is to be answered. Typically, the user of the electronic device would signal the electronic device as to whether or not to answer the incoming voice call. Alternatively, the electronic device could automatically decide whether to answer the call.
When the decision 204 determines that the user desires the incoming voice call to be answered, the incoming voice call is answered 206 and the user engages 208 in a voice call with the calling party. A decision 210 then determines whether the call has ended. When the decision 210 determines that the call has not yet ended, then the personal call response process 200 can return to repeat the block 208 while the voice call continues. Once the decision 210 determines that the voice call has ended, then the personal call response process 200 ends.
When the decision 204 determines that the user does not desire to answer the incoming voice call, a decision 212 determines whether the user desires to provide an audio message to the calling party. When the decision 212 determines that the user does desire to provide an audio message to the calling party, an audio message is obtained and sent 214 to the calling party (caller).
Alternatively, when the decision 212 determines that the user does not desire to provide an audio message, a decision 216 determines whether the user desires to provide a text message to the calling party. When the decision 216 determines that the user desires to provide a text message to the calling party, a text message is obtained and sent 218 to the calling party.
Still further, when the decision 216 determines that the user does not desire to provide a text message to the calling party, a decision 220 determines whether the incoming voice call is to be directed to voice mail. When the decision 220 determines that the incoming voice call should be directed to voice mail, then the incoming voice call is directed 222 to voice mail. On the other hand, when the decision 220 determines that the incoming voice call is not to be directed to voice mail, the incoming voice call is dropped 224. Following the blocks 214, 218, 222 and 224, the personal call response process 200 is complete and ends.
In another embodiment, a personal call response process could announce the calling party to the called party (user). In announcing the calling party, the personal call response process would present the called party with information pertaining to the calling party (e.g., display or audio sound). Such information could, for example, help the called party to decide whether to answer the incoming voice call. The information can, for example, include one or more of name (individual or business), telephone number, or other caller identification. The information could also include status information of the calling party, such as position, health, mood, etc. As an example, the information could be presented to the user prior to the decision 204 of the personal call response process 200 shown in FIG. 2.
In still another embodiment, an automated decision process to decide whether to answer a call can be based on time (e.g., decision 204). For example, the called party can previously set a rule, such as that from midnight to 6 am, the party does not want to answer voice calls. Then, during this time period, the electronic device can automatically decide not to answer incoming calls. In one implementation, when the electronic device decides not to answer incoming calls, no indication of incoming calls will be provided to the called party. For example, from midnight to 6 am, the device would not produce any ring tone. Additionally, if desired, the called party can also configure the electronic device to automatically provide an audio message or a text message to the calling party (e.g., I'm asleep call me tomorrow”).
FIG. 3 is a flow diagram of an audio message response process 300 according to one embodiment of the invention. The audio message response process 300 is, for example, suitable for use as the processing carried out by block 214 illustrated in FIG. 2.
The audio message response process 300 initially answers 302 the incoming voice call. In this operation, the incoming voice call is answered 302 but not in a traditional way. Instead, the electronic circuitry associated with a mobile communication device (e.g., mobile telephone) that receives the incoming voice call operates to answer the incoming voice call for purposes of an audio message response. For example, a voice channel is established between the calling party and the mobile communication device, but the speaker and microphone of the mobile communication device are disabled. In effect, in such an embodiment, neither the called party nor the calling party perceives that the voice calling has been answered.
Next, one or more predetermined audio messages can be presented 304 by the mobile communication device. The presentation 304 of the one or more predetermined audio messages can, for example, be achieved by audio or visual means. For example, the predetermined audio messages can be audio output to a speaker associated with the mobile communication device for the called party or can be visual output (e.g., text) to a display of the mobile communication device for the called party (e.g., user of the mobile communication device).
A decision 306 then determines whether a predetermined audio message has been selected. Here, the decision 306 determines whether the user (i.e., called party) of the mobile communication device has selected one or more of the predetermined audio messages. When the decision 306 determines that a predetermined audio message has been selected, then the selected audio message is played 308 for the calling party. Here, the mobile communication device can output the selected audio message to the calling party over the voice channel. Typically, the mobile communication device of the called party would not produce an audible output at the mobile communication device, so that the called party would not be disturbed by the sending of the audio response. The predetermined audio messages are normally short messages (e.g., not more than 160 characters) so that the duration of time the voice channel is needed and/or the amount of network bandwidth consumed is minimal.
On the other hand, when the decision 306 determines that none of the predetermined audio messages have been selected, then a decision 310 determines whether a custom audio message is requested. A custom audio message is an audio message that is specifically provided for the calling party. When the decision 310 determines that a custom audio message is not being requested, then the audio message response process 300 returns to repeat the decision 306 and subsequent operations. Alternatively, when the decision 310 determines that a custom audio message is requested, then a custom audio message is recorded 312. Thereafter, the custom audio message that has been recorded can be played 314 for the calling party (caller). Here, typically, the custom audio message would be output by the mobile communication device of the called party over the voice channel to the calling party. Typically, the mobile communication device of the called party would not produce an audible output at the mobile communication device, so that the called party would not be disturbed by the sending of the audio response. The custom audio messages are also normally short messages (e.g., not more than 160 characters) so that the duration of time the voice channel is needed and/or the amount of network bandwidth consumed is minimal.
Following the operations 308 and 314, the incoming voice call is closed 316. In other words, after the selected audio message or the custom audio message is played 308, 314, the incoming voice call can be closed 316. Following the block 316, the audio message response process 300 is complete and ends.
The predetermined audio messages that are presented 304 to a called party can be determined in a static or dynamic manner. A static determination would, for example, be when the called party has previously set or recorded an audio message to be utilized. Typically, with static determination, the list of audio messages remains the same (i.e., static) until changed (e.g., by the called party). A dynamic determination would allow the audio messages in the list (or the ordering of the audio messages in the list) to change without specific action by the user or the called party. For example, the list or ordering of the audio messages can depend on preference settings, configuration information, or prior usage. Prior usage can include biasing the list of audio messages such that those messages being most often selected appear higher in the list. The list or ordering of the audio messages can also depend on the calling party, type of calling party, location of calling party or called party, and the like. The list of audio messages can be represented by text and/or graphics (e.g., icons).
The audio message response process 300 flexibly enables a user to either select one or more predetermined audio messages or provide a custom audio message to be used as an audio message response to a calling party. However, it should be recognized that, in other embodiments, an audio message response process can alternatively simply pertain to only providing a custom audio message, or only permitting selection of a predetermined audio message. Further, in still other embodiments, an audio message response process can first determine whether a custom audio message is to be provided before presenting predetermined audio messages. In yet other embodiments, an audio message response process can answer the incoming voice call later in the processing than operation 302 as shown in FIG. 3 (e.g., before operations 308 and 314).
FIG. 4 is a flow diagram of a text message response process 400 according to one embodiment of the invention. The text message response process 400 is, for example, processing performed by the block 218 illustrated in FIG. 2.
The text message response process 400 initially drops 402 the incoming voice call. Here, the information to be supplied to the calling party is a short text message; therefore, there is no need for a voice channel.
Next, one or more predetermined text messages are displayed 404. Here, the one or more predetermined text messages would normally be displayed on a display screen associated with the mobile communication device being utilized by the called party. A decision 406 then determines whether one (or more) of the predetermined text messages has been selected. When the decision 406 determines that a predetermined text message has been selected, then the selected text message is transmitted 408 to the caller (i.e., the calling party).
On the other hand, when the decision 406 determines that a predetermined text message has not been selected, then a decision 410 determines whether a custom text message is requested. When the decision 410 determines that a custom text message is not requested, then the text message response process 400 returns to repeat the decision 406 and subsequent operations. Alternatively, when the decision 410 determines that a custom text message is requested, then the custom text message is entered 412. Here, the called party interacts with the mobile communication device to enter the custom text message. Then, the custom text message is transmitted 414 to the caller. In one embodiment, the transmission 408, 414 of the text message can be performed over a communication network, such as a network having a Short Message Service Center (SMSC) supporting Short Message Service (SMS) messages. Following the transmission 408 of the selected text message or the transmission 414 of the custom text message, the text message response process 400 is complete and ends.
An alternative embodiment of a text message response process could operate to answer the incoming voice call and announce to the caller that a text message will be forthcoming. Then, the incoming voice call could be promptly dropped. This additional operation could, for example, be used with the text message response process 400 by providing an additional operation prior to the block 402 illustrated in FIG. 4.
The predetermined text messages being displayed 404 to a called party can be determined in a static or dynamic manner. A static determination would, for example, be a text message the called party has previously set or entered. Typically, with static determination, the list of text messages remains the same (i.e., static) until changed (e.g., by the called party). A dynamic determination would allow the text messages in the list (or the ordering of the text messages in the list) to change automatically, and not by the user. For example, the list or ordering of the text messages can depend on preference settings, configuration information, or prior usage. To illustrate, prior usage can include biasing the list of text messages such that those messages being most often selected appear higher in the list. The list or ordering of the text messages can also depend on the calling party, type of calling party, location of calling party or called party, and the like. The list of text messages can identify each text message with text (e.g., at least a portion of the corresponding text message, or an abbreviation) and/or graphics (e.g., icons).
The text message response process 400 flexibly enables a user to either select one or more predetermined text messages or provide a custom text message to be used as a text message response to a calling party. However, it should be recognized that, in other embodiments, a text message response process can alternatively simply pertain to only providing a custom text message, or only permitting selection of a predetermined text message. Further, in still other embodiments, a text message response process can first determine whether a custom text message is to be provided before presenting predetermined text messages.
FIG. 5 is a flow diagram of an automated call response process 500 according to one embodiment of the invention. The automatic call response process 500 is substantially similar in many ways to the personal call response process 200 illustrated in FIG. 2. However, the automated call response process 500 operates to reduce user input at the mobile communication device by making use of stored data pertaining to its hardware components, configuration or preferences. In this regard, the automatic call response process 500 includes a decision 502 that determines whether a head-set is active. When the decision 502 determines that a head-set is active, then the automatic call response process 500 can prefer, suggest or require the user to obtain and send 214 an audio message to the caller in response to an incoming voice call. Alternatively, when the decision 502 determines that a head-set is not active, then a decision 504 can determine whether a display is present. In other words, the decision 504 can determine whether the mobile communication device has a display. When the decision 504 determines that the mobile communication device does have a display, then the mobile communication device can operate to obtain and send 218 a text message to the caller. Of course, this assumes that the caller can support text messages even though they initially called with a voice call. Hence, in another embodiment, the automatic call response process can operate to query or obtain information regarding the caller's communication device capabilities.
An exemplary scenario of how the previously described automatic call response process could work according to one implementation is as follows:
1. From his mobile phone, Bill calls Tom's mobile phone.
2. Tom is alerted by his mobile phone of an incoming call. Optionally, caller information (i.e., pertaining to Bill) can be displayed or announced to Tom.
3. Tom can choose to answer the incoming call or decline to answer the call.
4. In the event that Tom declines to answer the call, Tom can have the opportunity to provide the caller with a brief audio or text message.
5. If an audio message is to be provided, then Tom can either record a personalized message or select one of a plurality of predetermined audio messages. In this case, the incoming call is answered by Tom's mobile phone and then the audio message is played for the caller, thereafter the call is dropped. The audio messages are typically brief (i.e., short), and examples of audio messages are: (i) “Will call in 10 minutes,” (ii) “Cannot talk now,” (iii) “I'm in a meeting,” or (iv) “Please don't call anymore.”
6. On the other hand, if a text message is to be provided, then Tom can either enter a personalized text message or select from a plurality of predetermined text messages. In this case, the incoming call is dropped, and the entered text message or the selected one of the predetermined text messages is sent. Examples of text messages are: (i) “Will call in 10 minutes,” (ii) “Cannot talk now,” (iii) “I'm in a meeting,” or (iv) “Please don't call anymore.” The text messages can be English (or other language) words or phrases, or can be condensed text strings (e.g., such as slang or chat language). In one embodiment, the predetermined text messages presented to Tom can be dependent on some criteria (i.e., automatically selected). Alternatively, it is possible that Tom might want to edit the predetermined text message, such can be permitted. As yet another example, the text message can embed dynamic information, such as position, e.g., “I'm in [position] now, so I′ll get back to you later.” The position can be determined using a GPS receiver in the mobile phone or acquired by a remote computer and provided to the mobile phone. The position may also be further processed (locally or remotely) into a more user-friendly form, such as city, school, restaurant name, or street type addresses. The position could also be used above to assist the user in deciding whether to answer the incoming call or decline to answer the call.
7. If hardware components, configuration or preferences are taken into consideration, as illustrated in FIG. 5, the above scenario can be modified. For example, if Tom is using a head-set with his mobile phone, then an audio message may be most convenient, assuming that Tom wants to provide a particular (i.e., customized) message to Bill. The head-set allows Tom to record a brief audio message. Less conveniently, the head-set can be used to present a list of predetermined audio messages and allow Tom's selection therefrom by a button or voice-command.
8. If Tom is not using a head-set, then a text message response might be more suitable. This would typically require that Tom's mobile phone have a display and a keypad. Even so, without a head-set, Tom could still record an audio message, though such would likely be less convenient.
9. Tom can also not provide an audio message or a text message and simply let the incoming call roll-over into voice mail.
The exemplary scenario can also be used in a case where the called party is using one line but the mobile device has multi-line capabilities or call waiting. In such case, the mobile phone can enable the called party to provide a brief audio or text message to the calling party as noted above. Alternatively, the mobile phone can itself automatically (i.e., without user input) respond to the calling party via an audio or text message since the mobile phone is aware that the called party is on the other line.
In this aspect of the invention, the calling party and the called party often use mobile communication devices, such as mobile phones. However, the parties can alternatively use other electronic devices, such as a PDA, a computer, etc. Further, the option to provide a text response could be prevented if the caller's device is known to not support text messages.
The advantages of the previously described embodiments are numerous. Different embodiments or implementations may yield different advantages. One advantage is that communications for users of electronic devices can be flexibly provided. Another advantage is that communication mode changes can be performed at an electronic device to better suit the needs or condition of the electronic device or user preferences. In still another advantage, a user can provide feedback to a caller without answering a voice call from the caller.
Another aspect of the invention pertains to improved approaches to respond to an incoming text message. The improved approaches enable a recipient to provide a reply message to an initiator. The incoming text message can be presented to the recipient with an audio or textual presentation. Thereafter, a reply text message can be sent back to the initiator. The recipient can form the reply text message by recording a brief audio message or entering a text message. In the case in which a brief audio message is used, the audio message can be automatically converted to a text message before being transmitted to the initiator.
FIG. 6 is a flow diagram of a message presentation process 600 according to one embodiment of the invention. The message presentation process 600 is performed by an electronic device, such as a mobile communication device.
The message presentation process 600 begins with a decision 602 that determines whether an incoming text message is present. Typically, the incoming text message would be transmitted to the mobile communication device from another communication device. When the decision 602 determines that an incoming text message is not present, then the message presentation process 600 awaits such message. Once the decision 602 determines that an incoming text message has been received, a decision 604 determines whether an audio or text presentation is to be utilized. The decision 604 can be performed in a variety of different ways. For example, the determination of whether to utilize an audio or text presentation can be based on user input or can be automatically determined through a use of configuration or preference information or hardware components (e.g., display, speaker, head-set).
When the decision 604 determines that an audio presentation is to be utilized, the incoming text message is converted 606 to an audio message. For example, a text-to-speech conversion can be performed. In one embodiment, a user of the electronic device can be permitted to choose speech characteristics, such as a voice, tone, pace, accent, or mood, for the resulting speech. For example, a user could choose speech characteristics by preference settings. In another embodiment, the incoming text message can include or reference speech characteristics so that the initiator can control or influence speech characteristics. In still another embodiment, if the text to be converted contains condensed text (e.g., such as slang or chat language), the resulting speech can pertain to an uncondensed form of the text. The ability to convert from condensed text to resulting speech for uncondensed text can be facilitated by pattern matching. For example, in chat language “LOL” can be converted to an audio message for “lots of love.” In one implementation, a table can store audio messages corresponding to chat terms or phrases. In another implementation, a first table would store uncompressed terms or phrases corresponding to chat terms or phrases, and a second table would store audio messages corresponding to the uncompressed terms or phrases.
After the incoming text message is converted to the audio message, the audio message is played 608. Typically, the audio message is played 608 by the mobile communication device for the user. For example, the audio message can be output to a speaker of the mobile communication device or a headset used therewith. As a result, the user of the mobile wireless communication device receives an audio message even though the incoming message was a text message.
On the other hand, when the decision 604 determines that a text presentation is to be utilized, the incoming text message is displayed 610. Here, the incoming text message would be displayed 610 on a display associated with the mobile communication device. Following the blocks 608 and 610, the message presentation process 600 ends.
As discussed above, text-to-speech conversion can be invoked and performed on an electronic device, which may be a mobile communication device. While text-to-speech conversion, particularly if high quality is desired, requires substantial processing capabilities, mobile electronic devices, such as mobile communication devices, given their small form factor and price competition, tend to have limited processing capability. Accordingly, in one embodiment, text-to-speech conversion can be off-loaded from the mobile device. For example, a remote server computer can be provided the text message and produce the resulting audio message, and then supply the audio message to the mobile device. The remote server computer can be a networked server coupled to the network 108. One example of a networked server is a gateway computer for a wireless electronic device, such as a mobile telephone.
FIG. 7 is a flow diagram of a reply message process 700 according to one embodiment of the invention. The reply message process 700 is performed by an electronic device, such as a mobile communication device.
The reply message process 700 begins with a decision 702 that determines whether a reply message is to be sent. Typically, the reply message process 700 follows the presentation of an incoming text message to a user of a mobile communication device. Hence, the reply message to be sent is a reply to the incoming text message. However, in other embodiments, the reply message to be sent can be merely an initial message as opposed to a response to an earlier message.
In any case, when the decision 702 determines that a reply message is not to be sent, then the reply message process 700 ends or simply awaits the need to send a reply message. On the other hand, when the decision 702 determines that a reply message is to be sent, then a decision 704 determines whether an audio or text message is to be formed. The decision 704 can be performed in a variety of different ways. For example, the determination of whether to send an audio or text message can be based on user input or can be automatically determined through a use of configuration or preference information or hardware components (e.g., display, speaker, head-set).
When the decision 704 determines that an audio message is to be formed, then the reply message process 700 prompts 706 for an audio message. Here, the prompt 706 can be directed to the user of the mobile communication device. The prompt can be an audio or textual indication. Next, a decision 708 determines whether an audio message has been recorded. When the decision 708 determines that the audio message has not been recorded, then the reply message process 700 awaits the audio message. Once the decision 708 determines that the audio message has been recorded, then the audio message is converted 710 to a text message. In one embodiment, if the audio message recorded is greater than a maximum text message size (e.g., 150 or 160 characters), then the audio message can be shortened so that the resulting text message does not exceed the maximum text message size. One way to shorten the text message is to use abbreviations. For example, the words “For example” can be changed to “e.g.”. Such conversion can be again be performed by matching entries in tables. Another way to shorten is to remove non-essential text. Still another way to shorten is to clip off or truncate the text message at the maximum text message size. In another embodiment, the resulting text message might provide an indication that it was converted from an audio message. Following the block 710, the text message is transmitted 712 over a wireless network.
Alternatively, when the decision 704 determines that a text message is to be formed, then a text entry screen is displayed 714. Next, a decision 716 determines whether a text message has been entered. When the decision 716 determines that a text message has not yet been entered, then the reply message process 700 awaits entry of the text message. Once the text message has been entered, the text message is transmitted 712 over the wireless network. Following the block 712, the reply message process 700 ends.
Although the reply message process 700 provides for the user to enter a custom text or audio message, it should be understood that the reply message can alternatively be formed through use of semi-custom or predetermined reply messages from which the user of the mobile communication device can choose. The use of semi-custom or predetermined reply messages can be achieved as noted above in a number of embodiments, and can serve to simplify the conversion process.
An exemplary scenario of how message presentation and reply message processes could work according to one implementation of the second aspect is as follows:
1. From his mobile phone, Bill prepares and sends a text message to Tom's mobile phone.
2. Tom is alerted by his mobile phone of an incoming text message, such as by displaying at least a portion of the text message and/or otherwise notifying Tom of the text message.
3. Tom's mobile phone can decide whether to present the text message on a display screen of Tom's mobile phone, or to first convert the text message to an audio message and then present the audio message to Tom (e.g., play the audio message). Of course, Tom can interact with Tom's mobile phone to assist in making the determination on how to present the message.
4. Thereafter, if desired, Tom can prepare and send a reply message back to Bill. This reply message can be prepared initially as a text message or an audio message. Tom's mobile phone and/or Tom can determine whether the reply message is initially prepared as a text message or as an audio message. If an audio message is initially created, such audio message must be converted to a text message prior to transmission. Eventually, the reply message is sent to Bill as a text message. Tom's mobile phone can assist with the creation of the reply message through use of custom, semi-custom or predetermined reply message from which Tom and/or Tom's mobile phone can choose.
5. If Tom is using a head-set with his mobile phone, then an audio message may be more convenient, assuming that Tom wants to provide a particular (i.e., customized) message to Bill. The head-set allows Tom to easily record a brief audio message. Less conveniently, the head-set can be used to present a list of predetermined audio messages and allow Tom's selection therefrom by a button or voice-command.
6. If Tom is not using a head-set, then a text message response might be more suitable. This would typically require that Tom's mobile phone have a display and a keypad. Even so, without a head-set, Tom could still record an audio message, though such would likely be less convenient.
7. Tom can also not provide a reply message and simply not respond to the incoming text message. Alternatively, Tom can configure his mobile phone to automatically produce and send a reply message based on user settings or preferences, position, configuration, status, etc.
In this aspect of the invention, the calling party and the called party often use mobile communication devices, such as mobile phones. However, the parties can alternatively use other electronic devices, such as a PDA, a computer, etc.
The advantages of the invention exemplified by FIGS. 6-7 are numerous. Different embodiments or implementations may yield different advantages. One advantage is that communications for users of electronic devices can be flexibly provided. Another advantage is that communication mode changes can be performed at an electronic device to better suit the needs or condition of the electronic device or user preferences. Still another advantage is that conversion of an audio message to a text message facilitates use a low cost network (such as the SMS network). Another advantage is reduced network bandwidth load. Yet still another advantage is that the sender can get back a message in the same format as they sent the original message, though the recipient may use the message in a different format or mode (e.g., recipient hears the text message as an audio message).
Moreover, it should be noted that with regards to any of the embodiments in which a voice call or a text message is incoming to an electronic device, not only can the user of the mobile device take an action (e.g., button press or voice-command) to decline the call/message but also the electronic device itself can automatically decline the call/message such that the user is not disturbed. For example, an electronic device can be configured through user settings (e.g., preferences) to decline calls/messages matching certain criteria. Also, an auto reply message can be configured to be automatically sent in response to the call/message. For a known, undesired marketing caller/message sender, the electronic device can automatically send a reply message demanding the sender not to call or send messages anymore, and to remove your information from their database.
Text messages received or sent can optionally embed indications of speech characteristics to be used, should the text message be converted to an audio format. The speech characteristics can pertain to voice, tone, pace, accent, and/or mood. The speech characteristics for the resulting speech can be set in preference or configuration information, set on a per message basis by users, or set by evaluation of monitored data pertaining to the user.
Additionally, the messages being transmitted can be encrypted for security purposes.
In one embodiment, an electronic device performing communications using audio and/or text messages according to the invention can further integrate (or have tethered thereto) one or more electrical components for enhancing the hearing of the user of the electronic device. The electronic device will normally include a microphone and a speaker. In any case, additional details on hearing enhancement are further described, for example, in U.S. Provisional Patent Application No. 60/620,238, filed Oct. 18, 2004, and entitled “EYEGLASSES WITH HEARING ENHANCED AND OTHER AUDIO SIGNAL-GENERATING CAPABILITIES,” which is hereby incorporated herein by reference;
The invention described herein can be considered an automated secretary for a user of an electronic device. The automated secretary can completely or partially respond to an incoming call/message so as to reduce disturbances to the user. The user can personalize the automated secretary through user settings (e.g., preferences), or the automated secretary can learn over time how to handle different incoming calls/messages. Besides handling or assisting the user with incoming calls/messages, the automated secretary can also assist with other activities, such as making calendar entries (e.g., meetings) in a calendar or responding to incoming callers/messages with relevant information pertaining to the user's schedule as maintained by the calendar (though the user could restrict such access to certain information and/or inquiring parties). For example, if an incoming text message asks “available for lunch today?”, the automated secretary can check the user's availability for lunch by way of the user's calendar, then if the user is not available the automated secretary can quickly informing the inquiring party of same or propose another date. On the other hand, if the lunch time period is available in the user's calendar, then the automated secretary can either directly respond to the inquiring party of acceptance or propose a response to the user for review, modification and/or transmission.
Furthermore, the embodiments implementations and features described in: (i) U.S. Provisional Patent Application 60/509,631, filed Oct. 9, 2003, and entitled “TETHERED ELECTRICAL COMPONENTS FOR EYEGLASSES,” which is hereby incorporated herein by reference; and (ii) U.S. Provisional Patent Application 60/462,591, filed Apr. 15, 2003, and entitled “EYEGLASSES FOR WIRELESS COMMUNICATION,” which is hereby incorporated herein by reference; (iii) U.S. patent application Ser. No. 10/964,011, filed Oct. 12, 2004, and entitled “TETHERED ELECTRICAL COMPONENTS FOR EYEGLASSES,” which is hereby incorporated herein by reference; and (iv) U.S. patent application Ser. No. 10/822,218, filed Apr. 12, 2004, and entitled “EYEGLASSES FOR WIRELESS COMMUNICATIONS,” which is hereby incorporated herein by reference, can be used with the various embodiments, implementations, features and aspects of the invention noted above. For example some or all of the processing noted above with respect to FIGS. 1-7 can be performed in electrical components integral or tethered to eyeglasses. However, the electrical components integral or tethered to eyeglasses can also interact and/or share processing tasks with an electrical device (e.g., mobile telephone, PDA, etc.) located proximate thereto.
It should be obvious to those skilled in the art that a number of embodiments performing communications using voice as well as audio and/or text messages can be implemented using voice over Internet Protocol technologies, with signals delivered over the Web. For example, a calling party's communication or mobile device can include an adapter to convert voice signals to data packets before sending them over the Internet. A service provider can convert the packets back into voice signals before sending the voice signals to the called party's communication device. Similarly, embodiments can be implemented using voice over wireless protocols, such as Wi-Fi or Wi-Max networks. Using such technologies, computing devices can become communication devices.
The various embodiments, implementations, features and aspects of the invention noted above can be combined in various ways or used separately. Those skilled in the art will understand from the description that the invention can be equally applied to or used in other different settings with respect to various combinations, embodiments, implementations or features provided in the description herein.
The invention can be implemented in software, hardware or a combination of hardware and software. A number of embodiments of the invention can also be embodied as computer readable code on a computer readable medium. The computer readable medium is any data storage device that can store data which can thereafter be read by a computer system. Examples of the computer readable medium include read-only memory, random-access memory, CD-ROMs, magnetic tape, and optical data storage devices. The computer readable medium can also be distributed over network-coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.
Numerous specific details are set forth in order to provide a thorough understanding of the present invention. However, it will become obvious to those skilled in the art that the invention may be practiced without these specific details. The description and representation herein are the common meanings used by those experienced or skilled in the art to most effectively convey the substance of their work to others skilled in the art. In other instances, well-known methods, procedures, components, and circuitry have not been described in detail to avoid unnecessarily obscuring aspects of the present invention.
In the foregoing description, reference to “one embodiment” or “an embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the invention. The appearances of the phrase “in one embodiment” in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Further, the order of blocks in process flowcharts or diagrams representing one or more embodiments of the invention do not inherently indicate any particular order nor imply any limitations in the invention.
The many features and advantages of the present invention are apparent from the written description. Since numerous modifications and changes will readily occur to those skilled in the art, it is not desired to limit the invention to the exact construction and operation as illustrated and described. Hence, all suitable modifications and equivalents may be resorted to as falling within the scope of the invention.

## Claims

1. A mobile electronic device configured to support wireless communication, including messaging, for a first user, said mobile electronic device capable of wirelessly communicating with a wireless headset, said mobile electronic device comprising:
a data storage device for storing at least computer program code; and
hardware for performing at least a portion of the computer program code,
wherein the computer program code includes at least:
computer program code for receiving an incoming text message for the first user, the incoming text message being associated with a second user;
computer program code for converting the incoming text message to an incoming audio message;
computer program code for presenting the incoming audio message for the first user via the wireless headset;
computer program code for recording a reply audio message from the first user via the wireless headset;
computer program code for converting the reply audio message into a reply text message; and

computer program code for transmitting the reply text message to the second user.

2. A mobile electronic device as recited in claim 1,
wherein the computer program code includes at least:
computer program code for determining whether the wireless headset is active, and

wherein the computer program code for converting the incoming text message is automatically invoked to convert the incoming text message to the incoming audio message if the computer program code for determining determines that the wireless headset is active.

3. A mobile electronic device as recited in claim 1, wherein the computer program code includes at least:
computer program code for prompting the first user to provide the reply audio message prior to recording of the reply audio message by the computer program code for recording.

4. A mobile electronic device as recited in claim 1, wherein the computer program code includes at least:
computer program code for limiting the reply audio message so as to not exceed a predetermined text message size.

5. A mobile electronic device as recited in claim 1,
wherein the computer program code includes at least:
computer program code for determining whether the wireless headset is active, and

wherein the computer program code for converting of the incoming text message is automatically invoked to convert the incoming text message to the incoming audio message if the computer program code for determining determines that the wireless headset is active.

6. A mobile electronic device as recited in claim 1,
wherein the computer program code includes at least:
computer program code for determining whether the incoming text message should be presented to the first user in an audio manner, and

wherein the computer program code for converting of the incoming text message is invoked to convert the incoming text message to the incoming audio message if the computer program code for determining determines that the incoming text message should be presented to the first user in an audio manner.

7. A mobile electronic device as recited in claim 6, wherein the computer program code includes at least:
computer program code for prompting the first user to provide the reply audio message prior to recording of the reply audio message by the computer program code for recording.

8. A mobile electronic device as recited in claim 6, wherein the computer program code for determining whether the incoming text message should be presented to the first user in an audio manner is based on at least a preference setting that is able to be set by the first user.

9. A mobile electronic device as recited in claim 6, wherein the computer program code for determining whether the incoming text message should be presented to the first user in an audio manner is active is based on at least a user indication.

10. A mobile electronic device as recited in claim 6, wherein computer program code for determining whether the incoming text message should be presented to the first user in an audio manner is based on at least a determination of whether the wireless headset is active.

11. A mobile electronic device as recited in claim 1, wherein the computer program code for converting the incoming text message to the incoming audio message depends on at least one user-selected speech characteristic.

12. A mobile electronic device as recited in claim 11, wherein the at least one user-selected speech characteristic is set based on at least one user preference that is able to be set by the first user.

13. A mobile electronic device as recited in claim 11, wherein the at least one user-selected speech characteristic is set based on at least one user setting provided at the mobile electronic device.

14. A mobile electronic device as recited in claim 11, wherein the at least one user-selected speech characteristic pertains to at least a voice for use in producing the incoming audio message.

15. A mobile electronic device as recited in claim 11, wherein the computer program code for presenting the incoming audio message comprises computer program code for playing the incoming audio message, with the playing of the incoming audio message being dependent on the at least one user-selected speech characteristic.

16. A mobile electronic device as recited in claim 1, wherein the incoming text message is a SMS message, and wherein the reply text message is a SMS message.

17. A mobile electronic device as recited in claim 1, wherein the computer program code for converting of the incoming text message to the incoming audio message comprises:
computer program code for translating at least a portion of the incoming text message from a condensed format to an uncondensed text format; and
computer program code for converting at least the portion of the incoming text message in the uncondensed text format to at least a portion of the incoming audio message.

18. A mobile electronic device as recited in claim 17, wherein the computer program code for converting of the incoming text message to the incoming audio message depends on at least one user-selected speech characteristic.

19. A mobile electronic device as recited in claim 18, wherein the at least one user-selected speech characteristic is set based on at least one user setting provided at the mobile electronic device.

20. A mobile electronic device as recited in claim 1, wherein at least a portion of the incoming text message is in a chat language, and wherein the computer program code for converting of the incoming text message to the incoming audio message comprises computer program code for expanding at least one term in the incoming text message that is in the chat language to a plurality of words in a non-chat language.

21. A mobile electronic device as recited in claim 1, wherein the mobile electronic device comprises a mobile telephone.

22. A mobile electronic device as recited in claim 1, wherein the computer program code includes at least:
computer program code for presenting a plurality of predetermined reply messages to the first user;
computer program code for receiving a user selection of one of the plurality of predetermined reply messages; and
computer program code for initiating delivery of the selected one of the  plurality of predetermined reply messages to the second user as a response to the incoming text message.

23. A mobile electronic device as recited in claim 1,
wherein the conversion of the incoming text message to the incoming audio message depends on at least one user-selected speech characteristic,
wherein the at least one user-selected speech characteristic is set based on at least one user preference that is able to be set by the first user,
wherein the presentation of the incoming audio message operates to at least play the incoming audio message in a manner dependent on the at least one user-selected speech characteristic,
wherein at least a portion of the incoming text message is in a chat language, and wherein the computer program code for converting the incoming text message to the incoming audio message comprises computer program code for expanding the portion of the incoming text message that is in the chat language to a plurality of words,
wherein the computer program code also includes computer program code for determining whether the incoming text message should be presented to the first user in an audio manner,
wherein the computer program code for converting the incoming text message to the incoming audio message converts the incoming text message to the incoming audio message if the computer program code for determining determines that the incoming text message should be presented to the first user in an audio manner,
wherein the determination of whether the incoming text message should be presented to the first user in an audio manner is based on at least a determination of whether the wireless headset is active, and
wherein the incoming text message is a SMS message, and wherein the reply text message is a SMS message.

24. A wireless communication device, said wireless communication device supports wireless communication, including messaging, for a first user, said wireless communication device capable of wirelessly communicating with a wireless headset,
wherein said wireless communication device includes at least a processor and is configured to at least:
receive an incoming text message for the first user, the incoming text message being associated with a second user;
convert the incoming text message to an incoming audio message;
present the incoming audio message for the first user via the wireless headset;
record a reply audio message from the first user via the wireless headset;
convert the reply audio message into a reply text message; and
transmit the reply text message to the second user.

25. A wireless communication device as recited in claim 24,
wherein said wireless communication device is configured to determine whether the wireless headset is active, and
wherein the incoming text message is automatically converted to the incoming audio message if it is determined that the wireless headset is active.

26. A wireless communication device as recited in claim 24, wherein said wireless communication device is configured to:
prompt the first user to provide the reply audio message to be recorded.

27. A wireless communication device as recited in claim 24, wherein said wireless communication device is configured to:
limit the reply audio message when operating to record and/or convert the reply audio message so that the reply text message does not exceed a predetermined text message size.

28. A wireless communication device as recited in claim 24,
wherein said wireless communication device is configured to:
determine whether the incoming text message should be presented to the first user in an audio manner, and

wherein the incoming text message is converted to the incoming audio message if it is determined that the incoming text message should be presented to the first user in an audio manner.

29. A wireless communication device as recited in claim 28, wherein said wireless communication device is configured to:
prompt the first user to provide the reply audio message prior to the reply audio message being recorded.

30. A wireless communication device as recited in claim 28, wherein the determination of whether the incoming text message should be presented to the first user in an audio manner is based on at least a preference setting that is able to be set by the first user.

31. A wireless communication device as recited in claim 28, wherein the determination of whether the incoming text message should be presented to the first user in an audio manner is based on at least a user indication.

32. A wireless communication device as recited in claim 28, wherein the determination of whether the incoming text message should be presented to the first user in an audio manner is based on at least a determination of whether the wireless headset is active.

33. A wireless communication device as recited in claim 24, wherein the conversion of the incoming text message to the incoming audio message depends on at least one user-selected speech characteristic.

34. A wireless communication device as recited in claim 33, wherein the at least one user-selected speech characteristic is set based on at least one user preference that is able to be set by the first user.

35. A wireless communication device as recited in claim 33, wherein the at least one user-selected speech characteristic is set based on at least one user setting provided at said wireless communication device.

36. A wireless communication device as recited in claim 33, wherein the at least one user-selected speech characteristic pertains to at least a voice for use in producing the incoming audio message.

37. A wireless communication device as recited in claim 33, wherein the presentation of the incoming audio message operates to at least present the incoming audio message in a manner dependent on at least the one user-selected speech characteristic.

38. A wireless communication device as recited in claim 24, wherein at least one of the incoming text message or the reply text message is a SMS message.

39. A wireless communication device as recited in claim 24, wherein the conversion of the incoming text message to the incoming audio message comprises:
translate at least a portion of the incoming text message from a condensed format to an uncondensed text format; and
convert at least the portion of the incoming text message in the uncondensed text format to at least a portion of the incoming audio message.

40. A wireless communication device as recited in claim 39, wherein the conversion of the incoming text message to the incoming audio message depends on at least one user-selected speech characteristic.

41. A wireless communication device as recited in claim 40, wherein the at least one user-selected speech characteristic is set based on at least one user setting provided at said wireless communication device.

42. A wireless communication device as recited in claim 24, wherein at least a portion of the incoming text message is in a chat language, and wherein the conversion of the incoming text message to the incoming audio message comprises expansion of the portion of the incoming text message that is in the chat language to a plurality of words.

43. A wireless communication device as recited in claim 24, wherein said wireless communication device is a mobile telephone.

44. A wireless communication device as recited in claim 24, wherein said wireless communication device is a computing device having communication capabilities.

45. A wireless communication device as recited in claim 24, wherein the incoming text message includes or references at least a speech characteristic for use during presentation of the incoming audio message.

46. A wireless communication device as recited in claim 24, wherein the incoming text message includes or references at least a speech characteristic for use during conversion of the incoming text message to an incoming audio message.

47. A wireless communication device as recited in claim 24, wherein at least a portion of the incoming text message is in a chat language, and wherein the conversion of the incoming text message to the incoming audio message comprises at least increasing the number of characters in the portion of the incoming text message that is in the chat language.

48. A wireless communication device as recited in claim 24, wherein said wireless communication device is configured to:
present a plurality of predetermined reply messages to the first user; and
receive a user selection of one of the plurality of predetermined reply messages to use as a response to the incoming text message for the second user.

49. A wireless communication device as recited in claim 24,
wherein the conversion of the incoming text message to the incoming audio message depends on at least one user-selected speech characteristic,
wherein the at least one user-selected speech characteristic is set based on at least one user preference that is able to be set by the first user,
wherein the presentation of the incoming audio message operates to at least play the incoming audio message in a manner dependent on at least the one user-selected speech characteristic,
wherein at least a portion of the incoming text message is in a chat language, and wherein the conversion of the incoming text message to the incoming audio message comprises expansion of the portion of the incoming text message that is in the chat language to a plurality of words,
wherein said wireless communication device is configured to at least determine whether the incoming text message should be presented to the first user in an audio manner,
wherein the incoming text message is converted to the incoming audio message if it is determined that the incoming text message should be presented to the first user in an audio manner, and
wherein the incoming text message is a SMS message, and wherein the reply text message is a SMS message.