Non-visual presentation of information on an electronic wireless device

In one example, information is presented to a user in a non-visual manner. In this example, a list of visually representable items defined by a beginning and at least one of dimension of time and space is accessed. Each of the visually representable items within the dimension is placed in one of a plurality of non-visual sensory categories. A non-visual sensory preview is rendered, in sequence for each item in the list, from the plurality of non-visual sensory categories.

FIELD OF THE DISCLOSURE

The present disclosure generally relates to electronic devices, and more particularly to presenting information to a user on an electronic device.

BACKGROUND

Information is generally presented to a user on an electronic device, such as a wireless communication device, in a visual manner. Stated differently, information is displayed to a user via the display of the device. However, there are many instances where a user is not able to look at the display long enough to fully comprehend the information being displayed. Some electronic devices allow information on the display to be read back to the user using text-to-speech software. However, this text-to-speech option is usually slow and sometimes incomprehensible. Also, the user may need to be presented with the information in a more indiscrete and unobtrusive manner.

DETAILED DESCRIPTION

The terms “a” or “an”, as used herein, are defined as one or more than one. The term plurality, as used herein, is defined as two or more than two. The term another, as used herein, is defined as at least a second or more. The terms “including” and “having” as used herein, are defined as comprising (i.e. open language). The term “coupled” as used herein, is defined as “connected” although not necessarily directly, and not necessarily mechanically.

The term “wireless communication device” is intended to broadly cover many different types of devices that can wirelessly receive signals, and in most cases can wirelessly transmit signals, and may also operate in a wireless communication system. For example, and not for any limitation, a wireless communication device can include any one or a combination of the following: a two-way radio, a cellular telephone, a mobile phone, a smartphone, a two-way pager, a wireless messaging device, a laptop/computer, a personal digital assistant, a tablet computing device and other similar devices.

Described below are systems and methods for non-visually presenting information to a user of an electronic device. In one example, a list of visually representable items defined by a beginning and at least one of dimension of time and space is accessed. Each of the visually representable items is placed within the dimension in one of a plurality of non-visual sensory categories. A non-visual sensory preview from the plurality of non-visual sensory categories is rendered in sequence for each item in the list. This non-visual sensory preview of the information provides ambient global information to the user in an unobtrusive way. Stated differently, the non-visual sensory preview provides information to a user that can be processed in a conscience or subconscious way.

FIG. 1is a block diagram illustrating one example of an operating environment for presenting information to a user of an electronic device in a non-visual manner. In particular,FIG. 1shows an electronic device such as, but not limited to, a wireless communication device100. It should be noted that although the following discussion uses a wireless communication device as one example of an electronic device, any electronic device that presents information to a user is applicable to one or more examples of the present invention. The wireless communication device100comprises, among other things, a display102, a non-visual presentation manager104, one or more non-visual interfaces106, applications108, application data110(also referred to herein as “visually representable item110”), and non-visual presentation profiles112. The applications108can be any application that generates information to be displayed to a user via the display102. For example, the applications108can include, but are not limited to, a messaging application, a global positioning satellite (GPS) application, a calendar application, or the like.

The application data110comprises data/information generated or managed by the applications108to be displayed to the user via the display102. For example, with respect to a messaging application, the application data110can include text messages, email messages, instant messages and information associated therewith. With respect to a GPS application, the application data110can include routing information/instructions or other related information. With respect to a calendar application, the application data110can include meeting/scheduling information and other related information. It should be noted that the application data110can also include data that is not necessarily visually displayed to a user but is used by an application to visually display information associated therewith. It should also be noted that the application data is not required to be currently displayed for the non-visual presentation manager104to analyze the data. The non-visual presentation manager104can analyze the application data110in a non-displayed state. The non-visual presentation profiles112identify the non-visual sensory type/category of non-visual sensory event/action or feedback that is to be generated by the non-visual presentation manager104for a given set of application data110. The non-visual presentation profiles112are discussed in greater detail below.

The non-visual presentation manager104comprises a profile analyzer114, an application data analyzer116, and a non-visual sensory event/action generator118. The non-visual presentation manager104utilizes these components to identify the information that is being presented on the display102(and any additional information outside of the display area) and to generate non-visual feedback for presenting this information to the user in a non-visual manner via the one or more non-visual interfaces106. The non-visual interfaces106can include any non-visual interface such as a tactile interfaces, haptic interfaces, audio interfaces, temperature varying interfaces, and the like. The non-visual presentation manager104and its components are discussed in greater detail below.

The non-visual sensory events/actions collectively create a pre-view or an overview of the information on the device100that is currently being displayed. In one example, the non-visual sensory events/actions are performed in a sequence that represents the sequence in which the application data110is visually presented to the user on the display102. In addition, non-visual sensory events/actions can also be generated to create a pre-view or an overview of information that is outside of the display area (e.g., not currently being displayed). For example, non-visual sensory events/actions, such as a sequence of vibratory pulses either on the display102or throughout the device100, can be generated to represent email messages shown on the display102and outside of the current display view. Vibratory pulses of different lengths and of different intensities can be used to represent various dimensions, such as time and/or space, associated with the information. For example, an unread email message can be represented by a vibratory pulse of a given length and/or a given intensity while a read email message can be represented by a vibratory pulse of a differently length and/or different intensity. Also, the time between pulses can represent the time elapsed between when the emails were received. Non-visual sensory event/action can include, but are not limited to, sound, haptic and/or tactile feedback, temperature, electric shock, and change in a shape.

It should be noted that other attributes in addition to length/duration and intensity can be varied to represent other attributes of information as well. It should also be noted that the term “pulse” is used throughout this discussion to denote any kind of brief tactile stimulation and is not restricted to being perceived as a pulse per se. The tactile stimulation can take one of many forms such as, but not limited to, vibration, pressure, indentation, temperature, change in size, change in shape, shock, etc.

FIG. 2shows one example of a table200comprising various non-visual presentation profiles that are used by the non-visual presentation manager104for generating non-visual sensory events/actions for representing a set of application data110. In particular,FIG. 2shows one example of a table200associated with email messages. It should be noted that in the example ofFIG. 2, each individual row in the table represents a separate profile for a given type of email message comprising the attributes shown in the table. However, other configurations are also applicable as well. The table200includes a first column202, entitled “Status”, that comprises one or entries that include an email message status identifier. For example, a first entry204under this column202comprises an “unread” status identifier and a second entry206comprises a “read” status identifier. It should be noted that other attributes of a message can be included as well such as, but not limited to, the type of message, importance of a message, flag type associated with message, or any other attribute applicable to messages.

A second column208, entitled “Attachment”, comprises entries with attachment status identifiers. For example, a first entry210under this column208comprises an attachment status identifier of “Yes” and a second entry212comprises an attachment status identifier of “No”. Therefore, the first row214in the table200is a non-visual presentation profile for email messages that are unread and have an attachment. The second row216is a non-visual presentation profile for email messages that have been read and include an attachment. The third row218is a non-visual presentation profile for email messages that are unread and do not have an attachment. The fourth row220is a non-visual presentation profile for email messages that are have been read and do not have an attachment.

A third column222, entitled “Non-Visual Event Type”, comprises entries that indicate the type/category of non-visual sensory event to be generated for a given email message type. For example, a first entry224under this column222indicates that for an email message that is unread and has an attachment, a vibratory pulse is to be generated. A second entry226indicates that for an email message that is read and has an attachment, a non-visual sensory event is not generated. This configuration allows a user to easily distinguish between read and unread messages.

A fourth column228, entitled “Event Duration”, comprises entries that indicate a given duration for the event type/category identified in third column222. For example, a first entry230under this column228indicates that the duration of the vibratory pulse for an email message that is unread and that has an attachment is 0.25 seconds long. A fifth column232, entitled “Event Intensity”, comprises entries that identify the intensity level (if applicable) of a given presentation event type/category identified in the third column222. For example, a first entry234under this column232indicates that the vibratory pulse for an email message that is unread and that has an attachment is to be generated at a level 5 intensity. A second entry236indicates that the vibratory pulse for an email message that is unread and that does not have an attachment is to be generated at a level 1 intensity. The various intensity levels, in this example, allow the user to distinguish between unread messages with attachments and without attachments.

It should be noted that other configurations of presentation event types, durations, and intensity levels, in additional to those shown inFIG. 2, are also applicable as well. For example, email messages that have already been read can have a non-visual sensory event type/category associated therewith as well. This presentation event type/category can be the same as the event type/category for an unread email, but with a different duration and/or intensity. Alternatively, a different event type can be used as well. It should also be noted that one or more columns/rows can be added and/or deleted from the table shown inFIG. 2. One advantage is that presentation event types, event durations, and/or event intensities can be varied to allow a user to easily distinguish between different types of information such as an unread email with an attachment, an unread email without an attachment, a read email with an attachment, and a read email without an attachment in a non-visual manner.

FIG. 3shows another example of a table300comprising non-visual sensory event profiles that are used by the presentation manager104for generating non-visual sensory events to represent a set of application data110. In particular,FIG. 3shows one example of a table300for calendar information. It should be noted that in the example ofFIG. 3, each individual row in the table is a separate profile for a given type of calendar item. However, other configurations are also applicable as well. The table300includes a first column302, entitled “Scheduled Calendar Event”, which comprises entries identifying a scheduling status. For example, a first entry304under this column302identifies a profile that is applicable when a scheduled calendar item is detected for a given time period in a calendar application. A second entry306identifies a profile that is applicable when a “free” or “available” period is detected (i.e., a given time period is not associated with a scheduled calendar item). Therefore, the first row308in the table300is a non-visual presentation profile for scheduled calendar items and the second row310is a profile for calendar “free” time.

A second column312, entitled “Non-Visual Event Type”, comprises entries that indicate the type/category of non-visual sensory event to be generated for a detected scheduled calendar item or a detected “free” period. For example, a first entry314under this column312indicates that for detected scheduled calendar item a vibratory pulse is to be generated. A second entry316indicates that for a detected “free” period a non-visual event is not generated. This configuration allows a user to easily distinguish between time periods with scheduled calendar items and without scheduled calendar items. It should be noted that different types of calendar items can be associated with different types of non-visual sensory event types as well. For example, business related calendar items can be associated with different types of non-visual sensory events than personal related calendar items.

A third column318entitled “Event Duration” comprises entries that indicate a given duration for the non-visual sensory event type/category identified under the second column312. For example, a first entry320under this column318indicates that the duration of the vibratory pulse for a scheduled calendar item is 0.33 seconds per 1 hour interval. A second entry322under this column318indicates that the duration of a time interval without a non-visual sensory event time is also 0.33 seconds per 1 hour interval. For example, if a scheduled meeting is 1 hour long, the vibratory pulse representing this meeting is 0.33 seconds long. If a scheduled meeting is 2 hours long, the vibratory pulse representing this meeting is 0.66 seconds long. The same applies for periods of “free” time.

A fourth column324, entitled “Event Intensity”, comprises entries that identify the intensity level (if applicable) of a given non-visual sensory event type identified in the second column312. For example, a first entry326under this column324indicates that the vibratory pulse for a scheduled calendar event is to be generated at a level 5 intensity. It should be noted that other configurations of non-visual sensory event types, durations, and intensity levels in additional to those shown inFIG. 3are also applicable as well. Also, one or more columns/rows can be added and/or deleted from the table shown inFIG. 3.

FIG. 4shows another example of a table400comprising non-visual sensory event profiles that are used by the presentation manager104for generating non-visual sensory events to represent a set of application data110. In particular,FIG. 4shows one example of a table400for GPS routing information. It should be noted that in the example ofFIG. 4, each individual row424,426,428,430in the table is a separate profile for a given type of routing instruction. However, other configurations are also applicable as well. The table400includes a first column402, entitled “Routing Instruction”, which comprises entries identifying a given GPS routing instruction. For example, a first entry404under this column402identifies a “straight” routing instruction while a second entry406identifies a “left” routing instruction.

A second column408, entitled “Non-Visual Event Type”, comprises entries that indicate the type/category of non-visual sensory event to be generated for the corresponding routing instruction under the first column402. For example, a first entry410under this column408indicates that for a “straight” routing instruction an auditory event is to be generated. A second entry412indicates that for a “left” routing instruction an auditory event is to also be generated. It should be noted that different non-visual sensory event types can be associated with different routing instructions as well.

A third column414, entitled “Auditory Event”, comprises entries that identify the specific auditory event to be presented to the user for the corresponding routing instruction under the first column402. For example, a first entry416under this column414indicates that audio with the phrase “straight” is to be played to represent a “straight” routing instruction. A second entry418under this column414indicates that audio with the phrase “left” is to be played to represent a “left” routing instruction.

A fourth column420, entitled “Duration Between Events”, comprises entries that indicate a given delay between non-visual sensory events before presenting the next event. For example, a first entry422under this column420indicates that after a non-visual sensory event for a “straight” instruction is generated the manager104waits 0.25 seconds per 1 km before generating the next non-visual sensory event. Stated differently, if the user is to head straight for 10 km before turning left then there is a 2.5 second delay after generating the “straight” auditory event until the “left” auditory event is generated. This configuration gives the user an overview of the routing instructions and the distance that the user is to travel with respect to each instruction. It should be noted that vibratory pulses or other non-visual sensory events can be used instead of, or in addition to, the auditory events. For example, each routing instruction can be associated with a different vibratory pulse.

As can be seen fromFIGS. 2-4discussed above, various non-visual sensory events can be used to represent various types of information. These non-visual sensory events are advantageous because they can be used to provide a short overview or preview of the information in an unobtrusive non-visual manner that can be easily understood by the user. This short overview of preview of the information generated by the non-visual presentation manager104provides ambient global information to the user in an unobtrusive way. Stated differently, the non-visual presentation manager104provides information to a user that can be processed in a conscience or subconscious way.

Attributes associated with the non-visual sensory events such as duration and intensity can be selected and/or varied to represent time and/or space dimensions associated with information. For example, intensity levels can be varied such that a stronger intensity represents a point in time that is closer to the current time than an event with a weaker intensity. Intensity levels can also be varied to represent different types of information such as an email with an attachment and an email without an attachment. Duration of events and duration of the time between events can be varied such that events with a shorter delay between each other represent items that are closer to each other in space or time. For example, items on a web page that are close to each other can be represented by non-visual events with a smaller delay between each event, where items on the web page that are farther from each other can be represented by non-visual events with a longer delay between each event. In another example, a space dimension can be delimited by a scrollable window for viewing at least a portion of an email mailbox, where space dimension can be equal to viewable portion of the window or be greater or less than the viewable portion. In another example, the space dimension can be a position within a list of items, on a web page, or the like. These are only a few examples applicable to one or more examples of the present invention.

The non-visual presentation manager104uses the non-visual presentation profiles112to generate a sequence of non-visual sensory events that provide an overview or preview of a given set of information. For example, when the user of the device100opens an application108such as an email application, the application data analyzer116of the manager104analyzes the application data110such as email messages in an inbox. Alternatively, the process for non-visually representing information to a user can be initiated by the user placing a pointer over an icon without clicking the icon. The profile analyzer114of the manager104then identifies a set of profiles112such as those shown inFIG. 2associated with email messages. The profile analyzer114then compares and matches the information in the identified profiles112to the corresponding data in the application data110. As discussed above, these profiles112comprise a set of non-visual sensory types/categories of non-visual events that are associated with a given application data item. The non-visual sensory event generator118, based on this comparison and matching, generates a sequence of non-visual events that represent the application data110. The manager104then performs this sequence of non-visual sensory events to provide the user with an overview or preview of the application data/information110.

For example,FIG. 5shows a first set of emails502being presented on the display102and a second set of email messages504that are outside of the current view of the display102. The application data110in this example is the set of email messages502,504in the inbox of the email application and a set of attributes associated with the email messages. The application data110, in this example, is defined by a beginning, such as the first email in the set of emails to be non-visually presented, and by time and/or space dimension. The set of attributes can be, for example, message status such as read or unread, an indication as to whether the email comprises an attachment, the time the message was received (or other temporal attributes), or the like. The profile analyzer114compares this application data110to the set of profiles112to identify a profile (such as profiles214,216,218,220inFIG. 2) associated with each message.

Using Table200inFIG. 2, the profile analyzer114identifies that the third profile218in table200is to be used for the first email message506inFIG. 5since the first email message506is unread (as indicated by an icon of a closed envelope) and does not include an attachment (as indicated by the absence of a paper clip on the envelope icon). The profile analyzer114identifies that the fourth profile220in table200is to be used for the second email message508inFIG. 5since it is has been read (as indicated by an icon of an open envelope) and does not include an attachment. The profile analyzer114identifies that the first profile214in table200is to be used for the third email message510inFIG. 5since it is unread and has an attachment (as indicated by the presence of a paper clip on the envelope icon). The profile analyzer114continues this process for each email message in the first set of email messages502and optionally for each message in the second set of email messages504.

The non-visual sensory event generator118then generates a sequence of non-visual sensory events based on the identified profiles to create a non-visual overview/preview of the first set of email messages502and/or the second set of email messages504.FIG. 6shows one example of a sequence of non-visual events that represents and provides an overview/preview of the first and second set of email messages502,504inFIG. 5. In particular,FIG. 6shows that for the first email message506a first vibratory pulse602of 0.25 seconds is generated based on the information in the third profile218ofFIG. 2.FIG. 6also shows that a non-event period604of 0.25 seconds exists for the second email message508based on the information in the fourth profile220ofFIG. 2.

A second vibratory pulse606of 0.25 seconds is generated for the third email message510based on the information in the first profile214ofFIG. 2. However, because the third email message510has an attachment, the intensity of the second vibratory pulse606is greater than the first vibratory pulse602generated for the first email message504. This difference in intensity is represented by the second vibratory pulse606having greater amplitude than the first vibratory pulse602. The sequence continues for the remaining9email messages for a total direction of 3 seconds. As can be seen, the user is presented with an unobtrusive, efficient, and comprehensible non-visual overview/preview of email messages such that the user is able to distinguish between read messages, unread messages without an attachment, and unread messages with an attachment.

It should be noted that one or more examples of the present invention are applicable to any type of lists and are not limited to lists of email messages. For example, other types of lists include postings in a social network are applicable. In this example, the number comments associated with each posting can be represented with a non-visual preview, as discussed above. Another example of a list can include contacts where each contact has a network of his/her own contacts and the size of this network can be represented with a non-visual preview, as discussed above.

Another example of generating a sequence of non-visual sensory events to for providing an overview/preview of displayed information is shown inFIGS. 7-8.FIG. 7shows calendar information702being presented on the display102. The application data110in this example is the set of calendar information702and optionally any attributes associated therewith. The profile analyzer114compares this application data110to the set of profiles112to identify a profile (such as profiles308and310inFIG. 3) associated with a calendar item.

Using Table300inFIG. 3, the profile analyzer114compares the calendar information at each time interval/slot to the profiles in table300. For example, for the 9:00, 11:00, 12:00, 15:00, and 16:00 time slots the profile analyzer114determines that the second profile310is to be used since a calendar item is not present. However, the profile analyzer114determines that the first profile308is to be used for the time slot between 10:00-11:00, 13:00-14:00, and 16:30-17:00 since a calendar item exists for been scheduled for each of these slots.

The non-visual sensory event generator118then generates a sequence of non-visual events based on the identified profiles to create a non-visual representation of the calendar information702.FIG. 8shows one example of a sequence of non-visual events that represents and provides an overview/preview of the calendar information702inFIG. 7. In particular,FIG. 8shows that a first relaxed period802(no event) corresponding to the time period of 9:00 to 10:00 exists for total of 0.33 seconds. This indicates that user is free during this time period. A first vibratory pulse804is then generated for a total of 0.33 seconds for the time period corresponding to 10:00 am to 11:00 am. This indicates that a meeting has been scheduled for one hour during this time period. The sequence then continues as shown inFIG. 8. As can be seen fromFIG. 8, a user is presented with a non-visual overview of his/her calendar information702that allows the user to determine how many meetings he/she has and the duration of each meeting. It should be noted that, in one example, the length of the non-visual sensory preview shown inFIG. 8corresponds to a ratio of a length of one of the calendar entries divided by a length of a time dimension corresponding to the time slots. In another example, the start time of rendering of the non-visual sensory preview corresponds to a ratio of a start time of the one of the calendar items divided by a length of the time dimension of the calendar. Also, even though the user may have opened the calendar in a “Month” view, the non-visual preview presented to the user can be for another period of time such as the current day. For example, the user can move a pointer over to a given day in the “Month” view and be provided a non-visual preview for that given day without opening a view for that specific day.

Another example, of generating a sequence of non-visual events to represent a given set of information is shown inFIGS. 9-10.FIG. 9shows a set of GPS routing information902being presented on the display102. For example,FIG. 9shows that the user is to head straight for 10 Km then turn right for 1 Km, then turn left for 4 Km, then turn left for 2 Km, turn right for 4 Km. The application data110in this example is the set of calendar GPS routing information902and optionally any attributes associated therewith. The profile analyzer114compares this application data110to the profile112to identify a profile associated with calendar event.

Using Table400inFIG. 4as an example, the profile analyzer114compares the GPS routing information902to the profiles in Table400and identifies the profiles to be used for each GPS routing instruction. For example, the profile analyzer114determines that the first profile424is to be used for the first instruction904of heading straight for 10 km. The profile analyzer114also determines that the third profile426is to be used for the second instruction906of turn right for 1 Km. The profile analyzer114performs this process for each of the remaining GPS instructions inFIG. 9.

The non-visual sensory event generator118then generates a sequence of non-visual events based on the identified profiles to create a non-visual representation of the GPS routing information902.FIG. 10shows one example of a sequence of non-visual events that represents and provides an overview/preview of the GPS routing instructions902inFIG. 9. In particular,FIG. 10shows that a first non-visual event1002of audio with the phrase “straight” is presented to the user. The next event is not performed for another 2.5 seconds since the profile424indicates that the duration between events is for 0.25 seconds per 1 Km. Therefore, the user can determine that he/se is head straight for 10 Km. It should be noted the non-visual sensory preview shown inFIG. 10, in on example, corresponds to a ratio of a time of the direction entry divided by a length of time of the overall route described with each direction entry.

FIG. 10also shows that a second non-visual event1004of audio with the phrase “right” is presented to the user and a delay of 0.25 second exists until the next event. Therefore, the user can determine that he/se is to turn right for 1 Km. A third non-visual event1006of audio with the phrase “left” is presented to the user and a delay of 1.0 seconds exists until the next event. Therefore, the user can determine that he/se is to turn left for 4 Km. A fourth non-visual event1008of audio with the phrase “left” is presented to the user and a delay of 0.5 seconds exists until the next event. Therefore, the user can determine that he/se is to turn left for 2 Km. A fifth non-visual event1010of audio with the phrase “right” is presented to the user and a delay of 1.0 seconds exists until the next event. Therefore, the user can determine that he/se is to turn right for 4 Km. A sixth non-visual event1012of audio with the phrase “destination” is presented to the user, which indicates that this is the last instruction of the GPS routing information902. It should be noted that other forms of audio can be used to represent directions in an abstract manner. For example, instead of playing audio that states “left”, “right”, straight”, etc., any type of sound can be presented to the user to represent this information in an abstract manner. Also, the characteristics of the sounds such as frequency and amplitude can be varied to further represent a given set of application data.

As can be seen from the above discussion, the non-visual presentation manager104provides an overview/preview of information to a user of an electronic device using non-visual mechanisms. Users are provided with ambient global information in an unobtrusive way. The overview or overarching information that is communicated is subtle and can be processed by the user in a comprehensive way. The non-visual overview/preview can be automatically provided to the user upon launching an application and is designed to be presented to the user in an accelerated way.

For example, when unlocking the device100for the first time in the morning, the user is presented with a long string of faint tactile pulses that represent different meetings throughout the day. The approximate time and length of each meeting can be communicated in a non-visual manner. In another example, as soon as the destination address is entered into a GPS application or system, the system audibly presents an accelerated overview of the driving instructions. Alternatively, the instructions can be replaced with faint beeps that are used to indicate that some driving event will need to be taken without explicitly stating what the event will be. It should be noted that in examples where audio is used to non-visually represent data, stereo imaging can be utilized to provide another dimension to the preview. For example, in the GPS example given above, if a user is to take a right turn audio can be generated only from the right speaker, and if the user is to take a left turn audio can be generated only from the left speaker. If the user is to head straight then audio can be generated from both speakers simultaneously.

In yet another example, when an email application is launched, a string of pulses is performed. Each pulse represents an unread email in the inbox. The absence of a pulse indicates that the email was opened. A stronger pulse indicates that the email has an attachment associated therewith. Note that this example applies to a variety of lists and is not restricted to message lists. For instance, it is also applicable to a long list of images that have different properties. In another example, when an attachment is opened and being downloaded, faint pulses can be performed. The pulses can represent, for instance, the number of pages in the document. If a webpage is being loaded, pulses can represent the number of images on the webpage or even what type of page is being downloaded (a form, an image, a text, a blog, or the like). It should be noted that the modalities discussed above are interchangeable. For example, haptic feedback can be replaced with audio feedback and vice-versa. Alternatively, haptic feedback and audio feedback can be combined as well.

FIG. 11is a flow diagram for a non-visual sensory based information presentation process1100. The non-visual sensory based information presentation process1100presents information currently being displayed on an electronic device to a user in a non-visual sensory based manner as discussed above with respect toFIGS. 1-10. This non-visual sensory based information presentation process1100is performed by the non-visual presentation manager104discussed above.

The flow diagram ofFIG. 11begins at step1102and flows directly to step1104. The presentation manager104, at step1104, determines that a user has opened or is interacting with an application108. The presentation manager104, at step1106, analyzes a set of data items110being visually presented by the application108. As discussed above, this data is defined by a time and/or space dimension. The presentation manager104, at step1108, compares each data item in the set of data items110to a step of non-visual presentation profiles112. The presentation manager104, at step1110, identifies, for each data item, at least one profile112that substantially matches the data item based on the comparison. The presentation manager104, at step1112, generates a sequence of non-visual sensory events that represent the set of data items in at least one dimension, such as time and/or space. The presentation manager104, at step1114, performs the sequence of non-visual sensory events. The control flow then exits at step1116.

FIG. 12is a block diagram of an electronic device and associated components1200in which the systems and methods disclosed herein may be implemented. In this example, an electronic device1202is a wireless two-way communication device with voice and data communication capabilities. Such electronic devices communicate with a wireless voice or data network1204using a suitable wireless communications protocol. Wireless voice communications are performed using either an analog or digital wireless communication channel. Data communications allow the electronic device1202to communicate with other computer systems via the Internet. Examples of electronic devices that are able to incorporate the above described systems and methods include, for example, a data messaging device, a two-way pager, a cellular telephone with data messaging capabilities, a wireless Internet appliance, a tablet computing device or a data communication device that may or may not include telephony capabilities.

The illustrated electronic device1202is an example electronic device that includes two-way wireless communications functions. Such electronic devices incorporate communication subsystem elements such as a wireless transmitter1206, a wireless receiver1208, and associated components such as one or more antenna elements1210and1212. A digital signal processor (DSP)1214performs processing to extract data from received wireless signals and to generate signals to be transmitted. The particular design of the communication subsystem is dependent upon the communication network and associated wireless communications protocols with which the device is intended to operate.

The electronic device1202includes a microprocessor1216(that controls the overall operation of the electronic device1202. The microprocessor1216interacts with the above described communications subsystem elements and also interacts with other device subsystems such as non-volatile memory1218and random access memory (RAM)1220. The non-volatile memory1218and RAM1220in one example contain program memory and data memory, respectively. The microprocessor1216also interacts with the non-visual presentation manager104and its components, an auxiliary input/output (I/O) device1222, a Universal Serial Bus (USB) Port1224, a display1226, a keyboard1228, a speaker1232, a microphone1234, a short-range communications subsystem1236, a power subsystem1238, and any other device subsystems.

A battery1240is connected to a power subsystem1238to provide power to the circuits of the electronic device1202. The power subsystem1238includes power distribution circuitry for providing power to the electronic device1202and also contains battery charging circuitry to manage recharging the battery1240. The power subsystem1238includes a battery monitoring circuit that is operable to provide a status of one or more battery status indicators, such as remaining capacity, temperature, voltage, electrical current consumption, and the like, to various components of the electronic device1202. An external power supply1246is able to be connected to an external power connection1248.

The USB port1224further provides data communication between the electronic device1202and one or more external devices. Data communication through USB port1224enables a user to set preferences through the external device or through a software application and extends the capabilities of the device by enabling information or software exchange through direct connections between the electronic device1202and external data sources rather than via a wireless data communication network.

Operating system software used by the microprocessor1216is stored in non-volatile memory1218. Further examples are able to use a battery backed-up RAM or other non-volatile storage data elements to store operating systems, other executable programs, or both. The operating system software, device application software, or parts thereof, are able to be temporarily loaded into volatile data storage such as RAM1220. Data received via wireless communication signals or through wired communications are also able to be stored to RAM1220. As an example, a computer executable program configured to perform the non-visual sensory based information presentation process1100, described above, is included in a software module stored in non-volatile memory1218.

The microprocessor1216, in addition to its operating system functions, is able to execute software applications on the electronic device1202. A predetermined set of applications that control basic device operations, including at least data and voice communication applications, is able to be installed on the electronic device1202during manufacture. Examples of applications that are able to be loaded onto the device may be a personal information manager (PIM) application having the ability to organize and manage data items relating to the device user, such as, but not limited to, e-mail, calendar events, voice mails, appointments, and task items. Further applications include applications that have input cells that receive data from a user.

Further applications may also be loaded onto the electronic device1202through, for example, the wireless network1204, an auxiliary I/O device1222, USB port1224, short-range communications subsystem1236, or any combination of these interfaces. Such applications are then able to be installed by a user in the RAM1220or a non-volatile store for execution by the microprocessor1216.

In a data communication mode, a received signal such as a text message or web page download is processed by the communication subsystem, including wireless receiver1208and wireless transmitter1206, and communicated data is provided the microprocessor1216, which is able to further process the received data for output to the display1226, or alternatively, to an auxiliary I/O device1222or the USB port1224. A user of the electronic device1202may also compose data items, such as e-mail messages, using the keyboard1228, which is able to include a complete alphanumeric keyboard or a telephone-type keypad, which may be implemented as a physical keyboard or a virtual keyboard comprising key images rendered on a touchscreen display, in conjunction with the display1226and possibly an auxiliary I/O device1222. Such composed items are then able to be transmitted over a communication network through the communication subsystem.

For voice communications, overall operation of the electronic device1202is substantially similar, except that received signals are generally provided to a speaker1232and signals for transmission are generally produced by a microphone1234. Alternative voice or audio I/O subsystems, such as a voice message recording subsystem, may also be implemented on the electronic device1202. Although voice or audio signal output is generally accomplished primarily through the speaker1232, the display1226may also be used to provide an indication of the identity of a calling party, the duration of a voice call, or other voice call related information, for example.

Depending on conditions or statuses of the electronic device1202, one or more particular functions associated with a subsystem circuit may be disabled, or an entire subsystem circuit may be disabled. For example, if the battery temperature is low, then voice functions may be disabled, but data communications, such as e-mail, may still be enabled over the communication subsystem.

A short-range communications subsystem1236is a further optional component which may provide for communication between the electronic device1202and different systems or devices, which need not necessarily be similar devices. For example, the short-range communications subsystem1236may include an infrared device and associated circuits and components or a Radio Frequency based communication module such as one supporting Bluetooth® communications, to provide for communication with similarly-enabled systems and devices.

A media reader1242is able to be connected to an auxiliary I/O device1222to allow, for example, loading computer readable program code of a computer program product into the electronic device1202for storage into non-volatile memory1218. In one example, computer readable program code includes instructions for performing the pressure detecting user input device operating process1100, described above. One example of a media reader1242is an optical drive such as a CD/DVD drive, which may be used to store data to and read data from a computer readable medium or storage product such as computer readable storage media1244. Examples of suitable computer readable storage media include optical storage media such as a CD or DVD, magnetic media, or any other suitable data storage device. Media reader1242is alternatively able to be connected to the electronic device through the USB port1224or computer readable program code is alternatively able to be provided to the electronic device1202through the wireless network1204.

The present subject matter can be realized in hardware, software, or a combination of hardware and software. A system can be realized in a centralized fashion in one computer system, or in a distributed fashion where different elements are spread across several interconnected computer systems. Any kind of computer system—or other apparatus adapted for carrying out the methods described herein—is suitable. A typical combination of hardware and software could be a general purpose computer system with a computer program that, when being loaded and executed, controls the computer system such that it carries out the methods described herein.

Each computer system may include, inter alia, one or more computers and at least a computer readable medium allowing a computer to read data, instructions, messages or message packets, and other computer readable information from the computer readable medium. The computer readable medium may include computer readable storage medium embodying non-volatile memory, such as read-only memory (ROM), flash memory, disk drive memory, CD-ROM, and other permanent storage. Additionally, a computer medium may include volatile storage such as RAM, buffers, cache memory, and network circuits. Furthermore, the computer readable medium may comprise computer readable information in a transitory state medium such as a network link and/or a network interface, including a wired network or a wireless network, that allow a computer to read such computer readable information.

Although specific embodiments of the subject matter have been disclosed, those having ordinary skill in the art will understand that changes can be made to the specific embodiments without departing from the spirit and scope of the disclosed subject matter. The scope of the disclosure is not to be restricted, therefore, to the specific embodiments, and it is intended that the appended claims cover any and all such applications, modifications, and embodiments within the scope of the present disclosure.