Source: http://www.google.com/patents/US6978127?dq=7,546,338
Timestamp: 2017-06-27 04:40:05
Document Index: 555932173

Matched Legal Cases: ['art 104', 'art 104', 'art 104', 'art 104', 'art 104', 'art 104', 'art 104', 'art 204', 'art 304', 'art 304', 'art 304', 'art 110', 'art 304']

Patent US6978127 - Hand-ear user interface for hand-held device - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign inPatentsA hand-held information processing device, such as a mobile phone, has a thumb wheel that lets the user scan a circular array of options. Each respective one of the options is represented by a respective audio output that gets played out when the wheel is turned a notch up or down. This enables the user...http://www.google.com/patents/US6978127?utm_source=gb-gplus-sharePatent US6978127 - Hand-ear user interface for hand-held deviceAdvanced Patent SearchTry the new Google Patents, with machine-classified Google Scholar results, and Japanese and South Korean patents.Publication numberUS6978127 B1Publication typeGrantApplication numberUS 09/464,855Publication dateDec 20, 2005Filing dateDec 16, 1999Priority dateDec 16, 1999Fee statusPaidAlso published asCN1199425C, CN1369168A, DE60033518D1, DE60033518T2, EP1181802A2, EP1181802B1, EP1755319A2, EP1755319A3, US7310513, US20060099908, WO2001044912A2, WO2001044912A3Publication number09464855, 464855, US 6978127 B1, US 6978127B1, US-B1-6978127, US6978127 B1, US6978127B1InventorsWillem Bulthuis, Yevgeniy Eugene Shteyn, Mieko Kusano, Robert Lambourne, Lisa HolzhauserOriginal AssigneeKoninklijke Philips Electronics N.V.Export CitationBiBTeX, EndNote, RefManPatent Citations (25), Non-Patent Citations (1), Referenced by (171), Classifications (28), Legal Events (4) External Links: USPTO, USPTO Assignment, EspacenetHand-ear user interface for hand-held device
US 6978127 B1Abstract
A hand-held information processing device, such as a mobile phone, has a thumb wheel that lets the user scan a circular array of options. Each respective one of the options is represented by a respective audio output that gets played out when the wheel is turned a notch up or down. This enables the user to select an option with one hand and without having to look at the device. It also allows for a form factor smaller than that of a conventional mobile phones since a keypad is not needed for entering digits to make a call from a personalized directory.
1. A jukebox device for the play-out of audio files comprising:
a navigating input for enabling the user to navigate in a set of audio files;
each audio file having an introductory portion;
a memory enabling the user to store audio information corresponding to each audio file;
a feedback output to provide at least a first type and second type of auditory feedback in response to the navigating input;
the first type of auditory feedback comprising a play out of the audio information corresponding to a current audio file of the set of audio files when the user is navigating at a first speed;
the second type of auditory feedback indicating a progression to a next current audio file of the set of audio files when the user is navigating at a second speed, which is relatively faster than the first speed; and
a validating input to enable the user to select the current audio file in response to the feedback output,
wherein the audio information comprises the introductory portion of the current audio file.
a mobile communication apparatus having a user-interface for enabling a user to interact with the device;
a navigating input for enabling the user to navigate in a set of options;
a memory enabling the user to store audio information corresponding to each option of the set of options;
a feedback output to provide a first type and a second type of auditory feedback information to the user in response to the navigating input;
the first type of auditory feedback comprising a play out of the audio information corresponding to a current option of the set of options, as indicated by the navigating input when the user is navigating at a first speed;
the second type of auditory feedback indicating only a progression to a next current option of the set of options, as indicated by the navigating input, when the user is navigating at a second, faster speed; and
a validating input to enable the user to select the current option based on the provided feedback information,
wherein the audio information comprises at least one recorded user-spoken word associated with a telephone extension.
a mobile communication apparatus having a user-interface;
a wireless email terminal for operating with an application server for text-to-speech conversion;
the second type of auditory feedback indicating a progression to a next current option of the set of options when the user is navigating at a second speed, which is relatively faster than the first speed; and
a validating input to enable the user to select the current option,
wherein the audio information comprises
at least one recorded user-spoken word associated with an email address.
4. A method of enabling a user to access telephone extensions with an information processing device, comprising:
enabling the user to navigate among a set of telephone extensions;
enabling the user to store audio information corresponding to each of the telephone extensions;
providing a first type of auditory feedback information about each telephone extension, the first type of auditory feedback comprising a play out of the audio information corresponding to the telephone extension when the user is navigating at a first speed;
providing a second type of auditory feedback information about each telephone extension user when the user is navigation at a second speed that is relatively faster than the first speed; and
enabling the user to validate a current one of the options,
wherein the audio information comprises at least one recorded user-spoken word associated with one of the telephone extensions. Description
The invention relates in particular to a user interface for information processing devices such as mobile phones, pagers and other mobile communication devices, palmtop computers and personal digital assistants (PDA's), remote controls, devices for playing out pre-recorded information content such as music, etc. The invention is specifically relevant to hand-held devices and to apparatus used in an environment wherein the user is constrained regarding paying attention to interacting with the apparatus or device.
When interacting with current hand-held devices, the user typically needs to watch the device's user-interface, e.g., for selecting options from a menu of the device. For example, a typical mobile phone, PDA or remote control device requires that the user watches the keypad or touch screen when entering the desired alphanumeric characters or selecting the proper sequence of keys or icons to choose a menu option. This is considered highly undesirable when, e.g, the user is driving a car or has to focus on something else or is operating in an environment with insufficient light. Also, a visually impaired user is barred from properly interacting with such apparatus.
The invention provides a hand-held device that enables selecting options from a menu using only one hand and without having to look at the device. To this end, the information processing device of the invention comprises a user-interface for enabling a user to interact with the device. The user-interface comprises a navigating input for enabling the user to navigate in set of options; a feedback output to provide respective auditory feedback to the user about a respective selectable one of the options while the user is navigating; and a validating input to enable the user to select the current option based on the feedback.
Preferably, a hand-held version of the information processing device in the invention, such as a mobile phone, has a thumb wheel or another step-through component that lets the user scan a linear or circular array of options. Each respective one of the options is represented by a respective audio output that gets played out when the wheel is turned a notch up or down. This enables the user to select an option with one hand and without having to look at the device. It also allows for a form factor smaller than that of a conventional mobile phones since a keypad is not needed for entering digits to make a call from a personalized directory.
Incorporated herein by reference are the following patent documents:
U.S. Ser. No. 09/427,821 filed Oct. 27, 1999 for Joost Kemink and Richard Sagar for PDA HAS WIRELESS MODEM FOR REMOTE CONTROL VIA THE INTERNET. This document relates to a PDA that is combined with a wireless modem to enable remote control of CE equipment via the Internet and a local home server.
U.S. Ser. No. 09/434,155 filed May 13, 1999 for Joost Kemink for INTERNET-BASED SERVICE FOR UPDATING A PROGRAMMABLE CONTROL DEVICE. This document relates to an Internet based service for updating a programmable control device. An Internet site contains links to appliance-dependent control and feature option information which can be downloaded to the programmable control as a graphic user interface (GUI). A user interface is provided at the site for the user to easily specify a target appliance, and thereafter selectively download the interface and control information that is available for the target appliance. The Internet site also contains links to other providers of configurations and macros, such as system integrators who provide interfaces based on an inventory of the user's controllable equipment, hobbyist who share configurations and macros that they've found useful, and so on.
U.S. Ser. No. 09/160,490 filed Sep. 25, 1998 for Adrian Turner, Simon Pearce, David Eves and Allan Timms for CUSTOMIZED UPGRADING OF INTERNET-ENABLED DEVICES BASED ON USER-PROFILE, and U.S. Ser. No. 09/189,535 filed Nov. 10, 1998 for Eugene Shteyn for UPGRADING OF SYNERGETIC ASPECTS OF HOME NETWORKS, both of which relate to a server system that maintains a user profile of a particular end-user of consumer electronics network-enabled equipment and a data base of new technical features for this type of equipment. If there is a match between the profile and a new technical feature, and the user has indicated he/she is willing to receive the information about updates or sales offers, the user gets notified via the network of the option to obtain the feature. Synergy is detected between pieces of equipment of the user in order to notify him/her of further possibilities of using or expanding his/her equipment.
FIG. 2 is a block diagram for a palmtop computer or PDA;
FIG. 3 is a block diagram for a device for playing back pre-recorded audio; and
FIG. 4 is a flow diagram illustrating the operations caused by user input via the UI of the devices of FIGS. 1–3.
FIG. 1 is a block diagram of a mobile phone 100 according to the invention. Phone 100 comprises a user-interface (UI) 102 for enabling a user to interact with phone 100 and a communications part 104 that performs the wireless communication functionalities of a telephone. Part 104 is well known and is not described in further detail here. UI 102 has a navigating input 106 for enabling the user to navigate in a set of options stored in a memory 108. The options include, e.g., numeric characters as on a ordinary telephone keypad, or names arranged in a personalized directory, and are discussed more specifically below. UI 102 has a feedback output 110 to provide auditory feedback when the user comes across an option while manipulating navigation input 106. UI 102 further has a validation input 112 to enable the user to validate an option upon the auditory feedback. Validating a specific option causes the specific option to be stored in a buffer 114. The contents of buffer serves as input data for communication part 104. Navigation input and validation input are coupled to a processor 116. Processor 116 receives input signals from inputs 106 and 112 via appropriate transducers (not shown). For an example of a rotary input device, see e.g., U.S. Pat. No. 5,703,661 incorporated herein by reference; many other embodiments are known in the art. Processor 116 supplies control signals to memory 108, to feedback output 110 and to buffer 114 based on the input signals.
In this example, input 106 has a thumb wheel or other rotatable component that the user can rotate back and forth, to scan the options in a linear fashion, a circular fashion or in a more sophisticated manner, discussed below, that combines a decision tree with linear or circular scanning. Validation input 112 comprises a single key in this example. In alternative embodiments, input 106 comprises, for example, a toggle switch that can be pressed in one way for scanning the options in one direction and pressed in another way for scanning in the other direction. Inputs 106 and 112 can also be combined in a single component. For example, the thumb wheel for input 106 can be can be mounted so that it slides into device 100 against the pressure of a spring element to enable the user to use the wheel as validation input as well.
The operation of phone 100 is as follows. The user turns on phone 100 to enter input information for making a call. Assume that UI 102 allows the user to select input information in at least one of a variety of ways.
In a first manner, the user selects a telephone number through its numeric characters as follows. When the user rotates wheel 106 processor 116 scans in a circular fashion the data in memory 108 that represents the characters “0”, “1”, . . . , “8” and “9” as selectable options. When the user rotates wheel 106 quickly, feedback output 110 supplies audible clicks when going from a current one to the next option. When the user rotates wheel 106 slowly, feedback output 110 supplies synthesized or pre-recorded voice output, also stored in memory 108, when going from a current one to the next option. For example, the user hears the word “eight” spoken when the wheel is turned one notch forward from its current position, signifying the data “7”, to the next. The “clicks” enable fast forward or fast backward, whereas the voice output identifies the currently available option. If the user has identified the desired number, he/she presses validation key 112. Processor 116 then stores the data associated with the validated option into buffer 114. Preferably, processor then also resets the starting point for the scan of the next number to, e.g., “0”. Preferably, once the user has entered all numbers making up the desired telephone number, the user presses validation key 112, e.g., twice in rapid succession. This causes the contents of buffer 114 to be repeated by feedback output 110. If the user validates the selected string through key 112 the data in buffer 114 is transferred to communication part 104 for the setting up the call for the telephone number thus selected. The user thus needs only one hand to operate the phone 100 and does not need to look at UI 102.
In a second manner, memory 108 stores audio files of names associated with data that represent the telephone numbers of the parties associated with the names. The names and the audio files have been entered by the user in advance. For example, phone 100 has an operational mode for making and receiving calls, and a programming mode for programming memory 108. In the programming mode of phone 100 UI 102 uses a microphone 118, preferably the one accommodated in communication part 104 of phone 100, to enter voice data for storage into memory 108 via processor 116. The voice data represent the names or other identifiers of the parties to which the user may want to make calls frequently from phone 100. For example, the voice data to be entered are “home”, “mom at home”, “mom's cellular”, “secretary”, “Kandinsky”, “Gigi”, “Caius”, “Svetlana” and “Philips patent department”. Phone 100 comprises a sampler (not shown) and an encoder (not shown) for creating data to be stored in memory 108 representative of an audio file. Phone 100 also comprises a decoder (not shown) for playing out the audio file via feedback output 110 upon retrieval from memory 108. Feedback output 110 preferably uses a loudspeaker 120 accommodated in communication part 104 of phone 100.
Assume that the user has put phone 100 in the programming mode. While holding key 112 the user speaks the word “home” into microphone 118. The analog signals gets sampled and coded and the coded data is stored as an audio file “home” in memory 108. Processor 116 now prepares memory 108 to store the telephone number associated with the party “home”. The user is prompted to enter the digits making up the telephone number into phone 100 via a keypad. The entered data are stored in buffer 114 and the number is displayed on a display 124. If the number is correct, the user validates the number via key 112 and the number is stored in memory 108 as associated with “home”. The user releases key 112 and presses it again to enter the expression “mom at home” in a similar manner. The programming mode now gives the user the option to rank the audio files in a specific order. The order is relevant for the navigating later on via wheel 106 as explained below. The user has now the option to assign a rank to “mom at home” higher or lower than the rank of “home” via rotating wheel 106 up or down. When the user rotates wheel 106 a notch in one direction or the other, an audio file already stored is played out via feedback output 110, in this case the file “home”. The user has, for example, some alphabetic order in mind and selects a lower rank for “mom at home”. Processor 116 controls the arrangement such that the file to be stored is arranged at a rank higher or lower than the rank of the file played out last and dependent on the direction of rotation of wheel 106. The user thus presses validation key 112 after the file “home” has been played out upon wheel 106 being turned one notch down. The next entry is “mom's cellular” that is to be arranged between “home” and “mom at home”. The user rotates wheel 106 down and the stored files are played out in sequence. After the file “home” is played out the user presses key 112 and the audio file “mom's cellular gets stored with a rank lower than “home” and higher than “mom at home”. Eventually, memory 108 stores the audio files and associated telephone numbers in a particular order determined by the user. Now, when the user has exited the programming mode and entered the operational mode for selecting by nickname, he/she rotates wheel 106 up or down fast to hear audible clicks for each of the selectable options (nicknames) he/she passes in a circular fashion. When the user rotates wheel 106 slowly, one audio file gets played out per notch of the wheel in the order according to the rank assigned from low to high or from high to low depending on the direction of rotation of wheel 106. In this manner, the user can select the desired party to which he/she wants to make a call. If the user has found the desired nickname, he/she presses key 112 that causes controller 116 to transfer the data representing the digits if the associated telephone number directly from memory 108 to communications part 104 to initiate the dialing procedure. Buffering in buffer 114 for checking is then not needed.
A variant of this method is that the numbers are re-ranked dynamically depending on frequency of usage. After activating the operation mode for making a call, the user gets the most frequently used audio files upon turning the wheel per notch down in decreasing or increasing order depending on the direction of rotation. This shortens the selection procedure. The re-ranking is implemented, e.g., in software. For example, a first software module logs the selections made over a certain period of time; a second software module computes the number of selections per menu option; a third module arranges the options according to the number of selections; and a fourth software module creates a dynamic look-up table to link the input via wheel 106 to the re-ranked options.
Another variant is that the numerical-digit based navigation and the nickname-based navigation form branches in a single selection tree. For example, in the initial set of options the digits “0” to “9” are concatenated with a sign “nicknames” so that the user can select in a circular manner among the telephone number by its digits or by its nickname. If the user validates a chosen digit, the procedure proceeds as discussed with the first manner. If the user validates “nicknames”, the procedure switches to the second manner.
Yet another variant is that the numeric-digit-based navigation is combined with frequently used action-based navigation. For example, in the initial set of options the digits “0” to “9” are concatenated with, e.g., a “Delete Previous” option and a “Delete All” option. This type of navigation is very efficient when performed in a linear click-through manner, preferably combined with a physical limit to the rotation of wheel 106 in each direction. In order to reach the desired action, the user can fast-forward the selector towards the end or to the beginning of the range. After the physical limit has been reached, the user selects the desired option with higher precision.
Note that the keypad of a conventional mobile telephone determines the phone's form factor to a large extent. That is, the space required to accommodate a keypad is relatively large. A navigation and validation procedure of the invention enables the phone to have smaller dimensions and allows it to have shapes different from conventional mobile phones. Within this context, also see U.S. Ser. No. 09/062,364 filed Apr. 17, 1998 for Sung Choi and Jan van Ee for GRAPHICAL USER INTERFACE TOUCH SCREEN WITH AUTO ZOOM FEATURE, herein incorporated by reference. Keypad 122 could be made a module that is optionally attachable to, and detachable from, the other components of the phone 100. The sampler and encoder to enable storage of an audio file could likewise be made a detachable module to be used while programming or reprogramming memory 108.
FIG. 2 is a block diagram of a notebook computer or PDA 200 in the invention. PDA 200 has several software-controlled functionalities. For example, PDA 200 has a component 202 that enables a user to send and receive emails. In the PDA of the invention, the user is allowed to receive and send emails with audio file attachments. The audio file comprises content information that the user wishes to send to an addressee or receive from an sender via the Internet. The audio file may be an alternative or a supplement to a text body or text attachment as in plain emails. The audio file comprises recorded speech input from the user or from a sender, the information content being properly coded and compressed. PDA comprises a communications part 204 that has a wireless modem 206 for communication with the Internet. Modem 204 is, for example, a Minstrel or a Ricochet. The Minstrel marketed by Novatel Wireless is a two-way wireless modem for a PDA that lets the user browse the Web and receive email, among other things. In a more general sense, a wireless modem like the Minstrel or Ricochet provides handheld device 200 with an IP address that can be used by any type of application that uses the Internet for communication (within limitations of throughput, latency and coverage). The Minstrel uses a technology referred to as Cellular Digital Packet Data (CDPD) that is supported by the cellular service providers. Web surfing is limited to a CDPD speed cap of 19.2-kbps. The Ricochet from Metricom has a faster connect rate, in the 28.8 K-bps range, but it is supported in only three metropolitan centers (the San Francisco Bay area, Seattle and Washington). PDA 200 has a conversion table tying “nickname” to “email address”, similar in configuration as the one for “nicknames” to “telephone number” of mobile phone 100, stored in memory 108 and discussed above under FIG. 1. The conversion table may be user-programmed or pre-defined, e.g., by a the user's company system administrator. To send an email, the user navigates through the “nicknames” rotating wheel 106. Upon validating the choice, the email header is created by the PDA through inserting the email address corresponding to the recorded nickname selected. Prior to creating the header, or after this, the user speaks into the microphone to create the content information to be sent. The speech gets sampled and coded via sampler 208 and the coded data is attached to the email. Audio sampler and coders are known in the art and are not discussed in further detail. Attaching or including audio files into emails is known in the art and is not discussed further. Upon successful completion, the user causes the email to be send, e.g., by pressing a key (not shown). Preferably, the email creation program in, e.g., controller 116 allows prompt sounds to be supplied in order to prompt the user to speak his name and/or to cite the subject of the email into microphone 118. The data created from these inputs is stored in certain fields of the email, so that the receiving party can browse through the list of senders and/or subjects by listening to the sender field and subject data field when rendered as audio. Similar functionalities are known for emails that are rendered in a text format; these need not be discussed in further detail here. Note that speech recognition software is not required on PDA 200 or on a server (not shown) as the communication is contained within the audio files whose content is to be interpreted by the user upon rendering.
As with phone 100, PDA 200 preferably has a branched menu to be navigated using wheel 106 and validation button 112. For example, the user has organized the “nickname” file according to categories “home”, “office”, “friends”, and others. In the navigation mode, PDA 200 returns to the user the spoken names of the categories entered by the user in the programming mode. Upon validating a category during navigation, rotating of wheel 106 lets the PDA give the spoken names of the parties listed under the validated category and in the order programmed. Any level of nesting is feasible to implement this tree-like search strategy.
Note that an implementation of the invention in a network-based architecture can use an Internet service wherein the audio files and nicknames, and/or telephone number and nicknames are stored at the server for user-access, and wherein the access is via an Internet connection. The client need not be a portable device but can instead be a stationary apparatus such as a desktop PC or a desk-op telephone. A hand-held self-contained device, however, is especially interesting because of the ergonomics involved as specified above.
FIG. 3 is a block diagram of a device 300 for playing out pre-recorded audio content. Device 300 comprises a hand-held jukebox wherein the user can store music files in a memory 302 that has, e.g., a recordable or re-writeable optical disk, a large semiconductor memory or a hard disk drive with a small form factor to minimize the effects of mechanical shocks. Play-out of the stored audio is achieved in, e.g., a conventional manner through play-out part 304. Play-out part 304 has a processing board 306 for rendering the stored audio, a loudspeaker 308 and, preferably, editing/programming functionalities (not shown), known in the art, in order to enable labeling the programmed tracks for visual feedback via a GUI (not shown). Note that the GUI is preferred for the setting up of the device's library, but is not necessary during operational use of device 300. A GUT module could therefore be made detachable.
For jukebox technology see, for example, U.S. Ser. No. 09/326,506 filed Jun. 4, 1999 for Pieter van der Meulen for VIRTUAL JUKEBOX, herein incorporated by reference. This document relates to a collection management system, or virtual jukebox, provided for a collection of recordings that is independent of the physical media upon which the material is recorded.
The system forms a part of a network that includes storage media and playback devices, and provides an easy to use system for collection cataloging, archiving, and retrieval. In a preferred embodiment, a collection management system resides on a consumer electronic (CE) device, or a personal or home computer (PC), and the collection includes recordings that are stored on one or more hard drives associated with the CE device or the PC. The collection management system includes a user interface that facilitates the retrieval of recordings for playback from one or more storage devices, based on an individual selection of genre, author, and so on. By storing the recordings on a hard disc drive or other mass storage device with an associated disk operating system, immediate access is available to each recording on the drive, and additional drives can be added to the system as new material is added to the collection.
Assume that the user has stored multiple audio tracks in memory 302 and that memory 302 is accommodated in play-out part 304. Play-out processing board 306 has an intro play-out mode to play out only the first portion of each track stored. Such an intro mode is known from, e.g., the “CD player” software application, version 4.0 from Microsoft. The introductory portions or parts thereof are stored in memory 108 of UI 102 together with a label identifying the tracks from which the parts were taken. Upon rotating wheel 106 slowly, the introductory portions or parts of the tracks as stored in memory 108 are being played out via feedback part 110 and loudspeaker 120 as an auditory feedback upon navigating among the tracks. While thus navigating, the label associated with the intro being played out is stored into buffer 114. When the user validates his/her choice through key 112 the label gets fed back to play-out part 304 for playing out the whole track thus selected. When wheel 106 is being rotated rapidly, the user hears audible clicks to confirm progress along a linear or circular menu of selectable tracks or file folders.
Alternatively, when wheel 106 is rotated slowly, the relevant one of the complete audio files gets played out until wheel 106 arrives at the next notch, whereupon the play-out of the next file starts. In this embodiment, an instantaneous play-out is achieved while navigating among the options.
Alternatively or supplementarily, device 300 can be made a component in a system capable of downloading content from the Web, e.g., via a PC that serves as the master to device 300 being the slave functioning as a repository for the audio files. A combination of devices 300 and 200 is possible as a stand-alone functionality, when it is capable of accessing certain web sites that provide speech feedback for enabling the user to make the selections for the downloading, e.g., using wheel 106 and validation key 112. In a programming or downloading mode, these user inputs then function as parts of a browser to navigate in a list of audio files, similarly to the control keys of a keyboard or of a mouse when browsing the web via graphical representations rendered on a display. The web server addressed preferably provides the information in auditorily browseable pages.
Note that the some of above functionalities of phone 100, PDA 200 and music device 300 can also be implemented using a network-based system. For example, phone 100 is capable of contacting a server on the Internet. Instead of storing the names, digits or email addresses and the audio files for the auditory feedback while navigating, on the phone or PDA itself as in FIGS. 1 and 2, they are now stored at the server. The server is now an extension of the hand-held device itself with practically unlimited storage capacity for address lists and their compressed nickname audio files. The phone or PDA navigates through the options listed on the server by rotating the wheel and validating an end selection of a selection of a branch in a tree-like menu. The validated end-result is then used to enable the local functionalities of the device.
Another variant of an integrated network-based embodiment of the invention is a voice-mail system. The system enables the (mobile) user to retrieve and navigate among voice mails stored at a server. For example, when the user uses phone 100 to dial the voice-mail system number, a set of selectable items or options is activated associated with the voice-message access system. Assume that a caller-ID feature and a password have given the user access to his/her mailbox on the server. The password is entered, for example, by the user speaking an expression chosen in advance. An application on the server then determines if the expression spoken and, preferably, the signature of the user's voice in terms such as the frequency spectrum match a template stored for this user. Once the user has received access to the mailbox the user gets confirmation from the server, e.g., through a pre-recorded voice: “This is the mailbox of <username registered>. The system now makes available a list of options that contain “Next”, “Previous”, “Save”, “Delete”. Each option is mapped in phone 100 to a pulse sequence representative of a combination of alphanumeric characters as in a menu of a conventional voice mail service. The pulse sequence gets sent to the server upon pressing validation key 112. When received at the server side, the pulse sequence causes activation of the selected option. Preferably, the auditory feedback contains the name of the sender and an indication of the subject of the message. When the user confirms the selection of the message the full text gets played out. The mapping of the selection options can be manually programmed by the user, or, alternatively, via a specialized configuration tool or provided by the service provider as a service to set up the configuration of phone 100. Within this context see, e.g., U.S. Ser. No. 09/311,128 filed May 13, 1999 for Joost Kemink for INTERNET-BASED SERVICE FOR UPDATING A PROGRAMMABLE CONTROL DEVICE, incorporated herein by reference. This document relates to an Internet-based service for updating a programmable control device. An Internet site contains links to appliance-dependent control and feature option information which can be downloaded to the programmable control as a graphic user interface (GUI). A user interface is provided at the site for the user to easily specify a target appliance, and thereafter selectively download the interface and control information that is available for the target appliance.
As another example of the invention consider a universal programmable remote control device. The device has hard keys for a set of alphanumeric characters, e.g., “0” to “9”, a set of apparatus selection keys, e.g., “TV”, “VCR”, etc., and a set of action keys such as: “Channel up/down”, “Volume up/down”, “Play”, “Forward”, “Select”, etc., and UI with a wheel 106 and validation key 112, as discussed above with reference to FIGS. 1–3. The set of apparatus selection keys is limited to a rather small number of frequently used consumer appliances. The alphanumeric keys and the action keys give the user access to a greater number of apparatus and macro's than the set of apparatus selection keys allows, such as “DVD-player”, “Bedroom macro's”, “Time-warp recording” (as on a TiVo box), etc. Now, keys for additional apparatus can be programmed among which can be navigated through wheel 106, and from which a selection can be made through key 112. The associated auditory feedback can be programmed by recording the user's voice or by downloading a small audio file from the Web or via the user's PC for auditory rendering. When the user rotates wheel 106 slowly, the audio files get played out and validating a selection via key 112 enables the user to navigate a set of commands associated with the additional apparatus or set of macro's. The remote device has also a mapping of the keys to the various commands that enable the user to control the additional apparatus via, e.g., IR or via a control application on a PC or set top box that intermediates between the remote and the additional apparatus. Control codes for the additional apparatus can be stored in the remote as a default provision, or downloaded from the Web or from another apparatus or device. Configuring the remote can be done via, e.g., a configuration software application.
FIG. 4 is a flow diagram 400 illustrating the invention. In a step 402 the user input is received via wheel 106. In a step 404 the current position of the wheel is determined and in a step 406 the position is mapped on a selectable option. In a step 408 the option is temporarily selected in order to provide auditory feedback to the user in a step 410. If the user validates the option in a step 412 through key 112 the option gets processed in a step 414. If the option is not validated and the user rotates wheel 106 one notch further the process returns to step 402.
The invention has been described above in particular within the context of hand-held devices to illustrate the specific ergonomic advantages. It will be appreciated that the invention also has particular advantages with apparatus other than hand-helds. For example, the user-interface could be used on ATM or vending machines; in automotive applications where the navigating and validating input are accommodated in the steering wheel to operate, e.g., a car navigation system; on industrial machinery, etc. The invention is beneficial to the user operating under critical conditions, in terms of safety, because of its allowing to select menu options based on auditory feedback.
The thumb wheel and toggle switch have been mentioned above as special examples. Other user-controllable input components are feasible depending on the specific application. For example, the switch or wheel permits scrolling basically in two directions (up; down). A thumb- or hand-operated joystick or trackball allows scrolling in more than two directions, e.g., as in the four or eight main directions of a compass. A multidimensional option space e.g., two-dimensional with joystick is convenient for video games, e.g. for selecting weapons and firepower (it happens that this kind of video game is popular).
Optionally, speaker 120 can be a wired or wireless earpiece. Using the earpiece enables use in a noisy environment or when the environment should not be disturbed by the auditory feedback.
As mentioned above keypad is not required to be an integral part of the device according to the invention. For similar or other reasons, the device of this invention also does not need the display to be an integral part, even further reducing size and possibly costs: just a tiny speaker and a few buttons is sufficient. Accordingly, the invention thus forms not only the basis for the smallest cell phone, but also for the smallest wireless email terminal (earphone and remote control/transmitter piece): neither keyboard nor display is required with text-to-speech conversion on a server.
Another advantage of the invention is that all options can be softcoded, and can be changed over time as illustrated by above examples. Owing to the softcoding, the menu or its options can be added/removed or changed dynamically, e.g., depending on the application, environment, status and/or when new options get downloaded from a server via a network. For example, a multi-functional device uses as a first level of the menu a set of software applications, each of which is indicated to the user by a specific auditory feedback when he/she is scrolling through the list. For example, the user hears synthesized or pre-recorded speech as follows: “email”; “telephone”, “pager”, “music”, etc., when scrolling through a main-level list. Upon selecting an application through the validation input, e.g., “email”, the next level provides a menu of options relevant within the context of the application selected whose identities get auditorily rendered when the user is navigating among these options. The user can then navigate among the corresponding options (see the examples above) again using auditory feedback. Several menus can be accommodated in such a nested hierarchy.
Patent CitationsCited PatentFiling datePublication dateApplicantTitleUS4731811 *Oct 2, 1985Mar 15, 1988Regie Nationale Des Usines RenaultRadiotelephone system, particularly for motor vehiclesUS5095503 *Jul 26, 1990Mar 10, 1992Motorola, Inc.Cellular telephone controller with synthesized voice feedback for directory number confirmation and call statusUS5436954 *Sep 7, 1993Jul 25, 1995Hitachi, Ltd.Foldable radio telephone set with rotary selector integral with foldable hinge elementUS5444768 *Dec 31, 1991Aug 22, 1995International Business Machines CorporationPortable computer device for audible processing of remotely stored messagesUS5481595 *Mar 8, 1994Jan 2, 1996Uniden America Corp.Voice tag in a telephone auto-dialerUS5495566 *Nov 22, 1994Feb 27, 1996Microsoft CorporationScrolling contents of a windowUS5500919 *Nov 18, 1992Mar 19, 1996Canon Information Systems, Inc.Graphics user interface for controlling text-to-speech conversionUS5748104 *Jul 11, 1996May 5, 1998Qualcomm IncorporatedWireless remote telemetry systemUS5758295 *Jan 3, 1997May 26, 1998Telefonaktiebolget Lm EricssonUniform man-machine interface for cellular mobile telephonesUS5774540 *Nov 15, 1995Jun 30, 1998Lucent Technologies Inc.Hierarchical menu screen interface for displaying and accessing telephone terminal featuresUS5812870 *Nov 22, 1996Sep 22, 1998Eloner I.P. Holdings Ltd.Personal organizer with interface for recording digital voice filesUS5901222 *Oct 31, 1996May 4, 1999Lucent Technologies Inc.User interface for portable telecommunication devicesUS5909183 *Dec 26, 1996Jun 1, 1999Motorola, Inc.Interactive appliance remote controller, system and methodUS5950123 *Aug 26, 1996Sep 7, 1999Telefonaktiebolaget L MCellular telephone network support of audible information delivery to visually impaired subscribersUS5978689 *Aug 29, 1997Nov 2, 1999Tuoriniemi; Veijo M.Personal portable communication and audio systemUS6097964 *Sep 4, 1997Aug 1, 2000Nokia Mobile Phones LimitedNavigation key for a handsetUS6128012 *Apr 3, 1997Oct 3, 2000Microsoft CorporationUser interface for a portable data management device with limited size and processing capabilityUS6161008 *Nov 23, 1998Dec 12, 2000Nortel Networks LimitedPersonal mobility and communication termination for users operating in a plurality of heterogeneous networksUS6178338 *Apr 28, 1997Jan 23, 2001Sony CorporationCommunication terminal apparatus and method for selecting options using a dial shuttleUS6192253 *Oct 6, 1999Feb 20, 2001Motorola, Inc.Wrist-carried radiotelephoneUS6205427 *Jul 13, 1998Mar 20, 2001International Business Machines CorporationVoice output apparatus and a method thereofUS6246983 *Aug 5, 1998Jun 12, 2001Matsushita Electric Corporation Of AmericaText-to-speech e-mail reader with multi-modal reply processorDE4008598A1Mar 17, 1990Sep 19, 1991Philips PatentverwaltungKey interface for mobile radio equipment - uses only two keys and time interval measurements in conjunction with speech circuitryEP0905951A1Mar 18, 1997Mar 31, 1999Mitsubishi Denki Kabushiki KaishaMobile telephoneFR2769781A1 Title not available* Cited by examinerNon-Patent CitationsReference1 *199901511852, Jan. 1999, Ericsson.* Cited by examinerReferenced byCiting PatentFiling datePublication dateApplicantTitleUS7166791 *Oct 28, 2002Jan 23, 2007Apple Computer, Inc.Graphical user interface and methods of use thereof in a multimedia playerUS7254708 *Mar 5, 2002Aug 7, 2007Intel CorporationApparatus and method for wireless device set-up and authentication using audio authentication—informationUS7336602Jan 29, 2002Feb 26, 2008Intel CorporationApparatus and method for wireless/wired communications interfaceUS7392070 *Jan 3, 2005Jun 24, 2008Lite-On Technology CorporationInputting apparatus for mobile phone with a dial wheelUS7521625Dec 7, 2006Apr 21, 2009Apple Inc.Graphical user interface and methods of use thereof in a multimedia playerUS7560637Sep 28, 2005Jul 14, 2009Apple Inc.Graphical user interface and methods of use thereof in a multimedia playerUS7657910 *Mar 3, 2000Feb 2, 2010E-Cast Inc.Distributed electronic entertainment method and apparatusUS7667124Nov 29, 2006Feb 23, 2010Apple Inc.Graphical user interface and methods of use thereof in a multimedia playerUS7671837Feb 14, 2006Mar 2, 2010Apple Inc.Scrolling input arrangements using capacitive sensors on a flexible membraneUS7680849Oct 25, 2004Mar 16, 2010Apple Inc.Multiple media type synchronization between host computer and media deviceUS7710393Dec 13, 2006May 4, 2010Apple Inc.Method and apparatus for accelerated scrollingUS7710394Dec 13, 2006May 4, 2010Apple Inc.Method and apparatus for use of rotational user inputsUS7710409Dec 13, 2006May 4, 2010Apple Inc.Method and apparatus for use of rotational user inputsUS7757173 *Jul 18, 2003Jul 13, 2010Apple Inc.Voice menu systemUS7765326Oct 21, 2002Jul 27, 2010Apple Inc.Intelligent interaction between media player and host computerUS7769903Jun 1, 2007Aug 3, 2010Apple Inc.Intelligent interaction between media player and host computerUS7778595Jan 16, 2008Aug 17, 2010Affinity Labs Of Texas, LlcMethod for managing mediaUS7795553Sep 11, 2006Sep 14, 2010Apple Inc.Hybrid buttonUS7797446Jul 16, 2002Sep 14, 2010Apple Inc.Method and system for updating playlistsUS7827259Apr 27, 2004Nov 2, 2010Apple Inc.Method and system for configurable automatic media selectionUS7856251 *Apr 26, 2004Dec 21, 2010Samsung Electronics Co., Ltd.Device and method for using a rotating key and controlling a display in a mobile terminalUS7860830Apr 25, 2005Dec 28, 2010Apple Inc.Publishing, browsing and purchasing of groups of media itemsUS7865219 *Sep 29, 2003Jan 4, 2011Kyocera CorporationPortable terminalUS7880729Aug 4, 2006Feb 1, 2011Apple Inc.Center button isolation ringUS7910843Sep 4, 2008Mar 22, 2011Apple Inc.Compact input deviceUS7932897Aug 15, 2005Apr 26, 2011Apple Inc.Method of increasing the spatial resolution of touch sensitive devicesUS7953390Jun 30, 2009May 31, 2011Affinity Labs Of Texas, LlcMethod for content deliveryUS7956272Dec 5, 2005Jun 7, 2011Apple Inc.Management of files in a personal communication deviceUS7958441Apr 1, 2005Jun 7, 2011Apple Inc.Media management for groups of media itemsUS7970379Jun 30, 2009Jun 28, 2011Affinity Labs Of Texas, LlcProviding broadcast contentUS8022935Jul 6, 2006Sep 20, 2011Apple Inc.Capacitance sensing electrode with integrated I/O mechanismUS8044314Jul 27, 2010Oct 25, 2011Apple Inc.Hybrid buttonUS8046369Sep 4, 2007Oct 25, 2011Apple Inc.Media asset rating systemUS8059099Sep 11, 2006Nov 15, 2011Apple Inc.Techniques for interactive input to portable electronic devicesUS8086222 *Mar 30, 2007Dec 27, 2011Dot Assets No. 14 LlcVoicemail short message service method and means and a subscriber terminalUS8099482Oct 1, 2004Jan 17, 2012E-Cast Inc.Prioritized content download for an entertainment deviceUS8103793Oct 20, 2009Jan 24, 2012Apple Inc.Method and system for updating playlistsUS8125461Sep 5, 2008Feb 28, 2012Apple Inc.Dynamic input graphic displayUS8150937Nov 12, 2004Apr 3, 2012Apple Inc.Wireless synchronization between media player and host deviceUS8188357May 12, 2009May 29, 2012Apple Inc.Graphical user interface and methods of use thereof in a multimedia playerUS8261246Sep 7, 2004Sep 4, 2012Apple Inc.Method and system for dynamically populating groups in a developer environmentUS8264460Aug 30, 2010Sep 11, 2012Sap AgMethod and system for secure password/pin input via mouse scroll wheelUS8274479Jun 18, 2007Sep 25, 2012Apple Inc.Gimballed scroll wheelUS8295820 *Jul 15, 2009Oct 23, 2012Oter GottfriedAdvanced internet-based caller ID information/data for mobile phones and mobile networksUS8330061Mar 18, 2011Dec 11, 2012Apple Inc.Compact input deviceUS8359007Mar 21, 2011Jan 22, 2013Affinity Labs Of Texas, LlcSystem and method for communicating media centerUS8381107 *Jan 13, 2010Feb 19, 2013Apple Inc.Adaptive audio feedback system and methodUS8395590Jun 1, 2009Mar 12, 2013Apple Inc.Integrated contact switch and touch sensor elementsUS8406746Nov 16, 2011Mar 26, 2013Dot Assets No. 14 LlcServer and subscriber terminal for voicemail transmissions via packet switched data communicationUS8416198Sep 5, 2008Apr 9, 2013Apple Inc.Multi-dimensional scroll wheelUS8443038Jul 1, 2011May 14, 2013Apple Inc.Network media deviceUS8446370Jul 30, 2007May 21, 2013Apple Inc.Touch pad for handheld deviceUS8453057 *Dec 22, 2008May 28, 2013Verizon Patent And Licensing Inc.Stage interaction for mobile deviceUS8482530Aug 21, 2007Jul 9, 2013Apple Inc.Method of capacitively sensing finger positionUS8495246Jan 24, 2012Jul 23, 2013Apple Inc.Method and system for updating playlistsUS8514185Aug 1, 2007Aug 20, 2013Apple Inc.Mutual capacitance touch sensing deviceUS8516395 *Mar 30, 2010Aug 20, 2013Cisco Technology, Inc.One-dimensional representation of a two-dimensional data structureUS8519964Jan 4, 2008Aug 27, 2013Apple Inc.Portable multifunction device, method, and graphical user interface supporting user navigations of graphical objects on a touch screen displayUS8519972May 10, 2011Aug 27, 2013Apple Inc.Web-clip widgets on a portable multifunction deviceUS8521140May 27, 2011Aug 27, 2013Affinity Labs Of Texas, LlcSystem and method for communicating media contentUS8532641Nov 9, 2012Sep 10, 2013Affinity Labs Of Texas, LlcSystem and method for managing mediaUS8537132Apr 23, 2012Sep 17, 2013Apple Inc.Illuminated touchpadUS8542817 *Jul 18, 2006Sep 24, 2013At&T Intellectual Property I, L.P.Speaker volume control for voice communication deviceUS8552990Aug 1, 2007Oct 8, 2013Apple Inc.Touch pad for handheld deviceUS8554191Oct 23, 2012Oct 8, 2013Affinity Labs Of Texas, LlcSystem and method for managing mediaUS8558808May 10, 2011Oct 15, 2013Apple Inc.Web-clip widgets on a portable multifunction deviceUS8564544Sep 5, 2007Oct 22, 2013Apple Inc.Touch screen device, method, and graphical user interface for customizing display of content category iconsUS8584031Nov 19, 2008Nov 12, 2013Apple Inc.Portable touch screen device, method, and graphical user interface for using emoji charactersUS8611863Jun 16, 2011Dec 17, 2013Dot Assets No. 14 LlcInstant video and voicemail messaging method and meansUS8619038Sep 4, 2007Dec 31, 2013Apple Inc.Editing interfaceUS8626952Jul 2, 2010Jan 7, 2014Apple Inc.Intelligent interaction between media player and host computerUS8631088Feb 26, 2007Jan 14, 2014Apple Inc.Prioritized data synchronization with host deviceUS8683009Mar 29, 2012Mar 25, 2014Apple Inc.Wireless synchronization between media player and host deviceUS8683378Jan 9, 2008Mar 25, 2014Apple Inc.Scrolling techniques for user interfacesUS8688085Apr 1, 2013Apr 1, 2014Affinity Labs Of Texas, LlcSystem and method to communicate targeted informationUS8743060Jul 6, 2009Jun 3, 2014Apple Inc.Mutual capacitance touch sensing deviceUS8749493Jul 30, 2007Jun 10, 2014Apple Inc.Movable touch pad with added functionalityUS8788954Jan 6, 2008Jul 22, 2014Apple Inc.Web-clip widgets on a portable multifunction deviceUS8816967Sep 25, 2008Aug 26, 2014Apple Inc.Capacitive sensor having electrodes arranged on the substrate and the flex circuitUS8820133Sep 30, 2008Sep 2, 2014Apple Inc.Co-extruded materials and methodsUS8850140Feb 26, 2007Sep 30, 2014Apple Inc.Data backup for mobile deviceUS8866780Apr 8, 2013Oct 21, 2014Apple Inc.Multi-dimensional scroll wheelUS8872771Jul 7, 2009Oct 28, 2014Apple Inc.Touch sensing device having conductive nodesUS8892446Dec 21, 2012Nov 18, 2014Apple Inc.Service orchestration for intelligent automated assistantUS8892465Jun 11, 2014Nov 18, 2014Skky IncorporatedMedia delivery platformUS8898568Sep 9, 2008Nov 25, 2014Apple Inc.Audio user interfaceUS8903716Dec 21, 2012Dec 2, 2014Apple Inc.Personalized vocabulary for digital assistantUS8908567Mar 31, 2014Dec 9, 2014Skky IncorporatedMedia delivery platformUS8930191Mar 4, 2013Jan 6, 2015Apple Inc.Paraphrasing of user requests and results by automated digital assistantUS8933890Aug 1, 2007Jan 13, 2015Apple Inc.Techniques for interactive input to portable electronic devicesUS8942986Dec 21, 2012Jan 27, 2015Apple Inc.Determining user intent based on ontologies of domainsUS8949745 *Apr 18, 2012Feb 3, 2015Konntech Inc.Device and method for selection of options by motion gesturesUS8952886Dec 19, 2007Feb 10, 2015Apple Inc.Method and apparatus for accelerated scrollingUS8972289Oct 18, 2013Mar 3, 2015Skky IncorporatedMedia delivery platformUS9009626Dec 19, 2007Apr 14, 2015Apple Inc.Method and apparatus for accelerated scrollingUS9037502Feb 4, 2009May 19, 2015Skky IncorporatedMedia delivery platformUS9094802Jan 30, 2014Jul 28, 2015Affinity Labs Of Texas, LlcSystem and method to communicate targeted informationUS9117447Dec 21, 2012Aug 25, 2015Apple Inc.Using event alert text as input to an automated assistantUS9118693Mar 31, 2014Aug 25, 2015Skky IncorporatedMedia delivery platformUS9124717Mar 31, 2014Sep 1, 2015Skky IncorporatedMedia delivery platformUS9124718Mar 31, 2014Sep 1, 2015Skky IncorporatedMedia delivery platformUS9190062Mar 4, 2014Nov 17, 2015Apple Inc.User profiling for voice input processingUS9203870Mar 31, 2014Dec 1, 2015Skky IncorporatedMedia delivery platformUS9203956Mar 31, 2014Dec 1, 2015Skky IncorporatedMedia delivery platformUS9215310Mar 31, 2014Dec 15, 2015Skky IncorporatedMedia delivery platformUS9219810Oct 18, 2013Dec 22, 2015Skky IncorporatedMedia delivery platformUS9262612Mar 21, 2011Feb 16, 2016Apple Inc.Device access using voice authenticationUS9299329Dec 7, 2006Mar 29, 2016Apple Inc.Graphical user interface and methods of use thereof in a multimedia playerUS9300784Jun 13, 2014Mar 29, 2016Apple Inc.System and method for emergency calls initiated by voice commandUS9311043 *Feb 15, 2013Apr 12, 2016Apple Inc.Adaptive audio feedback system and methodUS9318108Jan 10, 2011Apr 19, 2016Apple Inc.Intelligent automated assistantUS9319516Sep 30, 2014Apr 19, 2016Skky, LlcMedia delivery platformUS9330720Apr 2, 2008May 3, 2016Apple Inc.Methods and apparatus for altering audio output signalsUS9335924Oct 17, 2013May 10, 2016Apple Inc.Touch screen device, method, and graphical user interface for customizing display of content category iconsUS9338493Sep 26, 2014May 10, 2016Apple Inc.Intelligent automated assistant for TV user interactionsUS9354751Sep 16, 2009May 31, 2016Apple Inc.Input device with optimized capacitive sensingUS9360967Jul 6, 2006Jun 7, 2016Apple Inc.Mutual capacitance touch sensing deviceUS9367151Jan 28, 2014Jun 14, 2016Apple Inc.Touch pad with symbols based on modeUS9367232Aug 27, 2013Jun 14, 2016Apple Inc.Portable multifunction device, method, and graphical user interface supporting user navigations of graphical objects on a touch screen displayUS9368114Mar 6, 2014Jun 14, 2016Apple Inc.Context-sensitive handling of interruptionsUS9405421Apr 3, 2015Aug 2, 2016Apple Inc.Mutual capacitance touch sensing deviceUS9405766Jan 13, 2014Aug 2, 2016Apple Inc.Prioritized data synchronization with host deviceUS9412417Apr 1, 2005Aug 9, 2016Apple Inc.Persistent group of media items for a media deviceUS9430463Sep 30, 2014Aug 30, 2016Apple Inc.Exemplar-based natural language processingUS9444868Jun 23, 2015Sep 13, 2016Affinity Labs Of Texas, LlcSystem to communicate mediaUS9448683Apr 24, 2013Sep 20, 2016Apple Inc.Network media deviceUS9454256Sep 5, 2008Sep 27, 2016Apple Inc.Sensor configurations of an input device that are switchable based on modeUS9483461Mar 6, 2012Nov 1, 2016Apple Inc.Handling speech synthesis of content for multiple languagesUS9495129Mar 12, 2013Nov 15, 2016Apple Inc.Device, method, and user interface for voice-activated navigation and browsing of a documentUS9502031Sep 23, 2014Nov 22, 2016Apple Inc.Method for supporting dynamic grammars in WFST-based ASRUS9535906Jun 17, 2015Jan 3, 2017Apple Inc.Mobile device having human language translation capability with positional feedbackUS9548050Jun 9, 2012Jan 17, 2017Apple Inc.Intelligent automated assistantUS9576574Sep 9, 2013Feb 21, 2017Apple Inc.Context-sensitive handling of interruptions by intelligent digital assistantUS9582608Jun 6, 2014Feb 28, 2017Apple Inc.Unified ranking with entropy-weighted information for phrase-based semantic auto-completionUS9591118 *Jan 1, 2009Mar 7, 2017Intel CorporationPose to device mappingUS9619143 *Sep 30, 2008Apr 11, 2017Apple Inc.Device, method, and graphical user interface for viewing application launch iconsUS9620104Jun 6, 2014Apr 11, 2017Apple Inc.System and method for user-specified pronunciation of words for speech synthesis and recognitionUS9620105Sep 29, 2014Apr 11, 2017Apple Inc.Analyzing audio input for efficient speech and music recognitionUS9621615Aug 30, 2016Apr 11, 2017Affinity Labs Of Texas, LlcSystem to communicate mediaUS9626955Apr 4, 2016Apr 18, 2017Apple Inc.Intelligent text-to-speech conversionUS9633004Sep 29, 2014Apr 25, 2017Apple Inc.Better resolution when referencing to conceptsUS9633660Nov 13, 2015Apr 25, 2017Apple Inc.User profiling for voice input processingUS9633674Jun 5, 2014Apr 25, 2017Apple Inc.System and method for detecting errors in interactions with a voice-based digital assistantUS9639709Feb 23, 2009May 2, 2017Ami Entertainment Network, LlcPrioritized content download for an entertainment systemUS9646609Aug 25, 2015May 9, 2017Apple Inc.Caching apparatus for serving phonetic pronunciationsUS9646614Dec 21, 2015May 9, 2017Apple Inc.Fast, language-independent method for user authentication by voiceUS9654104Jul 17, 2007May 16, 2017Apple Inc.Resistive force sensor with capacitive discriminationUS9668024Mar 30, 2016May 30, 2017Apple Inc.Intelligent automated assistant for TV user interactionsUS9668121Aug 25, 2015May 30, 2017Apple Inc.Social remindersUS20030142631 *Jan 29, 2002Jul 31, 2003Silvester Kelan C.Apparatus and method for wireless/wired communications interfaceUS20030172271 *Mar 5, 2002Sep 11, 2003Silvester Kelan C.Apparatus and method for wireless device set-up and authentication using audio authentication_informationUS20040055446 *Oct 28, 2002Mar 25, 2004Apple Computer, Inc.Graphical user interface and methods of use thereof in a multimedia playerUS20040132499 *Sep 29, 2003Jul 8, 2004Kyocera CorporationPortable terminalUS20040214612 *Apr 26, 2004Oct 28, 2004Park Jin-WooDevice and method for using a rotating key and controlling a display in a mobile terminalUS20050015254 *Jul 18, 2003Jan 20, 2005Apple Computer, Inc.Voice menu systemUS20050096018 *Sep 23, 2004May 5, 2005White Russell W.Audio system and methodUS20050261029 *Jan 3, 2005Nov 24, 2005Lite-On Technology CorporationInputting apparatus for mobile phone with a dial wheelUS20070190987 *Mar 30, 2007Aug 16, 2007Suinno OyVoicemail short message service method and means and a subscriber terminalUS20090013254 *Jun 13, 2008Jan 8, 2009Georgia Tech Research CorporationMethods and Systems for Auditory Display of Menu ItemsUS20090271440 *Apr 23, 2009Oct 29, 2009Koninklijke Kpn N.V.Personal Address Book Communication ServiceUS20090303074 *Sep 10, 2008Dec 10, 2009Chi Mei Communication Systems, Inc.Wireless control device and wireless communication device using the sameUS20100169781 *Jan 1, 2009Jul 1, 2010Graumann David LPose to device mappingUS20100321296 *Aug 30, 2010Dec 23, 2010Sap AgMethod and system for secure password/pin input via mouse scroll wheelUS20110014900 *Jul 15, 2009Jan 20, 2011Ofer GottfriedAdvanced internet-based caller id information/data for mobile phones and mobile networksUS20110059724 *Nov 18, 2003Mar 10, 2011Flemming Abilidgaardhand-portable electronic device for verifying an input test sequence of characters against a predetermined sequence of charactersUS20110173539 *Jan 13, 2010Jul 14, 2011Apple Inc.Adaptive audio feedback system and methodUS20110246928 *Mar 30, 2010Oct 6, 2011Ariel BraunsteinOne-Dimensional Representation of a Two-Dimensional Data StructureUS20130104090 *Apr 18, 2012Apr 25, 2013Eugene YuDevice and method for selection of options by motion gesturesUS20130159861 *Feb 15, 2013Jun 20, 2013Apple Inc.Adaptive Audio Feedback System and MethodUSRE42476Aug 20, 2001Jun 21, 2011Dot Assets No. 14 LlcInstant video- and voicemail messaging method and meansEP2112813A1Apr 24, 2008Oct 28, 2009Koninklijke KPN N.V.Personal address book communication service* Cited by examinerClassifications U.S. Classification455/412.1, 379/88.13, 455/567, 455/412.2, 379/68, 455/569.1, 379/433.01, 379/67.1International ClassificationG06F3/16, G06F3/02, H04M1/56, G06F3/01, H04M1/247, H04M1/2745, H04M1/725, G06F3/023Cooperative ClassificationH04M1/56, H04M1/72522, H04M1/72519, H04M2250/56, H04M1/274525, H04M1/233, H04M1/72558, H04M1/72583European ClassificationH04M1/56, H04M1/2745D, H04M1/725F1, H04M1/725F4Legal EventsDateCodeEventDescriptionDec 16, 1999ASAssignmentOwner name: PHILIPS ELECTRONICS NORTH AMERICA CORPORATION, NEWFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BULTHUIS, WILLAM;SHTEYN, YEVGENIY EUGENE;KUSANO, MIEKO;AND OTHERS;REEL/FRAME:010482/0434;SIGNING DATES FROM 19991203 TO 19991208Sep 7, 2005ASAssignmentOwner name: KONINKLIJKE PHILIPS ELECTRONICS, N.V., NETHERLANDSFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:PHILIPS ELECTRONICS NORTH AMERICA CORP.;REEL/FRAME:016738/0837Effective date: 20050907May 27, 2009FPAYFee paymentYear of fee payment: 4Mar 14, 2013FPAYFee paymentYear of fee payment: 8RotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services