Source: https://patents.justia.com/patent/8972903
Timestamp: 2019-06-19 09:20:23
Document Index: 223595374

Matched Legal Cases: ['art 515', 'art 515', 'art 515', 'Application No. 1', 'Application No. 11733962', 'Application No. 2013', '§ 1', 'Application No. 2013', '§ 1', 'Application No. 10']

US Patent for Using gesture to navigate hierarchically ordered user interface screens Patent (Patent # 8,972,903 issued March 3, 2015) - Justia Patents Search
Justia Patents Gesture-basedUS Patent for Using gesture to navigate hierarchically ordered user interface screens Patent (Patent # 8,972,903)
Using gesture to navigate hierarchically ordered user interface screens
Jul 8, 2010 - Apple
A method of navigating between user interface screens, including displaying a third user interface screen in a plurality of user interface screens that also includes a first and a second predefined user interface screen, the third user interface screen being other than the first and the second predefined user interface screen; detecting a finger gesture on the touch-sensitive display while displaying the third user interface screen, and in response to detecting the finger gesture on the touch-sensitive display, replacing display of the third user interface screen with display of the first predefined user interface screen when the detected finger gesture is a first finger gesture, and replacing display of the third user interface screen with display of the second predefined user interface screen when the detected finger gesture is a second finger gesture that is a reverse of the first finger gesture.
This relates generally to electronic devices with touch-sensitive surfaces, including but not limited to electronic devices with touch-sensitive surfaces for navigating between user interface screens.
The use of touch-sensitive surfaces as input devices for computers and other electronic computing devices has increased significantly in recent years. Exemplary touch-sensitive surfaces include touch pads and touch screen displays. Such surfaces are widely used to navigate through a user interface on a display and to manipulate user interface objects on a display.
But existing methods for navigating between user interface screens are cumbersome and inefficient. For example, navigating from one user interface screen to another through a sequence of intermediate user interface screens is tedious and creates a significant cognitive burden on a user. In addition, existing methods take longer than necessary, thereby wasting energy. This latter consideration is particularly important in battery-operated devices.
Accordingly, there is a need for computing devices with faster, more efficient methods and interfaces for navigating between user interface screens. Such methods and interfaces may complement or replace conventional methods for navigating between user interface screens. Such methods and interfaces reduce the cognitive burden on a user and produce a more efficient human-machine interface. For battery-operated computing devices, such methods and interfaces conserve power and increase the time between battery charges.
In accordance with some embodiments, a method is performed at a portable electronic device with a touch-sensitive display, where the touch-sensitive display is configured to separately display a plurality of user interface screens, including a first predefined user interface screen and a second predefined user interface screen. The method includes: displaying a third user interface screen in the plurality of user interface screens, the third user interface screen being other than the first predefined user interface screen and the second predefined user interface screen; detecting a finger gesture on the touch-sensitive display while displaying the third user interface screen; and in response to detecting the finger gesture on the touch-sensitive display, replacing display of the third user interface screen with display of the first predefined user interface screen when the detected finger gesture is a first finger gesture, and replacing display of the third user interface screen with display of the second predefined user interface screen when the detected finger gesture is a second finger gesture that is a reverse of the first finger gesture.
In accordance with some embodiments, a portable electronic device includes a touch-sensitive surface display, one or more processors, memory, and one or more programs. The touch-sensitive display is configured to separately display a plurality of user interface screens, including a first predefined user interface screen and a second predefined user interface screen. The one or more programs are stored in the memory and configured to be executed by the one or more processors. The one or more programs include instructions for: displaying a third user interface screen in the plurality of user interface screens, the third user interface screen being other than the first predefined user interface screen and the second predefined user interface screen; detecting a finger gesture on the touch-sensitive display while displaying the third user interface screen; and in response to detecting the finger gesture on the touch-sensitive display, replacing display of the third user interface screen with display of the first predefined user interface screen when the detected finger gesture is a first finger gesture, and replacing display of the third user interface screen with display of the second predefined user interface screen when the detected finger gesture is a second finger gesture that is a reverse of the first finger gesture.
In accordance with some embodiments, a computer readable storage medium has stored therein instructions which when executed by a portable electronic device with a touch-sensitive display, the touch-sensitive display configured to separately display a plurality of user interface screens, including a first predefined user interface screen and a second predefined user interface screen, cause the device to: display a third user interface screen in the plurality of user interface screens, the third user interface screen being other than the first predefined user interface screen and the second predefined user interface screen; detect a finger gesture on the touch-sensitive display while displaying the third user interface screen; and in response to detecting the finger gesture on the touch-sensitive display, replace display of the third user interface screen with display of the first predefined user interface screen when the detected finger gesture is a first finger gesture; and replace display of the third user interface screen with display of the second predefined user interface screen when the detected finger gesture is a second finger gesture that is a reverse of the first finger gesture.
In accordance with some embodiments, a graphical user interface on a portable electronic device with a touch-sensitive display, a memory, and one or more processors to execute one or more programs stored in the memory includes a plurality of separately displayed user interface screens, including a first predefined user interface screen and a second predefined user interface screen. A third user interface screen in the plurality of user interface screens is displayed, the third user interface screen being other than the first predefined user interface screen and the second predefined user interface screen. A finger gesture is detected on the touch-sensitive display while the third user interface screen is displayed. In response to detection of the finger gesture on the touch-sensitive display while the third user interface screen is displayed, display of the third user interface screen is replaced with display of the first predefined user interface screen when the detected finger gesture is a first finger gesture, and display of the third user interface screen is replaced with display of the second predefined user interface screen when the detected finger gesture is a second finger gesture that is a reverse of the first finger gesture.
In accordance with some embodiments, a portable electronic device includes: a touch-sensitive display, where the touch-sensitive display is configured to separately display a plurality of user interface screens, including a first predefined user interface screen and a second predefined user interface screen; means for displaying a third user interface screen in the plurality of user interface screens, the third user interface screen being other than the first predefined user interface screen and the second predefined user interface screen; means for detecting a finger gesture on the touch-sensitive display while displaying the third user interface screen; means for, in response to detecting the finger gesture on the touch-sensitive display, replacing display of the third user interface screen with display of the first predefined user interface screen when the detected finger gesture is a first finger gesture; and means for, in response to detecting the finger gesture on the touch-sensitive display, replacing display of the third user interface screen with display of the second predefined user interface screen when the detected finger gesture is a second finger gesture that is a reverse of the first finger gesture.
In accordance with some embodiments, an information processing apparatus for use in a portable electronic device with a touch-sensitive display, the touch-sensitive display configured to separately display a plurality of user interface screens, including a first predefined user interface screen and a second predefined user interface screen, includes: means for displaying a third user interface screen in the plurality of user interface screens, the third user interface screen being other than the first predefined user interface screen and the second predefined user interface screen; means for detecting a finger gesture on the touch-sensitive display while displaying the third user interface screen; means for, in response to detecting the finger gesture on the touch-sensitive display, replacing display of the third user interface screen with display of the first predefined user interface screen when the detected finger gesture is a first finger gesture; and means for, in response to detecting the finger gesture on the touch-sensitive display, replacing display of the third user interface screen with display of the second predefined user interface screen when the detected finger gesture is a second finger gesture that is a reverse of the first finger gesture.
Thus, portable electronic devices with touch-sensitive displays are provided with faster, more efficient methods and interfaces for navigating between user interface screens, thereby increasing the effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may complement or replace conventional methods for navigating between user interface screens.
FIGS. 5A-5S illustrate exemplary user interface screens that are navigable in accordance with some embodiments.
FIGS. 6A-6D are flow diagrams illustrating a method of navigating between user interface screens in accordance with some embodiments.
FIG. 7 illustrates different paths that can be selected to navigate between predefined user interface screen in accordance with some embodiments.
Embodiments of computing devices, user interfaces for such devices, and associated processes for using such devices are described. In some embodiments, the computing device is a portable communications device, such as a mobile telephone, that also contains other functions, such as PDA and/or music player functions. Exemplary embodiments of portable multifunction devices include, without limitation, the iPhone®, iPod Touch® and iPad® devices from Apple Inc. of Cupertino, Calif. In some other embodiments, the computing device is a portable electronic device that is used principally as a media player but may include other functions, such as video recording and/or FM radio reception. Exemplary embodiments of portable electronic devices that are used principally as media players include, without limitation, the iPod Nano® device from Apple Inc. of Cupertino, Calif. Other portable devices, such as laptops or tablet computers with touch-sensitive surfaces (e.g., touch screen displays and/or touch pads), may also be used. It should also be understood that, in some embodiments, the device is not a portable communications device, but is a desktop computer with a touch-sensitive surface (e.g., a touch screen display and/or a touch pad).
In some portable media player embodiments, touch-screen 112 may have physical dimensions of 2 inches or less in width and/or height. In some portable media player embodiments, touch-screen 112 may have a screen resolution of 600 pixels or less in width and/or height. In some portable media player embodiments, touch-screen 112 may have a screen resolution of 900 pixels or less in width and/or height. In some portable media player embodiments, touch-screen 112 may have a screen resolution of 1200 pixels or less in width and/or height.
FIGS. 5A-5S illustrate exemplary user interface screens that are navigable in accordance with some embodiments. The user interfaces in these figures are used to illustrate the processes described below, including the processes in FIGS. 6A-6D. It should be appreciated that FIGS. 5A-5S are not drawn to scale.
FIG. 5A depicts a main menu screen 502 displayed on touch screen 112 of device 300-1. Main menu screen 502 corresponds to a main, home, or root menu of device 300-1. Main menu screen 502 includes one or more links (or other user interface objects, such as buttons, icons, etc.) 504 for navigation to user interface screens associated with applications and/or functions on device 300-1. For example, the links 504 include Songs link 504-1, Albums link 504-2, Artists link 504-3, Genres link 504-4, Playlists link 504-5, Videos link 504-6, Photos link 504-7, and Settings link 504-8. When a link 504 is selected by a user (e.g., by the user performing a gesture on the link 504), a user interface screen corresponding to the selected link is displayed in place of main menu screen 502. Other links that may be included include, without limitation, a Podcasts link, an FM radio link, and a Games link, to name a few examples.
FIG. 5A also depicts a detected gesture 506 (e.g., a tap gesture) on Songs link 504-1; Songs link 504-1 is selected. In response to detection of gesture 506 on Songs link 504-1, device 300-1 displays songs listing screen 508 in place of main menu screen 502, as shown in FIG. 5B; the device 300-1 navigates from main menu screen 502 to songs listing screen 508. Songs listing screen 508 lists one or more links 510 for playing back audio files (e.g., songs) that are stored in device 300-1. For example, in FIG. 5B, songs listing screen 508 includes Song 1 link 510-1, Song 2 link 510-2, Song 3 link 510-3, and so on. Audio files stored in device 300-1 may be grouped into one or more of albums, artists, genres, playlists, or podcast shows. In some embodiments, audio files are grouped into albums, artists, etc. based on metadata (e.g., artist metadata, album metadata, etc.) associated with the audio file. Also displayed with songs listing screen 508 is “Back” button 507 for navigating to the immediately preceding user interface screen in response to a gesture (e.g., a tap gesture) detected on Back button 507.
When a song link 510 is selected, playback of the audio file corresponding to the selected song link 510 is activated and a media playback screen is displayed. FIG. 5B illustrates a detected gesture 512 (e.g., a tap gesture) on Song 1 link 510-1; Song 1 link 510-1 is selected. In response to detection of gesture 512 on Song 1 link 510-1, playback of Song 1 is activated and media playback screen 514 is displayed for playback of Song 1, as shown in FIG. 5C. The media playback screen 514 may include information about the audio file being played back (Song 1 in FIG. 5C), the playback time position in the song, album art 515, if available, for Song 1, playback controls 516 (e.g., play/pause button(s), next/previous track buttons, etc.), and progress bar and scrubber 517. Also displayed with media playback screen 514 is Back button 507 for navigating to the immediately preceding user interface screen in response to a gesture (e.g., a tap gesture) detected on Back button 507.
If, in FIG. 5A, a gesture (e.g., a tap gesture) was detected on Albums link 504-2 instead of Songs link 504-1 (i.e., Albums link 504-2 in main menu screen 502 was selected), albums listing screen 518 is displayed in response, as shown in FIG. 5D; the device 300-1 navigates from main menu screen 502 to albums listing screen 518. Albums listing screen 518 lists links 520 to one or more albums with which audio files stored in device 300-1 are associated (e.g., based on metadata associated with the audio files). For example, in FIG. 5D, links 520-1 thru 520-8 to Albums 1 thru 8 are shown. More or less album links, as well as a “miscellaneous” link or the like for audio files not associated with an album, may be displayed depending on the albums with which audio files in device 300-1 are associated. Back button 507 is also displayed in albums listings screen 518.
When an album link 520 is selected, links to one or more songs in the corresponding album are displayed. For example, in FIG. 5D, gesture 522 (e.g., a tap gesture) is detected on Album 2 link 520-2. In response to detection of gesture 522 on Album 2 link 520-2, Album 2 screen 524 is displayed, as shown in FIG. 5E. Displayed in Album 2 screen 524 are links 510 to audio files that are associated with Album 2. Thus, for example, Album 2 is associated with Songs 1, 4, 5, 8, 9, 10, 14, and 17; song links 510-1, 510-4, 510-5, 510-8, 510-9, 510-10, 510-14, and 510-17, corresponding to Songs 1, 4, 5, 8, 9, 10, 14, and 17, respectively, are displayed in Album 2 screen 524. Also displayed with Album 2 screen 524 is “Back” button 507 for navigating to the immediately preceding user interface screen (in this case, albums listing screen 518) in response to detecting a gesture (e.g., a tap gesture) on Back button 507. A song link 510 may be selected to activate playback of the corresponding audio file. For example, gesture 528 is detected on Song 4 link 510-4. In response to detection of gesture 528, media playback screen 514 is displayed for playback of Song 4, as shown in FIG. 5F. The media playback screen 514 for Song 4 may include album art 515, if available, for Song 4, playback controls 516, progress bar and scrubber 517, and Back button 507.
If, in FIG. 5A, a gesture (e.g., a tap gesture) was detected on Artists link 504-3 instead of Songs link 504-1 (i.e., Artists link 504-3 in main menu screen 502 was selected), artists listing screen 530 is displayed in response, as shown in FIG. 5G; the device 300-1 navigates from main menu screen 502 to artists listing screen 530. Artists listing screen 530 lists links 532 to one or more artists with which audio files stored in device 300-1 are associated (e.g., based on metadata associated with the audio files). For example, in FIG. 5G, links 532-1 thru 532-8 to Artists 1 thru 8 are shown. More or less artist links, as well as a “miscellaneous” link or the like for audio files not associated with an artist, may be displayed depending on the artists with whom audio files in device 300-1 are associated. Back button 507 is also displayed in albums listings screen 530.
When an artist link 532 is selected, links to one or more songs by the corresponding artist are displayed. For example, in FIG. 5G, gesture 534 (e.g., a tap gesture) is detected on Artist 1 link 532-1. In response to detection of gesture 534 on Artist 1 link 532-1, Artist 1 screen 536 is displayed, as shown in FIG. 5H. Displayed in Artist 1 screen 536 are links 510 to audio files that are associated with Artist 1. Thus, for example, Artist 1 is associated with Songs 1, 3, 6, 7, 9, 10, 14, and 17; song links 510-1, 510-3, 510-6, 510-7, 510-9, 510-10, 510-14, and 510-17, corresponding to Songs 1, 3, 6, 7, 9, 10, 14, and 17, respectively, are displayed in Artist 1 screen 536. Also displayed with Artist 1 screen 536 is “Back” button 507 for navigating to the immediately preceding user interface screen (in this case, artists listing screen 530) in response to a gesture (e.g., a tap gesture) detected on Back button 507. A song link 510 may be selected to activate playback of the corresponding audio file. For example, gesture 540 is detected on Song 3 link 510-3. In response to detection of gesture 540, media playback screen 514 is displayed for playback of Song 3, as shown in FIG. 5I. The media playback screen 514 for Song 3 may include album art 515, if available, for Song 3, playback controls 516, progress bar and scrubber 517, and Back button 507.
It should be appreciated that user interface screens displayed and the navigation of those user interface screens when following Genres link 504-4, Playlists link 504-5, Videos link 504-6 (for video files) Photos link 504-7 (for images) and podcasts link (not shown) are analogous to those described above in reference to FIGS. 5A-5I. Similarly, Settings link 504-8 leads to user interface screens organized by sub-category of settings, for configuring device 300-1.
While Song 3 is played back, as in FIG. 5I, Back button 507 may be selected to navigate back to Artist 1 screen 536 while Song 3 remains playing, as shown in FIG. 5J. A “Now playing” label 541 is displayed with Song 3 link 510-3 to remind the user that playback of Song 3 is ongoing.
FIG. 5J also depicts gesture 542 being detected on touch screen 112. Gesture 542 is a two-finger gesture; gesture 542 has two concurrent finger contacts 542-A and 542-B and includes movements 543-A and 543-B of finger contacts 542-A and 542-B in the horizontal direction, respectively, in a swipe or drag gesture. In response to detection of gesture 542, an animation of user interface screens sliding out of view and into view is displayed. The user interface screens shown sliding out of and into view in the animation may include user interface screens that are between Artist 1 screen 536 and main menu screen 502, inclusive, in a navigational sequence of user interface screens from Artist 1 screen 536 to main menu screen 502.
For example, the animation may include Artist 1 screen 536 sliding out of view, in the horizontal direction indicated by arrow 544 and artists listing screen 530 sliding into view, as shown in FIG. 5K. The animation continues with artists listing screen 530 sliding out of view and main menu screen 502 sliding into view in direction 544, as shown in FIG. 5L. The animation completes with main menu screen 502 sliding completely into view and being displayed on touch screen 112, as shown in FIG. 5M. Thus, in response to detection of gesture 542, device 300-1 displays main menu screen 502 in place of Artist 1 screen 536 and may display an animation that shows user interface screens that were bypassed (e.g., artists listing screen 530) in transitioning from Artist 1 screen 536 to main menu screen 502 to provide context for the user.
While Song 3 is played back (or paused), as in FIG. 5I, Back button 507 may be selected to navigate back to Artist 1 screen 536 while Song 3 remains playing (or paused), as shown in FIG. 5J. In some embodiments, a “Now playing” label 541 is displayed with Song 3 link 510-3 to remind the user that playback of Song 3 is ongoing. Back button 507 on Artist 1 screen 536 may be selected to navigate back from Artist 1 screen 536 to artists listing screen 530 while Song 3 remains playing (or paused), as shown in FIG. 5N.
FIG. 5N also depicts gesture 546 being detected on touch screen 112. Gesture 546 is a two-finger gesture; gesture 546 has two concurrent finger contacts 546-A and 546-B and includes horizontal movements 547-A and 547-B of finger contacts 546-A and 546-B, respectively, in a swipe or drag gesture. It should be appreciated that gesture 546 is the reverse of gesture 542; movements 543 and 547 are opposites of each other. In response to detection of gesture 546, an animation of user interface screens sliding out of view and into view is displayed. The user interface screens shown sliding out of and into view in the animation may include user interface screens that are between artists listing screen 530 and media playback screen 514 for Song 3, inclusive, in a navigational sequence of user interface screens from artists listing screen 530 to media playback screen 514 for Song 3.
For example, the animation may include artists listing screen 530 sliding out of view, in the direction indicated by arrow 548 and Artist 1 screen 536 sliding into view, as shown in FIG. 5O. The animation continues with Artist 1 screen 536 sliding out of view and media playback screen 514 for Song 3 sliding into view in direction 548, as shown in FIG. 5P. The animation completes with media playback screen 514 for Song 3 sliding completely into view and being displayed on touch screen 112, as shown in FIG. 5Q. Thus, in response to detection of gesture 546, device 300-1 displays media playback screen 514 for Song 3 in place of artists listing screen 530 and may display an animation that shows user interface screens that were bypassed (e.g., Artist 1 screen 536) in transitioning from artists listing screen 530 to media playback screen 514 for Song 3.
In the examples described above, two-finger gestures 542 and 546 activate navigation to main menu screen 502 or media playback screen 514, respectively, regardless of the number of user interface screens that are between the current screen and menu screen 502 or media playback screen 514, respectively. Main menu screen 502 is predefined as the user interface screen to which the device navigates in response to detecting gesture 542. Similarly, media playback screen 514 is predefined as the user interface screen to which the device navigates in response to detecting gesture 546, with gesture 546 being the reverse of gesture 542. In some embodiments, if the detected gesture was instead a one-finger gesture (e.g., a swipe or drag gesture but with just one finger contact), then navigation by one user interface screen is activated instead. Thus, for example, in FIG. 5J, if the detected gesture is a gesture that is like gesture 542 except that it is a single-finger gesture instead of a two-finger gesture, then artists listing screen 530 is displayed. The animation depicted in FIG. 5K may be displayed, but the animation stops with artists listing screen 530 being displayed, rather than continuing to show additional user interface screens sliding out of and into view. As another example, in FIG. 5N, if the detected gesture is a gesture that is like gesture 546 except that it is a single-finger gesture on Artist 1 532-1 instead of a two-finger gesture, then Artist 1 screen 536 is displayed. The animation depicted in FIG. 5O may be displayed, but the animation stops with Artist 1 screen 536 being displayed, rather than continuing to show additional user interface screens sliding out of and into view. Thus, the one-finger gestures serve to activate navigation by one user interface screen backward or forward, while two-finger gesture 542 and its reverse gesture (two-finger gesture 546) serve to activate navigation to respective predefined user interface screens (e.g., main menu screen 502 and media playback screen 514, respectively).
It should be appreciated that while the example above describes two-finger gestures as activating navigation to predefined user interface screens (e.g., main menu screen 502, media playback screen 514) and the one-finger gestures as activating navigation by one user interface screen at a time (e.g., to an immediately preceding or succeeding user interface screen), in some embodiments, the two-finger gestures activate navigation by one user interface screen at a time and the one-finger gestures activate navigation to predefined user interface screens. In some other embodiments, the number of fingers in a gesture for activating navigation to predefined user interface screens is an integer other than one or two, such as three or four. Further, in some embodiments, the location on touch screen 112 where the two-finger gesture is detected is irrelevant. Thus, for example, in FIG. 5J, gesture 542 may be performed in the upper portion, middle portion, or lower portion of touch screen 112 and the result is the same; main menu screen 502, along with an animation showing the transition to main menu screen 502, is displayed.
FIG. 5R depicts media playback screen 514 for Song 1 displayed on touch screen 112; playback of Song 1 is ongoing (or paused) on device 300-1. Media playback screen 514 for Song 1 may be displayed as a result of, for example, navigation from main menu screen 502 to songs listing screen 508 to media playback screen 514, as depicted in FIGS. 5A-5C. As another example, media playback screen 514 for Song 1 may be displayed as a result of navigation from main menu screen 502 to albums listing screen 518 to Album 2 screen 524, as shown in FIGS. 5A, 5D-5E, and selection of Song 1 link 510-1 in Album 2 screen 524. As a further example, media playback screen 514 for Song 1 may be displayed as a result of navigation from main menu screen 502 to artists listing screen 530 to Artist 1 screen 536, as shown in FIGS. 5A, 5G-5H, and selection of Song 1 link 510-1 in Artist 1 screen 536.
FIG. 5R also depicts detection of finger gesture 542 on touch screen 112. In response to detection of gesture 542, an animation analogous to that depicted in FIGS. 5K-5M is displayed; user interface screens between media playback screen 514 and main menu screen 502 are animated as sliding out of and into view in sequence, concluding with main menu screen 502 being displayed, as in FIG. 5M. In some embodiments, the user interface screens that are displayed in the animation depends on the user interface screens through which navigation occurred to reach media playback screen 514 from main menu screen 502, thereby providing context to the user.
FIG. 5S depicts main menu screen 502 displayed on touch screen 112 while playback of a song (e.g., Song 1, etc.) is ongoing. Main menu screen 502 may be displayed while a song (e.g., Song 1) is playing as a result of, for example, navigation from main menu screen 502 to songs listing screen 508 to media playback screen 514, as depicted in FIGS. 5A-5C, and then the user navigates back to song listing screen 508 and then to main menu screen 502 (e.g., by using Back button 507) while playback is active. As another example, media playback screen 514 may be displayed as a result of navigation from main menu screen 502 to albums listing screen 518 to Album 2 screen 524, as shown in FIGS. 5A, 5D-5E, and selection of a song link 510 in Album 2 screen 524, and then navigating back to main menu screen 502 (through one or more user interface screens in between) while playback is active. As a further example, media playback screen 514 for Song 1 may be displayed as a result of navigation from main menu screen 502 to artists listing screen 530 to Artist 1 screen 536, as shown in FIGS. 5A, 5G-5H, and selection of a song link 510 in Artist 1 screen 536, and then navigating back to main menu screen 502 (through one or more user interface screens in between) while playback is active.
FIG. 5S also depicts detection of finger gesture 546 on touch screen 112. In response to detection of gesture 546, an animation analogous to that depicted in FIGS. 5O-5Q is displayed; user interface screens between main menu screen 502 and media playback screen 514 are animated as sliding out of and into view in sequence, concluding with media playback screen 514 being displayed, as in FIG. 5Q. In some embodiments, the user interface screens that are displayed in the animation depends on the user interface screens through which navigation occurred to reach media playback screen 514 from main menu screen 502.
In some embodiments, main menu screen 502, media playback screen(s) 514, and other user interface screens described above in reference to FIGS. 5A-5S are parts of a navigational hierarchy (e.g., as in a tree data structure) of user interface screens on device 300-1. Main menu screen 502 is at the root or top level of the hierarchy, and other user interface screens on device 300-1 are navigable from main menu screen 502 through links in main menu screen 502 (e.g., links 510) and links in user interface screens further down in the hierarchy (e.g., song links 510, album links 520, artist links 532).
FIG. 7 depicts different paths 702, 704 and 706, which can be selected to navigate sequentially between main menu screen 502 and media playback screen 514. There may be zero or more user interface screens between a starting screen and a destination screen, not inclusive, along a path or navigational sequence from the starting screen to the destination screen. For example, from main menu screen 502 to media playback screen 514 for Song 1, there is, in one path, songs listing screen 508 in between main menu screen 502 and media playback screen 514 (e.g., as shown in FIGS. 5A-5C). In another path, there are artists listing screen 530 and Artist 1 screen 536 between main menu screen 502 and media playback screen 514 for Song 1.
By performing gesture 542 or 546, a user may navigate to main menu screen 502 or media playback screen 514 for a currently playing piece of media, respectively, from anywhere in the navigational hierarchy of user interface screens with just a single gesture. More generally, gestures that are the reverse of each other may each be associated with predefined user interface screens (e.g., frequently accessed screens such as main menu screen 502 and media playback screen 512) that are at opposite ends in the navigational hierarchy (for example, main menu screen 502 is at the root level and media playback screen 512 is typically a leaf level user interface screen). By performing either single gesture, a user may quickly navigate to the user interface screen associated with the respective gesture, without having to perform additional gestures to navigate through any intervening user interface screens in the hierarchy.
FIGS. 6A-6D are flow diagrams illustrating a method 600 of navigating between user interface screens in accordance with some embodiments. The method 600 is performed at a multifunction device (e.g., device 300, FIG. 3A, device 300-1, FIG. 3B, or portable multifunction device 100, FIG. 1) with a display and a touch-sensitive surface. In some embodiments, the display is a touch screen and the touch-sensitive surface is on the display. In some embodiments, the display is separate from the touch-sensitive surface. Some operations in method 600 may be combined and/or the order of some operations may be changed.
As described below, the method 600 provides an efficient way to navigate to two frequently used interface screens, such as a home screen and a media playback screen. The method reduces the cognitive burden on a user when of navigating between user interface screens, thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a user to of navigate between user interface screens faster and more efficiently conserves power and increases the time between battery charges.
The device typically has a touch-sensitive display configured to separately display a plurality of user interface screens. As used herein, “separately displayed” means that the user interface screens are displayed one at a time on the display (except during brief transitions between user interface screens, where portions of two or more screens may be shown in an animated transition). The plurality of user interface screens includes a first predefined user interface screen and a second predefined user interface screen. A user of the device interacts with the device through the user interface screens.
The device displays (602) a third user interface screen in the plurality of user interface screens, where the third user interface screen is other than the first predefined user interface screen and the second predefined user interface screen. For example, in FIGS. 5A-5C, main menu screen 502 is the first predefined user interface screen and media playback screen 514 is the second predefined user interface screen. In FIG. 5B, a third user interface screen (songs listing screen 508) that is other than the first or second predefined user interface screen is displayed. As another example, in FIG. 5J, Artist 1 screen 536, which is neither main menu screen 502 nor media playback screen 514, is displayed. In a further example, in FIG. 5N, artists listing screen 530, which is neither main menu screen 502 nor media playback screen 514, is displayed.
In some embodiments, the first predefined user interface screen is a home screen (604), e.g., a main or root menu screen. In some embodiments, the home screen is a main screen for a single application, such as a music player, with a hierarchical arrangement of categories within the single application. In some other embodiments, the home screen is a main screen for a plurality of applications (e.g., a screen that lists a plurality of applications that may be selected by a user). An example of a home screen is main menu screen 502 in FIG. 5A.
In some embodiments, the second predefined user interface screen is a media playback screen (606), e.g., a “now playing” screen with playback controls for managing playback of a currently playing or selected piece of media (e.g., audio, video). The media playback screen may also display information about the currently playing or selected piece of media. An example of a media playback screen is media playback screen 514.
The device detects (610) a finger gesture on the touch-sensitive display while displaying the third user interface screen. For example, in FIG. 5J, while Artist 1 screen 536 is displayed, gesture 542 is detected. In another example, in FIG. 5N, while artists listing screen 530 is displayed, gesture 546 is detected.
In response to detecting the finger gesture on the touch-sensitive display, the device replaces (612) display of the third user interface screen with display of the first predefined user interface screen when the detected finger gesture is a first finger gesture, and replaces (614) display of the third user interface screen with display of the second predefined user interface screen when the detected finger gesture is a second finger gesture that is a reverse of the first finger gesture. For example, in FIGS. 5J-5M, in response to detection of gesture 542, the display of Artist 1 screen 536 is replaced with the display of main menu screen 502. Alternatively, in FIGS. 5N-5Q, in response to detection of gesture 546, the display of artists listing screen 530 is replaced with the display of media playback screen 514. It should be appreciated that gesture 546 is the reverse of gesture 542; the movements 543-A and 543-B in gesture 542 are in a direction that is opposite to the movements 547-A and 547-B in gesture 546.
In some embodiments, the plurality of user interface screens is hierarchically ordered, with one or more user interface screens between the first predefined user interface screen and the second predefined user interface screen (608). The plurality of user interface screens on the device forms a navigational hierarchy, where navigation from user interface screen to user interface screen through the hierarchy starts at a root level screen (e.g., main menu screen 502) and from the root level branches out into one or more sublevels. Along a navigational path through the hierarchy, from the first predefined user interface screen (e.g., main menu screen 502) to the second predefined user interface screen (media playback screen 514 for a piece of media), there are one or more user interface screens between, but not including, the first and second predefined user interface screens. For example, in FIGS. 5A-5I, main menu screen 502 is the root level screen in a hierarchy of user interface screens. From main menu screen 502, one can navigate to various branches in the hierarchy by selecting a respective link 510. For example, a path from main menu screen 502 to media playback screen 514 for Song 1 through a “Songs” branch (corresponding to Songs link 510-1) is depicted in FIGS. 5A-5C. A path from main menu screen 502 to media playback screen 514 for Song 4 through an “Albums” branch (corresponding to Albums link 510-2) is depicted in FIGS. 5A, 5D-5F. A path from main menu screen 502 to media playback screen 514 for Song 3 through an “Artists” branch (corresponding to Artists link 510-3) is depicted in FIGS. 5A, 5G-5I. In each of these example paths, there are one or more user interface screens (e.g., songs listing screen 508, albums listing screen 518, Album 2 screen 524, artists listings screen 530, Artist 1 screen 536) between main menu screen 502 and media playback screen 514.
In some embodiments, in response to detecting the finger gesture on the touch-sensitive display, the device replaces (616) display of the third user interface screen with display of a fourth user interface screen in the plurality of user interface screens, the fourth user interface screen being other than the first predefined user interface screen and the second predefined user interface screen, when the detected finger gesture is a third finger gesture other than the first finger gesture and the second finger gesture. For example, in some embodiments, as described above with respect to FIGS. 5J-5Q, if a gesture is detected that is like gesture 542 or 546 except for the number of finger contacts (e.g., one finger instead of two), then the user interface screen currently displayed is replaced by the immediately preceding or succeeding user interface screen, depending on the direction of the detected gesture. In some other embodiments, if a gesture is detected that is like 542 or 546 except for the number of finger contacts (e.g., one finger instead of two), then the user interface screen currently displayed is replaced by a predefined user interface screen, other than main menu screen 502 and media playback screen 514, that is associated with the respective one-finger gesture. Further, in some embodiments, additional gestures (e.g., a two-finger swipe gesture vertically upward and a two-finger swipe gesture vertically downward, or one-finger versions of same) are also associated with respective predefined user interface screens; detection of any of these additional gestures activates direct navigation to the respective user interface screen associated with the detected gesture. For example, a two-finger upward gesture may activate display of a listing of genres and a two-finger downward gesture may activate display of a listing of albums (e.g., as in Albums screen 518). In some embodiments, the predefined user interface screens associated with respective one-finger and two-finger gestures are customizable by a user. In another example, the third finger gesture is a tap gesture that is located on a user interface object (e.g., Back button 507). In response to detection of the tap gesture on Back button 507, the currently displayed user interface screen is replaced with display of the immediately preceding user interface screen.
In some embodiments, the plurality of user interface screens is hierarchically ordered, with one or more user interface screens between the first predefined user interface screen and the second predefined user interface screen, and the fourth user interface screen is hierarchically adjacent to the third user interface screen in the plurality of hierarchically ordered user interface screens (618). In one example, if a gesture that is like 542 or 546 except for the number of finger contacts (e.g., one finger instead of two) is detected, then the user interface screen currently displayed is replaced by the immediately preceding or succeeding (i.e., adjacent within the hierarchy of user interface screens) user interface screen, depending on the direction of the detected gesture. In another example, a tap gesture is detected on Back button 507, and in response the user interface screen currently displayed is replaced by the immediately preceding user interface screen.
In some embodiments, the third finger gesture is an M-finger gesture and the first finger gesture and the second finger gesture are N-finger gestures, where M is an integer (e.g., from 1 to 4) and N is an integer (e.g., from 1 to 4) other than M (620). In some embodiments, the third finger gesture is a single-finger gesture (i.e., M=1) and the first finger gesture and the second finger gesture are two-finger gestures (i.e., N=2) (622). As in the example described above, the first and second finger gestures (e.g., gestures 542, 546) have a particular number of finger contacts and the third finger gesture (e.g., the gestures for navigating to the immediately preceding or succeeding user interface screen) has a different particular number of finger contacts. In one example, the first and second finger gestures (e.g., gestures 542 and 546) are two-finger gestures (i.e., each have two finger contacts) and the third finger gesture is a one-finger gesture (i.e., has one finger contact).
In some embodiments, the first finger gesture is a two-finger swipe gesture in a first direction, the second finger gesture is a two-finger swipe gesture in a direction that is opposite the first direction, and the third finger gesture is a single-finger gesture (624) (e.g., a tap or swipe gesture). In one example, gesture 542 (the first finger gesture) is a two-finger swipe gesture in one direction, gesture 546 (the second finger gesture) is a two-finger swipe gesture in the opposite direction, and the gesture for navigating to an adjacent user interface screen is a one-finger gesture (e.g., a swipe gesture in the same direction as gesture 542 or 546, or a tap gesture on Back button 507).
In some embodiments, in response to detecting the first finger gesture, the device displays (626) a first animation transitioning from the third user interface screen to the first predefined user interface screen. For example, the third user interface screen slides out of view and the home screen slides into view on the display. In some embodiments, the first animation includes user interface screens along a hierarchical path between the third user interface screen and the first predefined user interface screen (628).
In some embodiments, in response to detecting the second finger gesture, the device displays (630) a second animation transitioning from the third user interface screen to the second predefined user interface screen. For example, the third user interface screen slides out of view and the media playback screen slides into view on the display. In some embodiments, the second animation includes user interface screens along a hierarchical path between the third user interface screen and the second predefined user interface screen (632).
The first or second animation may show the user interface screens that are bypassed in navigating from the third user interface screen to the first or second user interface screen, respectively. For example, in FIGS. 5J-5M, an animation showing a transition from Artist 1 screen 536 to main menu screen 502, and the user interface screens between the two (e.g., artists listing screen 530), is displayed. In another example, in FIGS. 5N-5Q, an animation showing a transition from artists listing screen 530 to media playback screen 514, and the user interface screens between the two (e.g., Artist 1 screen 536), is displayed.
In some embodiments, in response to detecting the third finger gesture, the device displays an animation transitioning from the third user interface screen to the fourth user interface screen. Thus, an animation may be displayed even if the user interface screen to be replaced and the replacement user interface screen are adjacent in the hierarchy.
In some embodiments, the device displays (634) the first predefined user interface screen, detects (636) the second finger gesture on the touch-sensitive display while displaying the first predefined user interface screen, and, in response to detecting the second finger gesture while displaying the first predefined user interface screen, replaces (638) display of the first predefined user interface screen with display of the second predefined user interface screen. For example, in FIG. 5S, gesture 546 is detected while main menu screen 502 is displayed. In response to detection of gesture 546, display of main menu screen 502 is replaced with media playback screen 514 for whichever piece of media is currently playing (or, in some embodiments, if no piece of media is currently playing, the media playback screen 514 for the most recently played piece of media is displayed).
In some embodiments, in response to detecting the second finger gesture while displaying the first predefined user interface screen, the device displays (640) a third animation transitioning from the first predefined user interface screen to the second predefined user interface screen. In some embodiments, the third animation includes user interface screens along a hierarchical path between the first predefined user interface screen and the second predefined user interface screen (642). For example, in response to detection of gesture 546 while main menu screen 502 is displayed (FIG. 5S), an animation (e.g., user interface screens sliding into or out of view) showing the replacement of main menu screen 502 with media playback screen 514 is displayed. The animation may include user interface screens that are between main menu screen 502 and media playback screen 514 along the hierarchal path between the two (e.g., depending on the actual path, songs listing screen 508, Artist 1 screen 536, etc.).
In some embodiments, if the second finger gesture is detected when the second predefined user interface screen is displayed, a third predefined user interface screen is displayed in place of the second predefined user interface screen. For example, if gesture 546 is detected when media playback screen 514 is displayed, display of media playback screen 514 is replaced with, for example, display of a list of songs in the album to which the currently playing song belongs (e.g., as in Album 2 screen 524). In some other embodiments, if the second finger gesture is detected when the second predefined user interface screen is displayed, the second finger gesture is ignored.
In some embodiments, the device displays (644) the second predefined user interface screen, detects (646) the first finger gesture on the touch-sensitive display while displaying the second predefined user interface screen, and, in response to detecting the first finger gesture while displaying the second predefined user interface screen, replaces display of the second predefined user interface screen with display of the first predefined user interface screen (648). For example, in FIG. 5R, gesture 542 is detected while media playback screen 514 is displayed. In response to detection of gesture 542, display of media playback screen 514 is replaced with main menu screen 502.
In some embodiments, if the first finger gesture is detected when the first predefined user interface screen is displayed, a fourth predefined user interface screen is displayed in place of the first predefined user interface screen. For example, if gesture 542 is displayed when main menu screen 502 is displayed, display of main menu screen 502 is replaced with, for example, display of a user interface screen showing a clock or display of a user interface screen showing options for customizing main menu screen 502 (e.g., custom wallpaper, settings, etc.). In some other embodiments, if the first finger gesture is detected when the first predefined user interface screen is displayed, the gesture is ignored.
In some embodiments, in response to detecting the first finger gesture while displaying the second predefined user interface screen, the device displays (650) a fourth animation transitioning from the second predefined user interface screen to the first predefined user interface screen. In some embodiments, the fourth animation includes user interface screens along a hierarchical path between the second predefined user interface screen and the first predefined user interface screen (652). For example, in response to detection of gesture 542 while media playback screen 514 is displayed (FIG. 5R), an animation (e.g., user interface screens sliding into or out of view) showing the replacement of media playback screen 514 with main menu screen 502 is displayed. The animation may include user interface screens that are between main menu screen 502 and media playback screen 514 along the hierarchal path between the two (e.g., depending on the actual path, songs listing screen 508, Artist 1 screen 536, etc.).
The operations described above with reference to FIGS. 6A-6D, may be implemented by components depicted in FIGS. 1A-1C. For example, detection operation 610 and replacement operations 612 and 614 may be implemented by event sorter 170, event recognizer 180, and event handler 190. Event monitor 171 in event sorter 170 detects a contact on touch-sensitive display 112, and event dispatcher module 174 delivers the event information to application 136-1. A respective event recognizer 180 of application 136-1 compares the event information to respective event definitions 186, and determines whether a first contact at a first location on the touch-sensitive surface corresponds to a predefined event or sub-event, such as selection of an object on a user interface. When a respective predefined event or sub-event is detected, event recognizer 180 activates an event handler 190 associated with the detection of the event or sub-event. Event handler 190 may utilize or call data updater 176, object updater 177 or GUI updater 178 to update the application internal state 192. In some embodiments, event handler 190 accesses a respective GUI updater 178 to update what is displayed by the application. Similarly, it would be clear to a person having ordinary skill in the art how other processes can be implemented based on the components depicted in FIGS. 1A-1C.
1. A portable electronic device, comprising: a touch-sensitive display, the touch-sensitive display configured to separately display a plurality of hierarchically ordered user interface screens within a single application, the hierarchically ordered user interface screens including a first predefined user interface screen and a second predefined user interface screen with one or more user interface screens in the hierarchically ordered user interface screens in a plurality of user selectable paths between the first predefined user interface screen and the second predefined user interface screen; one or more processors; memory; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying a third user interface screen in the plurality of user interface screens, the third user interface screen belonging to a selected path in the hierarchically ordered user interface screens and being between the first predefined user interface screen and the second predefined user interface screen;
detecting a finger gesture on the touch-sensitive display while displaying the third user interface screen;
in response to detecting the finger gesture on the touch-sensitive display: replacing display of the third user interface screen with display of the first predefined user interface screen when the detected finger gesture is a two-finger swipe gesture in a first direction; replacing display of the third user interface screen with display of the second predefined user interface screen when the detected finger gesture is a two-finger swipe gesture in a direction that is opposite the first direction;
displaying the first predefined user interface screen;
detecting a two-finger swipe gesture in the direction that is opposite the first direction on the touch-sensitive display while displaying the first predefined user interface screen;
in response to detecting the two-finger swipe gesture in the direction that is opposite the first direction while displaying the first predefined user interface screen, replacing display of the first predefined user interface screen with display of the second predefined user interface screen;
displaying the second predefined user interface screen;
detecting a two-finger swipe gesture in the first direction on the touch-sensitive display while displaying the second predefined user interface screen;
in response to detecting the two-finger swipe gesture in the first direction while displaying the second predefined user interface screen, replacing display of the second predefined user interface screen with display of the first predefined user interface screen; and
in response to detecting a single-finger swipe gesture while displaying the second predefined user interface screen, replacing display of the second predefined user interface screen with display of a fourth user interface screen by navigating sequentially to the selected path.
2. The device of claim 1, wherein the first predefined user interface screen is a home screen.
3. The device of claim 1, wherein the second predefined user interface screen is a media playback screen.
in response to detecting the finger gesture on the touch-sensitive display: replacing display of the third user interface screen with display of the fourth user interface screen in the plurality of user interface screens, the fourth user interface screen being other than the first predefined user interface screen and the second predefined user interface screen, when the detected finger gesture is a single-finger gesture.
the fourth user interface screen is hierarchically adjacent to the third user interface screen in the plurality of hierarchically ordered user interface screens.
6. The device of claim 1, wherein the portable electronic device is a music player.
in response to detecting a single-finger swipe gesture in a first direction while displaying the third user interface screen, navigating sequentially in a first direction of the hierarchically ordered user interface screens of the selected path; and
in response to detecting a single-finger swipe gesture in a direction that is opposite the first direction while displaying the third user interface screen, navigating sequentially in the opposite direction of the hierarchically ordered user interface screens of the selected path.
in response to detecting the two-finger swipe gesture in the first direction while displaying the second predefined user interface screen, displaying an animation transitioning from the second predefined user interface screen to the first predefined user interface screen, wherein the animation includes user interface screens in the selected path between the second predefined user interface screen and the first predefined user interface screen.
9. A method, comprising: at a portable electronic device with a touch-sensitive display, the touch-sensitive display configured to separately display a plurality of hierarchically ordered user interface screens within a single application, the hierarchically ordered user interface screens including a first predefined user interface screen and a second predefined user interface screen with one or more user interface screens in the hierarchically ordered user interface screens in a plurality of user selectable paths between the first predefined user interface screen and the second predefined user interface screen:
detecting a finger gesture on the touch-sensitive display while displaying the third user interface screen; and
10. The method of claim 9, wherein the first predefined user interface screen is a home screen.
11. The method of claim 9, wherein the second predefined user interface screen is a media playback screen.
14. The method of claim 9, wherein the portable electronic device is a music player.
15. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a portable electronic device with a touch-sensitive display, the touch-sensitive display configured to separately display a plurality of hierarchically ordered user interface screens within a single application, the hierarchically ordered user interface screens including a first predefined user interface screen and a second predefined user interface screen with one or more user interface screens in the hierarchically ordered user interface screens in a plurality of user selectable paths between the first predefined user interface screen and the second predefined user interface screen, cause the device to:
display a third user interface screen in the plurality of user interface screens, the third user interface screen belonging to a selected path in the hierarchically ordered user interface screens and being between the first predefined user interface screen and the second predefined user interface screen;
detect a finger gesture on the touch-sensitive display while displaying the third user interface screen;
in response to detecting the finger gesture on the touch-sensitive display: replace display of the third user interface screen with display of the first predefined user interface screen when the detected finger gesture is a two-finger swipe gesture in a first direction; replace display of the third user interface screen with display of the second predefined user interface screen when the detected finger gesture is a two-finger swipe gesture in a direction that is opposite the first direction;
display the first predefined user interface screen;
detect a two-finger swipe gesture in the direction that is opposite the first direction on the touch-sensitive display while displaying the first predefined user interface screen;
in response to detecting the two-finger swipe gesture in the direction that is opposite the first direction while displaying the first predefined user interface screen, replace display of the first predefined user interface screen with display of the second predefined user interface screen;
display the second predefined user interface screen;
detect a two-finger swipe gesture in the first direction on the touch-sensitive display while displaying the second predefined user interface screen;
in response to detecting the two-finger swipe gesture in the first direction while displaying the second predefined user interface screen, replace display of the second predefined user interface screen with display of the first predefined user interface screen; and
16. The non-transitory computer readable storage medium of claim 15, wherein the first predefined user interface screen is a home screen.
17. The non-transitory computer readable storage medium of claim 15, wherein the second predefined user interface screen is a media playback screen.
in response to detecting the finger gesture on the touch-sensitive display: replace display of the third user interface screen with display of the fourth user interface screen in the plurality of user interface screens, the fourth user interface screen being other than the first predefined user interface screen and the second predefined user interface screen, when the detected finger gesture is a single-finger gesture.
20. The non-transitory computer readable storage medium of claim 15, wherein the portable electronic device is a music player.
7458014 November 25, 2008 Rubin et al.
20020126148 September 12, 2002 Rosenkranz et al.
20090172532 July 2, 2009 Chaudhri
2000-155638 June 2000 JP
2007-172767 July 2007 JP
2007-187708 July 2007 JP
International Search Report and Written Opinion dated Dec. 15, 2011, received in International Patent Application No. PCT/US2011/043302, which corresponds to U.S. Appl. No. 12/832,900 (James).
International Preliminary Report on Patentability dated Jan. 17, 2013, received in international Application No. PCT/US2011/043302, which corresponds to U.S. Appl. No. 12/832,900, 10 pages (James).
Office Action dated Oct. 17, 2013, received in Australian Patent Application No. 1 2011274519, which corresponds to U.S. Appl. No. 12/832,900, 3 pages (James).
Office Action received for European Patent Application No. 11733962.2, mailed on Jan. 22, 2014, 4 pages.
Office Action received for Japanese Patent Application No. 2013-518852, mailed on Feb. 10, 2014, 3 pages. (See Communication under 37 CFR § 1.98(a) (3)).
Notice of Allowance received for Japanese Patent Application No. 2013-518852, mailed on Nov. 17, 2014, 3 pages. (See Communication under 37 CFR § 1.98(a) (3)).
Office Action received for Korean Patent Application No. 10-2013-7003037, mailed on Oct. 23, 2014, 7 pages (3 pages of English Translation and 4 pages of Official Copy).
Patent number: 8972903
Patent Publication Number: 20120011437
Inventors: Bryan J. James (Menlo Park, CA), Policarpo Bonilla Wood, Jr. (San Francisco, CA), Jorge Fino (San Jose, CA), Jeffrey Theodore Lee (San Jose, CA)
Application Number: 12/832,900
Current U.S. Class: Gesture-based (715/863); Audio User Interface (715/727); For A Small Display Screen (e.g., Personal Digital Assistant, Palm-top) (715/864); Touch Panel (345/173)
International Classification: G06F 3/041 (20060101); G06F 3/0488 (20130101); G06F 1/16 (20060101); G06F 3/0482 (20130101);