# Patent

## Title
Graphical user interface and methods of use thereof in a multimedia player

## Abstract

In a portable multimedia device, a method, apparatus, and system for providing user supplied configuration data are described. In one embodiment, a hierarchically ordered graphical user interface are provided. A first order, or home, interface provides a highest order of user selectable items each of which, when selected, results in an automatic transition to a lower order user interface associated with the selected item. In one of the described embodiments, the lower order interface includes other user selectable items associated with the previously selected item from the higher order user interface.

## Background
CROSS REFERENCE TO RELATED APPLICATIONS
This application is a continuation of U.S. patent application Ser. No. 10/282,861, entitled, “GRAPHICAL USER INTERFACE AND METHODS OF USE THEREOF IN A MULTIMEDIA PLAYER”, filed Oct. 28, 2002 now U.S. Pat. No. 7,166,791, which is incorporated herein by reference, and which, in turn, claims the benefit of priority under 35 U.S.C. §119(e) to U.S. Provisional Patent Application No. 60/399,806, entitled “GRAPHICAL USER INTERFACE AND METHODS OF USE THEREOF IN A MULTIMEDIA PLAYER”, filed on Jul. 30, 2002, which is incorporated herein by reference.


BACKGROUND OF THE INVENTION
1. Field of Invention
This invention relates generally to multimedia devices. More specifically, the invention describes a graphical user interface for use in a multimedia asset player suitable for providing any number and kind of user supplied inputs.
2. Description of Related Art
Recent developments in consumer electronics have included the introduction of portable multimedia asset player devices such as MP3 players, minidisk players, and the like. For example, in the case of an MP3 player, a number of digitized audio files in the form of MP3 files are stored in a storage medium included in or coupled to the player in a fashion deemed most suitable to that user. In the case of MP3 files, for example, a user of the MP3 player must be able to peruse and select a particular file, or files, based upon such characteristics as music genre, author, album, or whatever grouping of MP3 files is present in the MP3 player.
What is required is a user interface that provides for a user friendly and efficient retrieval of stored multimedia asset files in a portable multimedia asset player.
SUMMARY OF THE INVENTION
The invention described herein pertains to a user interface that provides for a user friendly and efficient retrieval of stored multimedia asset files. In one embodiment, a method of assisting user interaction with a multimedia asset player by way of a hierarchically ordered user interface is described. A first order user interface having a first list of user selectable items is displayed and a user selection of one of the user selectable items is received. Based upon the user selection, automatically transitioning to and displaying a second order user interface.
In a portable media asset player, a method of selecting and playing a media asset from a group of media assets stored therein is described. A first user interface is displayed on the portable media asset player having a first number of items each of which is associated with a particular grouping of the stored media assets. A selection of one of the first number of items is received and based upon the selected one of the first number of items, automatically transitioning to a second user interface displayed on the portable media asset player that includes a second number of items each of which is associated with the selected item.
In a portable, pocket-sized multimedia asset player, a method of selecting and playing a multimedia asset from a group of multimedia assets stored therein is described. At a home interface, displaying a playlist list item which points to a number of playlists stored in the multimedia asset player, wherein each playlist is a user customizable group of multimedia asset files, an artists item corresponding to all of a number of artists each of which is associated with at least one of the stored multimedia asset, and a songs list item associated with each of the stored multimedia assets. Highlighting a desired one of the playlist list item, the artists item, or the songs list item, selecting the highlighted item, and automatically transitioning to a second interface based upon the selected item.
In a portable, pocket-sized multimedia asset player, a hierarchically ordered graphical user interface accessible to a user suitable for receiving user supplied inputs that facilitate selecting a multimedia asset stored therein. A first order interface having a first number of user selectable items, a user activated first selection tool suitable for selecting at least one of the first number of user selectable items, a second order interface having a second number of user selectable items based upon the selected at least one of the first number of user selectable items, and a user activated second selection tool suitable for selecting at least one of the second number of user selectable items, wherein when the first selection tool selects the at least one of the first number of user selectable items, the first order interface automatically transitions to the second order interface.



BRIEF DESCRIPTION OF THE DRAWINGS
The invention will be better understood by reference to the following description taken in conjunction with the accompanying drawings.
FIG. 1 shows an exemplary portable multimedia device 100 in accordance with an embodiment of the invention.
FIG. 2 illustrates a hierarchically ordered menu corresponding to stored media assets in accordance with an embodiment of the invention.
FIG. 3 shows a flowchart illustrating a particular process for selecting a particular one of a group of stored media assets in accordance with an embodiment of the invention.
FIG. 4 shows a state diagram of a user interface suitable for providing user provided input for an exemplary MP3 player (along the lines of the player 100) in accordance with an embodiment of the invention.
FIGS. 5A-5E illustrate various exemplary user interfaces consistent with selection and play of a media asset in accordance with an embodiment of the invention.



DETAILED DESCRIPTION OF SELECTED EMBODIMENTS
Reference will now be made in detail to a preferred embodiment of the invention. An example of the preferred embodiment is illustrated in the accompanying drawings. While the invention will be described in conjunction with a preferred embodiment, it will be understood that it is not intended to limit the invention to one preferred embodiment. To the contrary, it is intended to cover alternatives, modifications, and equivalents as may be included within the spirit and scope of the invention as defined by the appended claims.
With the rapid advancement in the ability to store data, multimedia asset players, such as MP3 players, can accommodate hundreds or even thousands of such assets, such as MP3 files, making the task of selecting, grouping, or retrieving a particular file, or files, a daunting task indeed. Therefore the invention described herein is well suited for providing a user friendly and efficient user interface for retrieving media assets for use in a portable multimedia asset player. In the described embodiment, the multimedia asset player takes the form of a pocket sized, portable MP3 player. Accordingly, a method and apparatus for providing user supplied inputs to the MP3 player are described. Such user supplied inputs can include user supplied commands directed at retrieving specific files, such as digitized audio files in the form of, for example, MP3 files.
In one embodiment, a hierarchically ordered graphical user interface are provided that facilitates a user file selection procedure. In this particular embodiment, a first order (sometimes referred to as a home interface) provides a highest order of user selectable items each of which, when selected, results in an automatic transition to a lower order user interface associated with the selected item. In one of the described embodiments, the lower order interface includes other user selectable items associated with the previously selected item from the higher order user interface. In this way, a user can automatically transition from a higher order interface to a lower order interface (and vice versa) by, in some cases, a direct transition. In other cases, the user can transition from the higher order user interface to the lower order user interface (and vice versa) in a step wise fashion whereby each intervening interface is displayed having any number of user selectable input items each directly associated with the previously selected input item.
In a particular embodiment, the portable multimedia device is a pocket sized, multimedia device (personal digital assistants, personal MP3 player/recorders, and the like) having a display screen arranged to display the various user interfaces and a corresponding user input device. The user input device is typically a manually operated switch, button, wheels, or other such contrivances. Accordingly, the invention will now be described in terms a portable multimedia asset player capable of storing a number of multimedia assets. For example, in the case of the multimedia asset player being an MP3 player (such as the IPODTM player manufactured by the Apple Computer Inc. of Cupertino, Calif.), the multimedia assets can include MP3 files as well as any other appropriately formatted data files.
Accordingly, FIG. 1 shows an exemplary portable multimedia device, or media player, 100 in accordance with an embodiment of the invention. The media player 100 includes a processor 102 that pertains to a microprocessor or controller for controlling the overall operation of the media player 100. The media player 100 stores media data pertaining to media assets in a file system 104 and a cache 106. The file system 104 is, typically, a storage disk or a plurality of disks. The file system 104 typically provides high capacity storage capability for the media player 100. However, since the access time to the file system 104 is relatively slow, the media player 100 can also include a cache 106. The cache 106 is, for example, Random-Access Memory (RAM) provided by semiconductor memory. The relative access time to the cache 106 is substantially shorter than for the file system 104. However, the cache 106 does not have the large storage capacity of the file system 104. Further, the file system 104, when active, consumes more power than does the cache 106. The power consumption is particularly important when the media player 100 is a portable media player that is powered by a battery (not shown). The media player 100 also includes a RAM 120 and a Read-Only Memory (ROM) 122. The ROM 122 can store programs, utilities or processes to be executed in a non-volatile manner. The RAM 120 provides volatile data storage, such as for the cache 106.
The media player 100 also includes a user input device 108 that allows a user of the media player 100 to interact with the media player 100. For example, the user input device 108 can take a variety of forms, such as a button, keypad, dial, etc. Still further, the media player 100 includes a display 110 (screen display) that can be controlled by the processor 102 to display information to the user. A data bus 311 can facilitate data transfer between at least the file system 104, the cache 106, the processor 102, and the CODEC 110. The media player 100 also includes a bus interface 116 that couples to a data link 118. The data link 118 allows the media player 100 to couple to a host computer.
In one embodiment, the media player 100 serves to store a plurality of media assets (e.g., songs) in the file system 104. When a user desires to have the media player play a particular media item, a list of available media assets is displayed on the display 110. Then, using the user input device 108, a user can select one of the available media assets. The processor 102, upon receiving a selection of a particular media item, supplies the media data (e.g., audio file) for the particular media item to a coder/decoder (CODEC) 110. The CODEC 110 then produces analog output signals for a speaker 114. The speaker 114 can be a speaker internal to the media player 100 or external to the media player 100. For example, headphones or earphones that connect to the media player 100 would be considered an external speaker.
For example, in a particular embodiment, the available media assets are arranged in a hierarchical manner based upon a selected number and type of groupings appropriate to the available media assets. For example, in the case where the media player 100 is an MP3 type media player, the available media assets take the form of MP3 files (each of which corresponds to a digitally encoded song or other audio rendition) stored at least in part in the file system 104. The available media assets (or in this case, songs) can be grouped in any manner deemed appropriate. In one arrangement, the songs can be arranged hierarchically as a list of music genres at a first level, a list of artists associated with each genre at a second level, a list of albums for each artist listed in the second level at a third level, while at a fourth level a list of songs for each album listed in the third level, and so on.
Accordingly, FIG. 2 illustrates an hierarchically ordered menu 200 used to navigate through those stored media assets of interest to a user in accordance with an embodiment of the invention. It should be noted that in the described embodiment, the menu 200 is navigated by the user scrolling vertically within a particular level in order to peruse and eventually select a particular item located within that level. Once selected, the menu 200 is automatically transitioned in a horizontal manner to a lower order interface associated with the selected item. For example, at a first level, a list of music genres 202 (ROCK, JAZZ, HIP HOP) corresponding to the available MP3 files is displayed. In order to select a particular music genre, a user scrolls “vertically down” the list 202 (usually accompanied by a pointer such as an arrow or by highlighting the adjacent item) until a desired input item is reached. Upon selecting a particular music genre (ROCK, for example), an automatic horizontal traversal 203 to a lower order interface 204 that includes a display of a list of ROCK artists 204a corresponding to the selected ROCK genre. Again after scrolling in a vertical direction in the ROCK artists list 204a, a user selects a particular one of the listed ROCK artists included in the list 204a resulting in another automatic horizontal traversal 205 to a lower order interface 206 denoting an album 206a (from a list of albums 206, if appropriate) associated with the selected artist. This procedure is continued until a particular song 208a from a list of songs 208 (included in the selected album) is selected. Once selected, the song 208a is then ready for play as described at a play song interface 210 that can in some cases include information related to the selected song 208a. 
FIG. 3 shows a flowchart 300 illustrating a particular process 300 for selecting a particular one of a group of stored media assets in accordance with an embodiment of the invention. Accordingly, at 302, a first order user interface is displayed having a list of first order user selectable items. In the example of FIG. 2, the first order user interface is the list of genres 202 whereas the first order user selectable items correspond to the various genres listed. Next, at 304, at least one of the user selectable items are selected and subsequently, at 306, an automatic transition to and substantially simultaneous display of a lower order user interface corresponding to the selected item. At 308, a determination is made whether or not there are additional order user interfaces based upon the latest selected item. For example, from FIG. 2 above, selection of the Rock genre from the list 202 initiates the automatic transition to the lower order user interface and substantially simultaneous display of the list of ROCK artists 204a. This process continues until a lowest order interface (i.e., the Play Song display 210) is reached at which point the selection process ends and the selected multimedia asset is played.
FIG. 4 shows a state diagram 400 of a user interface suitable for providing user provided input for an exemplary MP3 player (along the lines of the player 100) in accordance with an embodiment of the invention. It should be noted that for sake of simplicity, only a single selection path is shown corresponding to a single selection item (i.e., Artists). Accordingly, a home interface 402 provides a list that includes a PLAYLIST item 404, an ARTISTS item 406, and a SONGS item 408 each of which is selectable by a user. It should be noted that each item is associated with a particular grouping of the multi-media assets (which in this example are MP3 files) stored at least in the file system 104. For example, the PLAYLIST item 404 is associated with a number of customizable playlists (i.e., a compendium of artists, songs, albums, etc. in any order and grouping as deemed appropriate) whereas the ARTISTS item 406 is associated with particular artists whose songs are stored in the file system 104 and so on.
Therefore, once a user selects either the PLAYLIST item 404, the ARTISTS item 406, or the SONGS item 408, an automatic transition to a lower order user interface occurs corresponding to the selected item. For example, if the user selects the ARTISTS item 406, an automatic transition 410 to the ARTISTS user interface 412 occurs that concurrently displays an ALL item 414 (associated with all artists) and a list of specific artists 416. It should be noted that, although not shown, if the user had selected a particular song from the list of songs associated with the SONGS item 408, then the display would automatically transition directly to a now playing interface (not shown) indicating that the selected song is playing (or is prepared to be played) along with any other data or information deemed appropriate.
Once in the ARTISTS user interface 412, the user has the option of selecting a particular artist by selecting a desired artist from the list of specific artists 416 or selecting all artists by invoking the ALL item 414. For example, if the user selects all artists by invoking the ALL item 414, an automatic transition to a lower order ALBUMS interface 418 occurs that concurrently displays an ALL item 420 corresponding to all songs of all artists and a list of specific albums for all artists 422. If, for example, the user selected a specific album from the list of specific albums 422, then an automatic transition to a still lower order interface ALL SONGS 424 occurs that displays a list of all songs of the selected album 426. At this point, when the user selects a particular song, an automatic transition to a now playing interface 428 occurs having a song information display 430 consistent with the selected song.
If, on the other hand, had the user had invoked the ALL item 420 in the ALBUMS interface 418, then songs interface 424 would display a list of all songs 432 of all the artists. At this point, the user could select a particular song from the list of all songs 432 resulting in an automatic transition to the now playing interface 428 having a song information display 430 consistent with the selected song.
A similar procedure can be followed in the case where instead of invoking the ALL item 414, the user had selected a particular artist from the list of artists 416. In this case, the act of selecting a particular artist initiates an automatic transition to a selected artist interface 436 that includes an ALL item 438 that points to all songs of the selected artist stored in the MP3 player and a list of all albums of the selected artist 440 that are stored in the MP3 player. Selecting one of the albums from the list of albums 440 results in an automatic transition to the songs interface 424 that includes a list of all songs associated with the selected album 442. On the other hand, invoking the ALL item 438 results in an automatic transition to the songs interface 424 having a list of all songs of the selected artist 444. Once in the songs interface 424, the user is free to select any song listed for play at the now playing interface 428. For example, selecting one of the songs listed in list of all songs of selected artist 444 or from the list of all songs of selected album 442 results in an automatic transition to the now playing interface 428 simultaneously with the display of song information displays 446 and 448, respectively.
It should be noted that the procedure described above is pathwise bi-directional in that the user can go in either direction along a selected path. It should be further noted, that in some embodiments, it is desirable to directly transition from the now playing interface 428 to the home interface 402 (and vice-versa) without displaying any of the intervening interfaces.
FIGS. 5A-5E illustrate various exemplary user interfaces consistent with selection and play of a media asset in accordance with an embodiment of the invention. One should note that the various user interfaces illustrated in FIGS. 5A-5F correspond to particular embodiments of the HOME interface 402, the ARTISTS interface 412, the ALBUMS interface 418, the SONGS interface 424, and the NOW PLAYING interface 428 described above. Accordingly, it should be further noted that each of the interfaces described are incorporated into a representative media player 500 having a display 502 and a user input device 504 that includes a central button 506, a selector wheel 508, and selectors 510-516. It is well to note that in this particular embodiment, the selectors 510-516 are a back up one level 510, a rewind 512, a play/pause 514, and a fast forward 516. Accordingly, FIG. 5A shows a particular implementation of the HOME interface 402 displayed on the display 502. In order to select the ARTISTS item 406, the user rotates selector wheel 508 in either a clockwise or counterclockwise direction (or any appropriate combination thereof) until the ARTISTS item 406 is rendered selectable (as noted by a semi-transparent highlight bar 518). Once the desired item is highlighted, the user selects the highlighted item by invoking a selection protocol by, for example, pressing the central button 506. Once selected, the HOME interface 402 immediately transitions to the ARTISTS interface 412 as shown in FIG. 5B. As with the selection in the HOME interface 402 of the ARTISTS item 406, a particular artist (or all artists) is selected by manipulating any of the user input devices 504 (such as the selector wheel 508) in combination with an appropriate selection event which can include pressing the central button 506. In this way, the user is provided the capability of navigating the user input menu in any manner that the user deems to be most convenient and efficient. It should be noted that a stack indicator bar 520 indicates the relative position of the selected item in relation to the stack of items associated with the particular selected group. Accordingly, FIGS. 5C-5E show various exemplary user interfaces consistent with the described embodiment of the invention.
While this invention has been described in terms of a preferred embodiment, there are alterations, permutations, and equivalents that fall within the scope of this invention. It should also be noted that there are many alternative ways of implementing both the process and apparatus of the present invention. It is therefore intended that the invention be interpreted as including all such alterations, permutations, and equivalents as fall within the true spirit and scope of the present invention.

## Claims

1. A pocket-sized device comprising:
a display screen configured to display a graphical user interface comprising a group of items, and
an input device comprising a first surface of the pocket-sized device and a second surface of the pocket-sized device, the first surface surrounding the second surface,
wherein the pocket-sized device is configured to
scroll through each item of the group of items in different directions in response to different rotational inputs from a user received by the input device on the first surface,
invoke a selection protocol in response to a press input from a user received by the input device on the second surface, and
scroll through each item of the group of items in different directions in response to different press inputs from a user received by the input device.

2. A pocket-sized device comprising:
a display screen configured to display a graphical user interface, the graphical user interface comprising a group of media assets and an indicator bar, the indicator bar indicating a relative position of a highlighted media asset in relation to the group of media assets, and
an input device comprising a closed loop and a central button centrally located on the input device,
wherein the pocket-sized device is configured to
scroll through each media asset of the group of media assets in different directions in response to different rotational inputs from a user received by the input device on the closed loop,
invoke a selection protocol in response to a press input from a user received by the input device on the central button, and
scroll through each media asset of the group of media assets in different directions in response to different press inputs from a user received by the input device.

3. The pocket-sized device of claim 1, wherein the input device comprises multiple buttons and a closed loop.

4. The pocket-sized device of claim 3, wherein the multiple buttons comprise a central button centrally located on the input device.

5. The pocket-sized device of claim 4, wherein the press input to invoke the selection protocol is received by the central button.

6. The pocket-sized device of claim 4, wherein the press input to scroll through the group of items is received by one of the multiple buttons.

7. The pocket-sized device of claim 3, wherein the rotational input is received by the closed loop.

8. The pocket-sized device of claim 3, wherein the closed loop comprises a wheel.

9. The pocket-sized device of claim 1, wherein the pocket-sized device is configured to scroll through the group of items in a vertical direction.

10. The pocket-sized device of claim 1, wherein the pocket-sized device is configured to transition along a path of user-selected items in a bi-directional manner.

11. The pocket-sized device of claim 1, wherein the pocket-sized device is configured to transition from a first order interface displaying an item to a lower order interface associated with the item in response to a selection of the item by the user.

12. The pocket-sized device of claim 1, wherein the graphical user interface comprises an indicator bar to indicate a relative position of a highlighted item in relation to the group of items.

13. The pocket-sized device of claim 1, wherein the items correspond to media assets.

14. The pocket-sized device of claim 13, wherein the media assets are stored on the pocket-sized device.

15. The pocket-sized device of claim 13, wherein the media assets comprise audio files.

16. The pocket-sized device of claim 13, wherein the audio files comprise songs.

17. The pocket-sized device of claim 2, wherein the closed loop comprises a wheel.

18. The pocket-sized device of claim 2, wherein the input device comprises multiple buttons.

19. The pocket-sized device of claim 2, wherein the press input to scroll through the group of media assets is received by one of the multiple buttons.

20. The pocket-sized device of claim 2, wherein the pocket-sized device is configured to scroll through the group of media assets in a vertical direction.

21. The pocket-sized device of claim 2, wherein the pocket-sized device is configured to transition along a path of user-selected items corresponding to a media asset in a bi-directional manner.

22. The pocket-sized device of claim 2, wherein the pocket-sized device is configured to transition from a first order interface displaying an item corresponding to a media asset to a lower order interface associated with the item in response to a selection of the item by the user.

23. The pocket-sized device of claim 2, wherein the media assets are stored on the pocket-sized device.

24. The pocket-sized device of claim 2, wherein the media assets comprise audio files.

25. The pocket-sized device of claim 2, wherein the audio files comprise songs.