# Patent

## Title
Graphical user interface and methods of use thereof in a multimedia player

## Abstract

In a portable multimedia device, a method, apparatus, and system for providing user supplied configuration data are described. In one embodiment, a hierarchically ordered graphical user interface is provided. A first order, or home, interface provides a highest order of user selectable items each of which, when selected, results in an automatic transition to a lower order user interface associated with the selected item. In one of the described embodiments, the lower order interface includes other user selectable items associated with the previously selected item from the higher order user interface.

## Background
CROSS REFERENCE TO RELATED APPLICATIONS
This application is a continuation of U.S. patent application Ser. No. 10/282,861, entitled “GRAPHICAL USER INTERFACE AND METHODS OF USE THEREOF IN A MULTIMEDIA PLAYER”, filed Oct. 28, 2002, now U.S. Pat. No. 7,166,791 which is incorporated herein by reference, and which, in turn, claims the benefit of priority under 35 U.S.C. § 119(e) to U.S. Provisional Patent Application No. 60/399,806, entitled “GRAPHICAL USER INTERFACE AND METHODS OF USE THEREOF IN A MULTIMEDIA PLAYER”, filed on Jul. 30, 2002, which is incorporated herein by reference.


BACKGROUND OF THE INVENTION
1. Field of Invention
This invention relates generally to multimedia devices. More specifically, the invention describes a graphical user interface for use in a multimedia asset player suitable for providing any number and kind of user supplied inputs.
2. Description of Related Art
Recent developments in consumer electronics have included the introduction of portable multimedia asset player devices such as MP3 players, minidisk players, and the like. For example, in the case of an MP3 player, a number of digitized audio files in the form of MP3 files are stored in a storage medium included in or coupled to the player in a fashion deemed most suitable to that user. In the case of MP3 files, for example, a user of the MP3 player must be able to peruse and select a particular file, or files, based upon such characteristics as music genre, author, album, or whatever grouping of MP3 files is present in the MP3 player.
What is required is a user interface that provides for a user friendly and efficient retrieval of stored multimedia asset files in a portable multimedia asset player.
SUMMARY OF THE INVENTION
The invention described herein pertains to a user interface that provides for a user friendly and efficient retrieval of stored multimedia asset files. The invention can be implemented in numerous ways. Several embodiments of the invention are discussed below.
As a method of assisting user interaction with a multimedia asset player by way of a pathwise bi-directional user interface, one embodiment of the invention includes at least the acts of: displaying a first order user interface having a first list of user selectable items each of which points to at least one second list of user selectable items; receiving a user selection of one of the user selectable items from the first list; and automatically transitioning to and displaying a second order user interface based upon the selected one of the user selectable items from the first list, the second order user interface having the second list of user selectable items pointed to by the selected one of the user selectable items from the first list. Each of the user selectable items in the second list points back to the corresponding one of the user selectable items in the first list and points forward to at least one user selectable item in a third list of user selectable items displayed by a corresponding third order user interface.
As a pathwise bi-directional method of selecting a desired multimedia asset from a number of multimedia assets stored in a multimedia asset player, one embodiment of the invention includes at least the acts of: displaying a first order user interface having a first set of user selectable items each of which points to a second set of other user selectable items displayed on a second order user interface; receiving a user navigation input with respect to the first set of user selectable items to identify one of the user selectable items of the first set, the user navigation input being associated with a rotational user action with respect to a user input device of the multimedia asset player; accepting the identified one of the user selectable items of the first set; automatically transitioning to and displaying the second set of user selectable items each of which points back to the identified one of the user selectable items of the first set and points forward to a third order user interface; and receiving and acting upon at least one additional user input until a desired multimedia asset is selected.
As a portable media player, one embodiment of the invention includes at least the acts of: a storage device that stores media content for each of a plurality of media items; a display screen that displays one of a plurality of hierarchically ordered sets of user selectable items; a user input device that enables a user to interact with the one of more of the hierarchically ordered sets of user selectable items being displayed on the display screen; and a processor operatively connected to the storage device and the user input device. The processor controls the portable media player to facilitate user navigation through the one of more of the hierarchically ordered sets of user selectable items to select a particular media item to be played, and then to play the media content of the particular media item that was selected. In facilitating user navigation through the one of more of the hierarchically ordered sets of user selectable items, the processor operates to (i) display, on the display screen, a first order user interface having a first list of user selectable items each of which points to at least one second list of user selectable items; (ii) receive, via the user input device, a user selection of one of the user selectable items from the first list; and (iii) automatically transitioning to and displaying, on the display screen, a second order user interface based upon the selected one of the user selectable items from the first list, the second order user interface having the second list of user selectable items pointed to by the selected one of the user selectable items from the first list.



BRIEF DESCRIPTION OF THE DRAWINGS
The invention will be better understood by reference to the following description taken in conjunction with the accompanying drawings.
FIG. 1 shows an exemplary portable multimedia device 100 in accordance with an embodiment of the invention.
FIG. 2 illustrates a hierarchically ordered menu corresponding to stored media assets in accordance with an embodiment of the invention.
FIG. 3 shows a flowchart illustrating a particular process for selecting a particular one of a group of stored media assets in accordance with an embodiment of the invention.
FIG. 4 shows a state diagram of a user interface suitable for providing user provided input for an exemplary MP3 player (along the lines of the player 100) in accordance with an embodiment of the invention.
FIGS. 5A-5E illustrate various exemplary user interfaces consistent with selection and play of a media asset in accordance with an embodiment of the invention.



DETAILED DESCRIPTION OF SELECTED EMBODIMENTS
Reference will now be made in detail to a preferred embodiment of the invention. An example of the preferred embodiment is illustrated in the accompanying drawings. While the invention will be described in conjunction with a preferred embodiment, it will be understood that it is not intended to limit the invention to one preferred embodiment. To the contrary, it is intended to cover alternatives, modifications, and equivalents as may be included within the spirit and scope of the invention as defined by the appended claims.
With the rapid advancement in the ability to store data, multimedia asset players, such as MP3 players, can accommodate hundreds or even thousands of such assets, such as MP3 files, making the task of selecting, grouping, or retrieving a particular file, or files, a daunting task indeed. Therefore the invention described herein is well suited for providing a user friendly and efficient user interface for retrieving media assets for use in a portable multimedia asset player. In the described embodiment, the multimedia asset player takes the form of a pocket sized, portable MP3 player. Accordingly, a method and apparatus for providing user supplied inputs to the MP3 player are described. Such user supplied inputs can include user supplied commands directed at retrieving specific files, such as digitized audio files in the form of, for example, MP3 files.
In one embodiment, a hierarchically ordered graphical user interface are provided that facilitates a user file selection procedure. In this particular embodiment, a first order (sometimes referred to as a home interface) provides a highest order of user selectable items each of which, when selected, results in an automatic transition to a lower order user interface associated with the selected item. In one of the described embodiments, the lower order interface includes other user selectable items associated with the previously selected item from the higher order user interface. In this way, a user can automatically transition from a higher order interface to a lower order interface (and vice versa) by, in some cases, a direct transition. In other cases, the user can transition from the higher order user interface to the lower order user interface (and vice versa) in a step wise fashion whereby each intervening interface is displayed having any number of user selectable input items each directly associated with the previously selected input item.
In a particular embodiment, the portable multimedia device is a pocket sized, multimedia device (personal digital assistants, personal MP3 player/recorders, and the like) having a display screen arranged to display the various user interfaces and a corresponding user input device. The user input device is typically a manually operated switch, button, wheels, or other such contrivances. Accordingly, the invention will now be described in terms a portable multimedia asset player capable of storing a number of multimedia assets. For example, in the case of the multimedia asset player being an MP3 player (such as the iPod® player manufactured by the Apple Computer Inc. of Cupertino, Calif.), the multimedia assets can include MP3 files as well as any other appropriately formatted data files.
Accordingly, FIG. 1 shows an exemplary portable multimedia device, or media player, 100 in accordance with an embodiment of the invention. The media player 100 includes a processor 102 that pertains to a microprocessor or controller for controlling the overall operation of the media player 100. The media player 100 stores media data pertaining to media assets in a file system 104 and a cache 106. The file system 104 is, typically, a storage disk or a plurality of disks. The file system 104 typically provides high capacity storage capability for the media player 100. However, since the access time to the file system 104 is relatively slow, the media player 100 can also include a cache 106. The cache 106 is, for example, Random-Access Memory (RAM) provided by semiconductor memory. The relative access time to the cache 106 is substantially shorter than for the file system 104. However, the cache 106 does not have the large storage capacity of the file system 104. Further, the file system 104, when active, consumes more power than does the cache 106. The power consumption is particularly important when the media player 100 is a portable media player that is powered by a battery (not shown). The media player 100 also includes a RAM 120 and a Read-Only Memory (ROM) 122. The ROM 122 can store programs, utilities or processes to be executed in a non-volatile manner. The RAM 120 provides volatile data storage, such as for the cache 106.
The media player 100 also includes a user input device 108 that allows a user of the media player 100 to interact with the media player 100. For example, the user input device 108 can take a variety of forms, such as a button, keypad, dial, etc. Still further, the media player 100 includes a display 110 (screen display) that can be controlled by the processor 102 to display information to the user. A data bus 311 can facilitate data transfer between at least the file system 104, the cache 106, the processor 102, and the CODEC 110. The media player 100 also includes a bus interface 116 that couples to a data link 118. The data link 118 allows the media player 100 to couple to a host computer.
In one embodiment, the media player 100 serves to store a plurality of media assets (e.g., songs) in the file system 104. When a user desires to have the media player play a particular media item, a list of available media assets is displayed on the display 110. Then, using the user input device 108, a user can select one of the available media assets. The processor 102, upon receiving a selection of a particular media item, supplies the media data (e.g., audio file) for the particular media item to a coder/decoder (CODEC) 110. The CODEC 110 then produces analog output signals for a speaker 114. The speaker 114 can be a speaker internal to the media player 100 or external to the media player 100. For example, headphones or earphones that connect to the media player 100 would be considered an external speaker.
For example, in a particular embodiment, the available media assets are arranged in a hierarchical manner based upon a selected number and type of groupings appropriate to the available media assets. For example, in the case where the media player 100 is an MP3 type media player, the available media assets take the form of MP3 files (each of which corresponds to a digitally encoded song or other audio rendition) stored at least in part in the file system 104. The available media assets (or in this case, songs) can be grouped in any manner deemed appropriate. In one arrangement, the songs can be arranged hierarchically as a list of music genres at a first level, a list of artists associated with each genre at a second level, a list of albums for each artist listed in the second level at a third level, while at a fourth level a list of songs for each album listed in the third level, and so on.
Accordingly, FIG. 2 illustrates an hierarchically ordered menu 200 used to navigate through those stored media assets of interest to a user in accordance with an embodiment of the invention. It should be noted that in the described embodiment, the menu 200 is navigated by the user scrolling vertically within a particular level in order to peruse and eventually select a particular item located within that level. Once selected, the menu 200 is automatically transitioned in a horizontal manner to a lower order interface associated with the selected item. For example, at a first level, a list of music genres 202 (ROCK, JAZZ, HIP HOP) corresponding to the available MP3 files is displayed. In order to select a particular music genre, a user scrolls “vertically down” the list 202 (usually accompanied by a pointer such as an arrow or by highlighting the adjacent item) until a desired input item is reached. Upon selecting a particular music genre (ROCK, for example), an automatic horizontal traversal 203 to a lower order interface 204 that includes a display of a list of ROCK artists 204a corresponding to the selected ROCK genre. Again after scrolling in a vertical direction in the ROCK artists list 204a, a user selects a particular one of the listed ROCK artists included in the list 204a resulting in another automatic horizontal traversal 205 to a lower order interface 206 denoting an album 206a (from a list of albums 206, if appropriate) associated with the selected artist. This procedure is continued until a particular song 208a from a list of songs 208 (included in the selected album) is selected. Once selected, the song 208a is then ready for play as described at a play song interface 210 that can in some cases include information related to the selected song 208a. 
FIG. 3 shows a flowchart 300 illustrating a particular process 300 for selecting a particular one of a group of stored media assets in accordance with an embodiment of the invention. Accordingly, at 302, a first order user interface is displayed having a list of first order user selectable items. In the example of FIG. 2, the first order user interface is the list of genres 202 whereas the first order user selectable items correspond to the various genres listed. Next, at 304, at least one of the user selectable items are selected and subsequently, at 306, an automatic transition to and substantially simultaneous display of a lower order user interface corresponding to the selected item. At 308, a determination is made whether or not there are additional order user interfaces based upon the latest selected item. For example, from FIG. 2 above, selection of the Rock genre from the list 202 initiates the automatic transition to the lower order user interface and substantially simultaneous display of the list of ROCK artists 204a. This process continues until a lowest order interface (i.e., the Play Song display 210) is reached at which point the selection process ends and the selected multimedia asset is played.
FIG. 4 shows a state diagram 400 of a user interface suitable for providing user provided input for an exemplary MP3 player (along the lines of the player 100) in accordance with an embodiment of the invention. It should be noted that for sake of simplicity, only a single selection path is shown corresponding to a single selection item (i.e., Artists). Accordingly, a home interface 402 provides a list that includes a PLAYLIST item 404, an ARTISTS item 406, and a SONGS item 408 each of which is selectable by a user. It should be noted that each item is associated with a particular grouping of the multi-media assets (which in this example are MP3 files) stored at least in the file system 104. For example, the PLAYLIST item 404 is associated with a number of customizable playlists (i.e., a compendium of artists, songs, albums, etc. in any order and grouping as deemed appropriate) whereas the ARTISTS item 406 is associated with particular artists whose songs are stored in the file system 104 and so on.
Therefore, once a user selects either the PLAYLIST item 404, the ARTISTS item 406, or the SONGS item 408, an automatic transition to a lower order user interface occurs corresponding to the selected item. For example, if the user selects the ARTISTS item 406, an automatic transition 410 to the ARTISTS user interface 412 occurs that concurrently displays an ALL item 414 (associated with all artists) and a list of specific artists 416. It should be noted that, although not shown, if the user had selected a particular song from the list of songs associated with the SONGS item 408, then the display would automatically transition directly to a now playing interface (not shown) indicating that the selected song is playing (or is prepared to be played) along with any other data or information deemed appropriate.
Once in the ARTISTS user interface 412, the user has the option of selecting a particular artist by selecting a desired artist from the list of specific artists 416 or selecting all artists by invoking the ALL item 414. For example, if the user selects all artists by invoking the ALL item 414, an automatic transition to a lower order ALBUMS interface 418 occurs that concurrently displays an ALL item 420 corresponding to all songs of all artists and a list of specific albums for all artists 422. If, for example, the user selected a specific album from the list of specific albums 422, then an automatic transition to a still lower order interface ALL SONGS 424 occurs that displays a list of all songs of the selected album 426. At this point, when the user selects a particular song, an automatic transition to a now playing interface 428 occurs having a song information display 430 consistent with the selected song.
If, on the other hand, had the user had invoked the ALL item 420 in the ALBUMS interface 418, then songs interface 424 would display a list of all songs 432 of all the artists. At this point, the user could select a particular song from the list of all songs 432 resulting in an automatic transition to the now playing interface 428 having a song information display 430 consistent with the selected song.
A similar procedure can be followed in the case where instead of invoking the ALL item 414, the user had selected a particular artist from the list of artists 416. In this case, the act of selecting a particular artist initiates an automatic transition to a selected artist interface 436 that includes an ALL item 438 that points to all songs of the selected artist stored in the MP3 player and a list of all albums of the selected artist 440 that are stored in the MP3 player. Selecting one of the albums from the list of albums 440 results in an automatic transition to the songs interface 424 that includes a list of all songs associated with the selected album 442. On the other hand, invoking the ALL item 438 results in an automatic transition to the songs interface 424 having a list of all songs of the selected artist 444. Once in the songs interface 424, the user is free to select any song listed for play at the now playing interface 428. For example, selecting one of the songs listed in list of all songs of selected artist 444 or from the list of all songs of selected album 442 results in an automatic transition to the now playing interface 428 simultaneously with the display of song information displays 446 and 448, respectively.
It should be noted that the procedure described above is pathwise bi-directional in that the user can go in either direction along a selected path. It should be further noted, that in some embodiments, it is desirable to directly transition from the now playing interface 428 to the home interface 402 (and vice-versa) without displaying any of the intervening interfaces.
FIGS. 5A-5E illustrate various exemplary user interfaces consistent with selection and play of a media asset in accordance with an embodiment of the invention. One should note that the various user interfaces illustrated in FIGS. 5A-5E correspond to particular embodiments of the HOME interface 402, the ARTISTS interface 412, the ALBUMS interface 418, the SONGS interface 424, and the NOW PLAYING interface 428 described above. Accordingly, it should be further noted that each of the interfaces described are incorporated into a representative media player 500 having a display 502 and a user input device 504 that includes a central button 506, a selector wheel 508, and selectors 510-516. It is well to note that in this particular embodiment, the selectors 510-516 are a back up one level 510, a rewind 512, a play/pause 514, and a fast forward 516. Accordingly, FIG. 5A shows a particular implementation of the HOME interface 402 displayed on the display 502. In order to select the ARTISTS item 406, the user rotates selector wheel 508 in either a clockwise or counterclockwise direction (or any appropriate combination thereof) until the ARTISTS item 406 is rendered selectable (as noted by a semi-transparent highlight bar 518). Once the desired item is highlighted, the user selects the highlighted item by invoking a selection protocol by, for example, pressing the central button 506. Once selected, the HOME interface 402 immediately transitions to the ARTISTS interface 412 as shown in FIG. 5B. As with the selection in the HOME interface 402 of the ARTISTS item 406, a particular artist (or all artists) is selected by manipulating any of the user input devices 504 (such as the selector wheel 508) in combination with an appropriate selection event which can include pressing the central button 506. In this way, the user is provided the capability of navigating the user input menu in any manner that the user deems to be most convenient and efficient. It should be noted that a stack indicator bar 520 indicates the relative position of the selected item in relation to the stack of items associated with the particular selected group. For example, if the. Accordingly, FIGS. 5C-5E show various exemplary user interfaces consistent with the described embodiment of the invention.
While this invention has been described in terms of a preferred embodiment, there are alterations, permutations, and equivalents that fall within the scope of this invention. It should also be noted that there are many alternative ways of implementing both the process and apparatus of the present invention. It is therefore intended that the invention be interpreted as including all such alterations, permutations, and equivalents as fall within the true spirit and scope of the present invention.

## Claims

1. A method of assisting user interaction with a multimedia asset player by way of a pathwise bi-directional user interface, said method comprising:
displaying a first order user interface having a first list of user selectable items each of at least a plurality of which points to at least another list of user selectable items;
receiving a user selection of one of the user selectable items from the first list, said receiving the user selection of one of the user selectable items from the first list including at least (i) successively highlighting one or more of the user selectable items from the first list using a rotational user action with respect to a user input device of the multimedia asset player and (ii) accepting a selection of one of the highlighted user selectable items; and
automatically transitioning to and displaying a second order user interface based upon the selected one of the user selectable items from the first list, the second order user interface having a second list of user selectable items pointed to by the selected one of the user selectable items from the first list,
wherein each of at least a plurality of the user selectable items in the second list points back to the corresponding one of the user selectable items in the first list and points forward to at least one user selectable item in a third list of user selectable items displayed by a corresponding third order user interface.

2. A method as recited in claim 1, wherein not more than one of the user selectable items in each of the first list, the second list and the third list are the same.

3. A method as recited in claim 1, wherein the first order user interface is a home interface.

4. A method as recited in claim 1, wherein the first list of user selectable items includes at least a playlists item, an artists item, and a songs item.

5. A method as recited in claim 4, wherein when the selected one of the user selectable items from the first list is the playlists item, then the second list of user selectable items being displayed in the second order user interface includes a list of playlists.

6. A method as recited in claim 4, wherein when the selected one of the user selectable items from the first list is the artists item, then the second list of user selectable items being displayed in the second order user interface includes an all artists indication and a list of particular artists.

7. A method as recited in claim 4, wherein when the selected one of the user selectable items from the first list is the songs item, then the second list of user selectable items being displayed in the second order user interface includes a list of all songs.

8. A method as recited in claim 1, wherein said method further comprises:
automatically transitioning to and displaying a fourth order user interface based upon the selected one of the user selectable items from the third list.

9. A method as recited in claim 8, wherein the fourth order user interface is a play media asset interface.

10. A method as recited in claim 9, wherein when the play media asset interface is displayed, a previously selected media asset is played on the multimedia asset player.

11. A method as recited in claim 10, wherein the fourth order user interface presents media asset information pertaining to the previously selected media asset being played.

12. A method as recited in claim 10, wherein when the previously selected media asset is a digital audio file, then the associated media asset information includes title, artist, album, and duration.

13. A method as recited in claim 1, wherein the accepting of the selection of one of user selectable items comprises receiving a button press.

14. A pathwise bi-directional method of selecting a desired multimedia asset from a number of multimedia assets stored in a multimedia asset player comprising:
(a) displaying a first order user interface having a first set of user selectable items each of which points to a second set of user selectable items displayed on a second order user interface;
(b) receiving a user navigation input with respect to the first set of user selectable items to identify one of the user selectable items of the first set, the user navigation input being associated with a rotational user action with respect to a user input device of the multimedia asset player;
(c) accepting the identified one of the user selectable items of the first set;
(d) automatically transitioning to and displaying the second set of user selectable items each of which points back to the identified one of the user selectable items of the first set and points forward to a third order user interface; and
(e) receiving and acting upon at least one additional user input until a desired multimedia asset is selected.

15. A method as recited in claim 14, wherein said receiving and acting (e) comprises:
(e1) receiving a user navigation input with respect to the second set of user selectable items to identify one of the user selectable items of the second set, the user navigation input being associated with a rotational user action with respect to the user input device of the multimedia asset player;
(e2) accepting the identified one of the user selectable items of the second set; and
(e3) automatically transitioning to and displaying the third order user interface based on the identified one of the user selectable items of the second set that has been accepted.

16. A method as recited in claim 15, wherein the third order user interface comprises a third set of user selectable items each of which points back to the identified one of the user selectable items of the second set and points forward to a fourth order user interface.

17. A method as recited in claim 15, wherein said accepting (c) and said accepting (e2) are associated with a button of the multimedia asset player.

18. A method as recited in claim 17, wherein the button is provided in an opening provided at a center of the user input device.

19. A method as recited in claim 14, wherein the multimedia asset is a digitized multimedia file.

20. A method as recited in claim 14, wherein the first set of user selectable items includes at least a playlists item, an artists item, and a songs item.

21. A method as recited in claim 20, wherein when the accepted item is the playlists item, then the second set of user selectable items includes a list of playlists, and wherein when the accepted item is the artists item, then the second set of user selectable items includes an all artists indication and a list of particular artists, and wherein when the accepted item is the songs item, then the second set includes a list of all songs stored in the multimedia asset player.

22. A method as recited in claim 14, wherein the user selectable items of the second set of user selectable items are completely different than the user selectable items of the first set of user selectable items.