PATENT DOCUMENT

Publication Number: US-8276076-B2
Application Number: US-61930209-A
Country: US
Kind Code: B2

Title: Methods and apparatus for visualizing a media library

Abstract:
Visualizing and exploring a music library using metadata, such as genre, sub-genre, artist, and year, is provided. Geometric shapes, such as disks or rectangles, may be divided into sectors representing genre and each sector may be further divided into sub-sectors representing artists associated with each genre. The sector&#39;s relative size generally reflects the importance of the corresponding genre within the library. Likewise, the sub-sector&#39;s relative size generally reflects the importance of the corresponding artist within the genre which may be determined by the number of media items of the artist. Marks representing each media item may be arranged and displayed within the geometric shape to reflect the mark&#39;s corresponding genre, artist, and year. In addition, each mark may reflect an attribute, such as playcount, of the media item and each sector may reflect the mean value of an attribute of all media items within the sector.

Claims:
1. A computer-implemented method for generating a graphical representation of a media library comprising:
 accessing a datastore of metadata that describes a set of media items, the metadata including at least first, second and third attribute values for each media item; 
 generating a visualization screen display wherein the screen display comprises a geometric shape, the geometric shape divided into a plurality of sectors, each sector representing a corresponding value of the first attribute, and each sector sized to reflect a ratio computed as the number of media items in the media library that have the first attribute value associated with the sector, divided by the total number of media items in the media library, 
 and further wherein each sector is divided into one or more sub-sectors, each sub-sector representing a corresponding value of the second attribute, and each sub-sector sized to reflect a ratio computed as the number of media items in the media library that have the second attribute value associated with the sub-sector, divided by the total number of media items in the sector; 
 in the screen display, displaying a mark for each one of the set of media items, wherein the displaying step includes; 
 locating each mark within a selected sub-sector that is associated with the first and second attribute values for the corresponding media item; and 
 positioning each mark within the selected sub-sector spaced apart from a selected point within the geometric shape by a selected distance responsive to the third attribute value of the corresponding media item. 
 
     
     
       2. A computer-implemented method according to  claim 1  wherein:
 the geometric shape of the visualization screen display is a circle; and 
 each sector of the display is a geometric sector of the circle. 
 
     
     
       3. A computer-implemented method according to  claim 2  wherein:
 the selected point in the geometric shape is the center of the circle, so that the third attribute value of a media item is represented graphically as a distance from the center of the circle. 
 
     
     
       4. A computer-implemented method according to  claim 3  wherein:
 the first attribute value for each media item in the datastore is one of a binary value, a numeric value, an n-tuple, wherein n is an integer, and a text string; 
 the second attribute value for each media item in the datastore is one of a binary value, a numeric value, an n-tuple, wherein n is an integer, and a text string; and 
 the third attribute value for each media item in the datastore is a numeric value or a date. 
 
     
     
       5. A computer-implemented method according to  claim 3  wherein:
 said positioning each mark spaced apart from the center of the circle includes positioning the mark along a radius of the circle, and locating the mark along the radius by a distance responsive to comparing the third attribute value of the mark to a range of the third attribute values of all the marks in the media item dataset. 
 
     
     
       6. A computer-implemented method according to  claim 5  wherein:
 the media items are music items; 
 one of the first and second attributes of a music item is a genre; 
 the other one of the first and second attributes of a music item is an artist; and 
 the third attribute of a music item is a date or year of release of the item. 
 
     
     
       7. A computer-implemented method according to  claim 5  wherein: the media items in the library comprise any of songs, tracks, music CDs, movies, music videos, documents, books, poems, and photographs. 
     
     
       8. A computer-implemented method according to  claim 5  wherein:
 the attributes of the media items, stored as metadata in the datastore, include one or more of title of the media item, album, style or era, tempo, musicians featured in the media item, instruments used in the media item, total number of musicians, soloing musicians, composer of the media item, producer of the media item, where the media item was recorded, whether the media item is a live performance, record company, rhythmic foundation, and melodic/harmonic development. 
 
     
     
       9. A computer-implemented method according to  claim 5  wherein:
 the attributes of the media items, stored as metadata in the datastore, include one or more of playcount, rating, last played date, and added date. 
 
     
     
       10. A non-transitory computer-readable medium storing a computer program having instructions to perform the following steps:
 accessing a datastore of metadata that describes a set of media items, the metadata including at least first, second and third attribute values for each media item; 
 generating a visualization screen display wherein the screen display comprises a geometric shape, the geometric shape divided into a plurality of sectors, each sector representing a corresponding value of the first attribute, and each sector sized to reflect a ratio computed as the number of media items in the media library that have the first attribute value associated with the sector, divided by the total number of media items in the media library, 
 and further wherein each sector is divided into one or more sub-sectors, each sub-sector representing a corresponding value of the second attribute, and each sub-sector sized to reflect a ratio computed as the number of media items in the media library that have the second attribute value associated with the sub-sector, divided by the total number of media items in the sector; 
 in the screen display, displaying a mark for each one of the set of media items, wherein the displaying step includes; 
 locating each mark within a selected sub-sector that is associated with the first and second attribute values for the corresponding media item; and 
 positioning each mark within the selected sub-sector spaced apart from a selected point within the geometric shape by a selected distance responsive to the third attribute value of the corresponding media item. 
 
     
     
       11. A non-transitory computer-readable medium according to  claim 10  wherein:
 the geometric shape of the visualization screen display is a circle; and 
 each sector of the display is a geometric sector of the circle. 
 
     
     
       12. A non-transitory computer-readable medium according to  claim 11  wherein:
 the selected point in the geometric shape is the center of the circle, so that the third attribute value of a media item is represented graphically as a distance from the center of the circle. 
 
     
     
       13. A non-transitory computer-readable medium according to  claim 10  wherein:
 the first attribute value for each media item in the datastore is one of a binary value, a numeric value, an n-tuple, wherein n is an integer, and a text string; 
 the second attribute value for each media item in the datastore is one of a binary value, a numeric value, an n-tuple, wherein n is an integer, and a text string; and 
 the third attribute value for each media item in the datastore is a numeric value or a date. 
 
     
     
       14. A non-transitory computer-readable medium according to  claim 11  wherein:
 said positioning each mark spaced apart from the center of the circle includes positioning the mark along a radius of the circle, and locating the mark along the radius by a distance responsive to comparing the third attribute value of the mark to a range of the third attribute values of all the marks in the media item dataset.

Description:
RELATED APPLICATIONS 
     This application is a continuation of co-pending U.S. application Ser. No. 11/543,730 filed Oct. 4, 2006, which claims priority from U.S. Provisional Application No. 60/723,865 filed Oct. 4, 2005, both of which are hereby incorporated by reference as though fully set forth. 
    
    
     BACKGROUND 
     This application relates to methods and apparatus for providing a graphical representation of a music library. 
     Effectively organizing a music library not only allows a user to get a sense of music contained in the library, but also helps them select and play the music. However, the popularity of digital audio encoding together with music distribution channels through the Internet have allowed users to collect hundreds or even thousands of media items. This change in scale of accessible music from the traditional album to thousands of songs makes choosing what music to listen to at a particular moment a challenge. 
     Digital media players, such as iTunes  10  of  FIG. 1  introduced by Apple Computer, Inc., Cupertino, Calif., USA, allow users to play and organize digital music and video files using textual lists. Each item of the list may be categorized by track title  12 , track length  14 , artist  16 , album  18 , year released  20 , genre  22 , and composer  24 . Track lists can be ordered alphanumerically by categories such as title  12 , artist  16 , album  18 , or genre  22  for example. Search bar  26  may be used to perform a keyword-based search by one or more category, such as artist  16 , album  18 , or track title  12 . Tracks may also be filtered using a genre filter  28 , artist filter  30 , or album filter  32 , or all three filters may be used at the same time. For example, the user can filter all tracks by (1) Jazz using genre filter  28 , (2) Billie Holiday using artist filter  30 , and (3) Lady in Satin using album filter  32 . Results from the filters are displayed in a results window  34  and may be ordered alphanumerically by one or more category, such as artist  16 , album  18 , or track title  12 . 
     Playlists are also known to help organize and manage music libraries. A playlist is a subset of a library that defines an ordered sequence of media items to be played and are usually created by adding media items to the playlist one-by-one. A smart playlist follows a set of logical filtering criteria, such as all jazz from 1970 that were played in the last six months. Playlists may be generated in iTunes  10  using two different methods: (1) adding media items manually in a one-by-one manner; and (2) defining filtering criteria, such as artist  16 , album  18 , or track title  12 , to create smart playlist  36 . The smart playlist may automatically update when new media items are added to the library. 
     Playlists are also known to be automatically generable. PATS: Realization and User Evaluation of an Automatic Playlist Generator of Pauws et. al. refers to a Personalized Automatic Track Selection (PATS) that creates a playlist using a dynamic clustering method. Songs are grouped based on a similarity measure that selectively weighs categorization values of songs, such as track title, year released, album, style, tempo, instruments used, place of recording, record company, or rhythmic foundation. The similarity measure is selective in the sense that one categorization value may be more important than another. When the user selects a song, the cluster in which the song is contained is presented as a playlist. An inductive learning algorithm is used to eliminate tracks from future playlists based upon user input. 
     In addition, analyzing media items based on signal processing techniques are known to allow the user to organize and visualize a music library. However, these methods analyze each media item using signal processing techniques without requiring categorization based on genre, artist, and year. 
     Furthermore, visualizing search results is known to help users browse for digitized music. Variations2: Toward Visual Interfaces for Digital Music Libraries of Notess et. al. refers to visualizing music bibliographic data to assist music students and faculty members browse and search for digitized music. By way of example, a student may search for works by creator and instrumentation used. The results of the search are displayed with a grid-based visualization that uses icon shape to represent media type, such as audio, score, or video, color to represent the performer, and position within the grid to indicate both work genre (x-axis) and composer/work (y-axis). Hovering over an object gives details on the performer, for example. 
     However, each one of these references suffers from one or more of the following disadvantages: (1) the user does not have an overall feel for how many media items are in the music library; (2) the user cannot intuitively see what portion of the library represents a rock genre versus an easy listening genre, for example; (3) the user cannot easily see desired attributes about each media item in relation to the library as a whole, such as which media items they listen to most often; (4) the user cannot easily visualize, manage, or organize playlists; and (5) the user cannot easily rediscover media items in their music library or know which portion of their music library needs expansion. 
     The present inventors have recognized a need for improved apparatus and methods for providing a graphical representation of a music library. 
    
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
       Features, aspects, and advantages of the present invention are set forth in the following description, appended claims, and accompanying drawings wherein: 
         FIG. 1  shows a user interface for iTunes of the prior art; 
         FIG. 2  shows a disk visualization of a music library according to a first embodiment; 
         FIG. 3  shows the disk visualization of  FIG. 2  with a mean value of a playcount of all media items within a sector illustrated; 
         FIG. 4  shows the disk visualization of  FIG. 2  having a graphical representation of playlists overlaid thereon; 
         FIG. 5  shows a rectangular visualization of a music library according to a second embodiment; 
         FIG. 6  shows the rectangular visualization of  FIG. 5  with a mean value of a playcount of all media items within a sector illustrated; 
         FIG. 7  shows the rectangular visualization of  FIG. 5  having a graphical representation of playlists overlaid thereon; 
         FIG. 8A  shows a Tree-Map visualization of a music library according to a third embodiment; 
         FIG. 8B  shows a Tree-Map visualization for the rock genre of  FIG. 8A ; 
         FIG. 8C  shows a Tree-Map visualization for the rock and roll sub-genre of  FIG. 8B . 
     
    
    
     DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 
     Throughout the specification, reference to “one embodiment,” “an embodiment,” or “some embodiments” means that a particular described feature, structure, or characteristic is included in at least one embodiment. Thus appearances of the phrases “in one embodiment,” “in an embodiment,” or “in some embodiments” in various places throughout this specification do not necessarily refer to the same embodiment. 
     Furthermore, the described features, structures, and characteristics may be combined in any suitable manner in one or more embodiments. Skilled persons will appreciate that the invention can be practiced without one or more of the specific details, or with other methods, components, materials, etc. In some instances, well-known structures, materials, and operations are omitted or not described in detail to avoid obscuring aspects of the embodiments. 
       FIG. 2  shows a disk visualization  40  of a music library according to a first embodiment. Disk visualization  40  includes a plurality of sectors  50  representing genre of the music library, one or more sub-sectors  60  representing artists associated with the genre, radii  70  representing a time axis, and a plurality of marks  100  corresponding to each media item of the music library. Disk visualization  40  may not only provide an overview of the total number of media items in the music library but may also provide good percentage and proportional overviews. In addition, disk visualization  40  may allow one or more playlists  110  to be visualized, managed and organized. Furthermore, disk visualization  40  may facilitate rediscovering media items in a music library instead of simply enlarging it. Therefore, when the time comes to expand the music library, disk visualization  40  may be helpful in deciding what to acquire or listen to next. 
     Referring now to  FIG. 2 , disk visualization  40  is divided into different sectors  50  that represent each genre of the library. For example, the music library illustrated in the embodiment of  FIG. 2  is categorized into nine genres: (1) Rock genre  112 ; (2) Soundtrack genre  114 ; (3) Easy listening genre  116 ; (4) Electronica/dance genre  118 ; (5) Jazz genre  120 ; (6) Latin genre  122 ; (7) Pop genre  124 ; (8) Alternative and punk genre  126 ; and (9) R&amp;B genre  128 . The music library could also be classified into other genres, such as Classical music, Gospel, Blues, Rhythm and blues, Funk, Metal, Country music, Electronic music, Melodic music, Ska, Reggae, Dub, Hip hop, and Contemporary African music. 
     The size of each sector  50  may be proportional to the number of media items of the associated genre with respect to the whole library. Therefore, the size of each sector  50  may be directly proportional to the importance of the corresponding genre within the library. At the same time, sectors  50  may be split in sub-sectors  60  representing the artists of the associated genre. Again, the size of sub-sectors  60  may be proportional to the number of media items of the artist. The radii  70  of disk visualization  40 , from the center  80  to the perimeter  90 , could illustrate a time axis. In addition, the center  80  could represent the year of the oldest possible media item of the library and the perimeter  90  could represent the most recent media items in the library. While year may be described primarily in relation to a year an album was released, it is to be appreciated that year can include the year a media item was released, for example. 
     In addition, although media items may be described primarily in relation to songs or music tracks, it is to be appreciated that media items can include, but are not limited to, songs, tracks, music CDs, movies, music videos, documents, books, poems, and images (e.g., photographs), for example. Media items may be depicted as marks  100  and can be arranged within disk visualization  40  according to the media item&#39;s categorization. For example, the media items of the library may be categorized according to genre, artist, and year of release. Further categorizations may include title of the media item, album, style or era, tempo, musicians featured in the media item, instruments used in the media item, total number of musicians, soloing musicians, composer of the media item, producer of the media item, where the media item was recorded, whether the media item is a live performance, record company, rhythmic foundation, and melodic/harmonic development. In one embodiment, media items belonging to the same album are positioned contiguously thereby having the effect of producing arcs of points  130  representing albums. In addition, albums may be depicted in alphanumeric order and media items of the same album may be ordered in the original order of the album. 
     Quantitative attributes  132  may be chosen by the user. For example, quantitative attributes  132  may include playcount  134 , rating  136 , last played date  138 , and added date  140 . In addition, other quantitative attributes  132  may include ratings and reviews assigned by critics, artists, or others, or artists having new media items forthcoming. The quantitative attributes  132  may be depicted by marks  100  and colors may be used to express the exact value for one media item in its associated mark  100 . For example, each mark  100  could have different color or grayscale tonalities indicative of quantitative attribute  132 . By way of example, if the quantitative attribute  132  is playcount  134 , a spectrum from light blue to black may be used. Marks  100  colored light blue could represent the most played media items, marks  100  colored black could represent the least played media items, and marks  100  colored according to another part of the spectrum could fall in between the most played and least played media items. In addition, each mark  100  could have a unique identification code  142 , such as A, B, and C. By way of example, if the quantitative attribute  132  is playcount  134 , A could represent the most played media item. C could represent the least played media item, and B could represent a media item falling in between the least played and most played. 
     Referring now to  FIG. 3 , a mean value of all the media items for one genre may be used to color a corresponding sector  50 . For example, each sector  50  could have different color or grayscale tonalities indicative of the mean value of the playcount  134  of all media items within that sector  50 . Again, a spectrum from light blue to black may be used, but other colors would be suitable. Sectors  50  colored light blue could represent sectors  50  having the most played media items, sectors  50  colored black could represent sectors  50  having the least played media items, and sectors  50  colored according to another part of the spectrum could represent sectors  50  having media items with a playcount falling between the most played and least played. In addition, each sector  50  could also be shaded with unique patterns  144  as shown in  FIG. 3 . By way of example, sectors  50  represented by a first unique pattern  146  could represent sectors  50  having the most played media items. In a similar manner, sectors  50  represented by a second unique pattern  148  could represent sectors  50  having media items with a playcount falling between the most played and least played. Finally, sectors  50  represented by a third unique pattern  150  could represent sectors  50  having the least played media items. 
     Referring now to  FIG. 4 , playlists  110  are shown using the disk visualization  40 . Playlists  110  may be created by adding media items in a one-by-one manner, or they could be smart playlists following a set of logical filtering criteria. Media items of playlists  110  without any grouping logic may be depicted using geometric forms different from marks  100 , which are used in general for the rest of the media items. For example, jogging playlist  152  could be displayed using diamond shapes  154 . While, diamond shapes  154  are colored black, other shapes, sizes, colors or shading could be used. Likewise, 25 last played playlist  156  could be represented using black crosses  158 . Again, other shapes, sizes, colors or shading could also be used. Other playlists  110 , including 60&#39;s and 70&#39;s music playlist  160 , Bruce Springsteen playlist  162 , and R.E.M. after 1990 playlist  164 , may be shown as shaded regions since they follow a regular geometric form. In one embodiment, red shaded regions are used, but other colors, shading patterns, or indicia could also be used. Rolling Stones &amp; Beatles playlist  166  and 80&#39;s pop music playlist  168  are not highlighted in the embodiment shown in  FIG. 4  because the user has not activated the corresponding checkboxes  170 . 
     Disk visualization  40  may also indicate currently playing media item  172 . For example, currently playing media item  172  could be displayed using a circular shape. While, the circular shape illustrating currently playing media item  172  is colored black, other shapes, sizes, colors or shading could be used. Furthermore. Path  174  grouping media items to be played next could be displayed. In this manner, the user could get an idea of what regions of the library are going to be used in the current music sequence, such as playlist  110 . 
     The user may interact with disk visualization  40  in a number of ways, including navigating media items, zooming over one or more sectors  50 , managing playlists  110 , and searching for media items. For example, additional information about any media item in the library may be visualized by positioning a cursor  176  over the mark  100  representing the media item. As illustrated in  FIG. 2 , cursor  176  is positioned over the media item/don&#39;t want a lover by Texas. Metadata, such as media item attributes, could be indicated in media item title field  178 , artist name field  180 , album name field  182 , and year released field  184 . In addition, an album cover field  186  may provide a visual indication of cover art associated with the album indicated in album name field  182 . 
     If cursor  176  is positioned over one of sectors  50 , the artist of corresponding sub-sector  60  may be highlighted. For example, as shown in  FIG. 2 , cursor  176  is over sector  50  representing the pop genre  124  and sub-sector  60  representing the group Texas. The name of the artist may be displayed in a sub-sector name field  188  as illustrated in  FIG. 2 . Likewise, the year of release may be highlighted with dashed-circle  190  and the actual year displayed in year field  192 . In this manner, the user could see other media items released in the same year. 
     The user may also zoom over any sector  50  of the disk visualization  40  to get a more detailed view of the library. When the zoom feature is activated, a second disk visualization (not shown) could be generated with similar visualization and interaction principles but applied to the genre of selected sector  50 . The second disk visualization may be displayed proximate disk visualization  40  or disk visualization  40  may simply be updated with new information. By way of example, if the user zooms over sector  50  representing pop genre  124 , sectors  50  of disk visualization  40  representing genres may become sectors (not shown) representing artists. Likewise, sub-sectors  60  of disk visualization  40  representing artists may become sub-sectors (not shown) representing albums. All the other dimensions and general principles may remain the same. 
     The user may perform another level of zoom by selecting another sector of the second disk visualization. This could generate a third disk visualization (not shown) with similar visualization and interaction principles but applied to the artist of the selected sector. The third disk visualization may be displayed proximate the second disk visualization or the second disk visualization may simply be updated with new information. By way of example, if the user zooms over the sector representing the group Texas, sectors of the second disk visualization representing artists may become sectors (not shown) representing albums. In the third disk visualization, there may be no sub-sector, but the user could obtain a graphical representation of the media items for a given artist. 
     Referring again to  FIG. 4 , disk visualization  40  may not only be used to graphically display playlists  110 , but may also be used to edit or create new playlists  110  using the graphical display. For example, playlists  110  may be considered as sets and new playlists  110  may be formed using set operations. By way of example, the user could select multiple playlists  110 , such as the 60&#39;s and 70&#39;s music playlist  160  and the Bruce Springsteen playlist  162 , and apply set operations, such as union, intersection, difference, or complements. The resulting playlists  110  could graphically displayed. 
     In addition, when creating or editing playlists  110  by directly selecting media items or by constructing a set of logic rules for smart playlists, the disk visualization  40  may be helpful by showing playlist  110  being created step-by-step. This may not only allow the user to immediately see the new playlist  110  take form, but it may also allow the user to see changes to the new playlist  110  in a real-time manner. Furthermore, the user can also approximate the size and topology of the new playlist  110  which provides a better idea of the zones of the library that are overused or underused, or the zones implied in each playlist  110 . 
     Furthermore, the user may also search for media items using search bar  194 . In response to the search, results may be dynamically filtered and highlighted on disk visualization  40 . 
       FIGS. 5 ,  6 , and  7  show a rectangular visualization  200  of a music library according to a second embodiment (in  FIGS. 5 ,  6 , and  7  reference numerals with the prime symbol, e.g.,  50 ′, indicate elements similar to those of the same name in the first embodiment, i.e., sectors  50 ). Rectangular visualization  200  includes a plurality of sectors  50 ′ representing genre of the music library, one or more sub-sectors  60 ′ representing artists associated with the genre, lines  202  representing a time axis, and a plurality of marks  100 ′ corresponding to each media item of the music library. 
     Although a sector may be described as a plane figure bounded by two radii and the included arc of a circle, it is to be appreciated that sector may be described as a division into sectors, portions, or contiguous subparts, for example. Referring now to  FIG. 5 , rectangular visualization  200  is divided into different sectors  50 ′ that represent each genre of the library. For example, the music library illustrated in the embodiment of  FIG. 5  is categorized into nine genres: (1) Rock genre  112 ′; (2) Soundtrack genre  114 ′; (3) Easy listening genre  116 ′; (4) Electronica/dance genre  118 ′; (5) Jazz genre  120 ′; (6) Latin genre  122 ′; (7) Pop genre  124 ′; (8) Alternative and punk genre  126 ′; and (9) R&amp;B genre  128 ′. 
     The size of each sector  50 ′ may be proportional to the number of media items of the associated genre with respect to the whole library. Therefore, the size of each sector  50 ′ may be directly proportional to the importance of the corresponding genre within the library. At the same time, sectors  50 ′ may be split in sub-sectors  60 ′ representing the artists of the associated genre. Again, the size of sub-sectors  60 ′ may be proportional to the number of media items of the artist. Lines  202  of rectangular visualization  200  illustrate parallel lines of equal length defining sectors  50 ′. Bottom side  204  and top side  206  illustrate a time axis. For example, bottom side  204  could represent the year 1956 while top side  206  could represent the year 2004. In this manner, bottom side  204  may represent the year of the oldest possible media item of the library and top side  206  may represent the most recent media items in the library. 
     Media items may be depicted as marks  100 ′ and are arranged within rectangular visualization  200  according to the media item&#39;s categorization. For example, the media items of the library may be categorized according to genre, artist, and year of release. Further categorizations may include title of the media item, album, style or era, tempo, musicians featured in the media item, instruments used in the media item, total number of musicians, soloing musicians, composer of the media item, producer of the media item, where the media item was recorded, whether the media item is a live performance, record company, rhythmic foundation, and melodic/harmonic development. In one embodiment, media items belonging to the same album are positioned contiguously thereby having the effect of producing a line of points  210  representing albums. In addition, albums may be depicted in alphanumeric order and media items of the same album may be ordered in the original order of the album. 
     Quantitative attributes  132 ′ may be chosen by the user. For example, quantitative attributes  132 ′ may include playcount  134 ′, rating  136 ′, last played date  138 ′, and added date  140 ′. In addition, other quantitative attributes  132 ′ may include ratings and reviews assigned by critics, artists, or others, or artists having new works forthcoming. The quantitative attributes  132 ′ may be depicted by marks  100 ′ and colors may be used to express the exact value for one media item in its associated mark  100 ′. For example, each mark  100 ′ could have different color or grayscale tonalities indicative of quantitative attribute  132 ′. By way of example, if the quantitative attribute  132 ′ is playcount  134 ′, a spectrum from light blue to black may be used. Marks  100 ′ colored light blue could represent the most played media items, marks  100 ′ colored black could represent the least played media items, and marks  100 ′ colored according to another part of the spectrum could fall in between the most played and least played media items. In addition, each mark  100 ′ could have a unique identification code  142 ′, such as A. B. and C. By way of example, if the quantitative attribute  132 ′ is playcount  134 ′. A could represent the most played media item. C could represent the least played media item, and B could represent a media item falling in between the least played and most played. 
     Referring now to  FIG. 6 , a mean value of all the media items for one genre may be used to color a corresponding sector  50 ′. For example, each sector  50 ′ could have different color or grayscale tonalities indicative of the mean value of the playcount  134 ′ of all media items within that sector  50 ′. Again, a spectrum from light blue to black may be used, but other colors would be suitable. Sectors  50 ′ colored light blue could represent sectors  50 ′ having the most played media items, sectors  50 ′ colored black could represent sectors  50 ′ having the least played media items, and sectors  50 ′ colored according to another part of the spectrum could represent sectors  50 ′ having media items with a playcount falling between the most played and least played. In addition, each sector  50 ′ could also be shaded with unique patterns  144 ′ as shown in  FIG. 6 . By way of example, sectors  50 ′ represented by a first unique pattern  146 ′ could represent sectors  50 ′ having the most played media items. Sectors  50 ′ represented by a second unique pattern  148 ′ could represent sectors  50 ′ having media items with a playcount falling between the most played and least played. Finally, sectors  50 ′ represented by a third unique pattern  150 ′ could represent sectors  50 ′ having the least played media items. 
     Referring now to  FIG. 7 , playlists  110 ′ are shown using the rectangular visualization  200 . Playlists  110 ′ may be created by adding media items in a one-by-one manner, or they could be smart playlists following a set of logical filtering criteria. Media items of playlists  110 ′ without any grouping logic may be depicted using geometric forms different from marks  100 ′, which can be used in general for the rest of the media items. For example, jogging playlist  152 ′ could be displayed using diamond shapes  154 ′. While, diamond shapes  154 ′ are colored black, other shapes, sizes, colors or shading could be used. Likewise, 25 last played playlist  156 ′ could be represented using black crosses  158 ′. Again, other shapes, sizes, colors or shading could also be used. Other playlists  110 ′, including 60&#39;s and 70&#39;s music playlist  160 ′, Bruce Springsteen playlist  162 ′, and R.E.M. after 1990 playlist  164 ′, may be shown as shaded regions since they follow a regular geometric form. In a preferred embodiment, red shaded regions are used, but other colors, shading patterns, or indicia could also be used. Rolling Stones &amp; Beatles playlist  166 ′ and 80&#39;s pop music playlist  168 ′ are not highlighted because the user has not activated their corresponding checkboxes  170 ′. 
     Rectangular visualization  200  may also indicate currently playing media item  172 ′. For example, currently playing media item  172 ′ could be displayed using a circular shape. While, the circular shape illustrating currently playing media item  172 ′ is colored black, other shapes, sizes, colors or shading could be used. In addition, path  174 ′ grouping media items to be played next could also be displayed. In this manner, the user might get an idea of what regions of the library are going to be used in the current music sequence, such as playlist  110 ′. 
     The user may interact with rectangular visualization  200  in a number of ways, including navigating media items, zooming over one or more sectors  50 ′, managing playlists  110 ′, and searching for media items. For example, additional information about any media item in the library may be visualized by positioning a cursor (not shown) over a mark  100 ′ in a manner similar to that described for disk visualization  40 . In addition, if the cursor is positioned over a sector  50 ′, the artist of corresponding sub-sector  60 ′ may be highlighted in a manner similar to that described for disk visualization  40 , except that the year of release may be highlighted with a dashed-line (not shown). 
     The user may also zoom over any sector  50 ′ in a manner similar to that described for disk visualization  40  to get a more detailed view of the library. For example, when the zoom feature is activated, a second rectangular visualization (not shown) may be generated with similar visualization and interaction principles but applied to the genre of selected sector  50 ′. The second rectangular visualization may be displayed proximate rectangular visualization  200  or rectangular visualization  200  may simply be updated with new information. By way of example, if the user zooms over sector  50 ′ representing pop genre  124 ′, sectors  50 ′ of rectangular visualization  200  representing genres may become sectors (not shown) representing artists. Likewise, sub-sectors  60 ′ of rectangular visualization  200  representing artists may become sub-sectors (not shown) representing albums. All the other dimensions and general principles could remain the same. 
     The user may perform another level of zoom by selecting another sector of the second rectangular visualization. This could generate a third rectangular visualization (not shown) with similar visualization and interaction principles but applied to the artist of the selected sector. The third rectangular visualization may be displayed proximate the second rectangular visualization or the second rectangular visualization may simply be updated with new information. By way of example, if the user zooms over the sector representing the group Bruce Springsteen, sectors of the second rectangular visualization representing artists may become sectors (not shown) representing albums. In the third rectangular visualization, there may be no sub-sector, but the user could obtain a graphical representation of the media items for a given artist. 
     Another way of applying a zoom function in the rectangle visualization  200  is to consider that the media items in the library are always shown, but the scale of a horizontal axis  210  or vertical axis  212  changes. For example, the user could explore the entire library by using a scroll bar (not shown) for panning over a specific zone. In this manner, when zooming in, the horizontal axis  210  still represents the genres, and the artists within each genre. Another level of zoom, as previously described, could be used in which the horizontal axis  210  also represents the albums for each artist. Accordingly, the horizontal axis  210  and its scroll bar may be adapted depending on the zoom level. 
     Referring again to  FIG. 7 , rectangular visualization  200  may be used to graphically display playlists  110 ′ and to edit or create new playlists  110 ′ using the graphical display in a manner similar to that described for disk visualization  40 . In addition, the user may also search for media items using search bar  194 ′. In response to the search, results may be dynamically filtered and highlighted on rectangular visualization  200 . 
       FIGS. 8A ,  8 B, and  8 C show a Tree-Map visualization  300  of a music library according to a third embodiment (in  FIGS. 8A ,  8 B, and  8 C reference numerals with the prime symbol, e.g.,  50 ″, indicate elements similar to those of the same name in the first embodiment, i.e., sectors  50 ). Tree-Map visualization  300  includes a plurality of sectors  50 ″ representing genre of the music library, one or more first sub-sectors  302  representing sub-genres associated with the genre, one or more second sub-sectors  304  representing artists associated with each sub-genre, and an indicia representing a mean value of an attribute of all media items within a second sub-sector. Tree-Map visualization  300  may give the user a good overview of the number of media items belonging to each genre, sub-genre, and artist as represented by the respective rectangle sizes. However, in one embodiment. Tree-Map visualization  300  does not display information about individual media items or playlists. 
     Referring now to  FIG. 8A , Tree-Map visualization  300  is divided into different sectors  50 ″ that represent each genre of the library. For example, the music library illustrated in the embodiment of  FIG. 8A  is categorized into seven genres: (1) Jazz genre  306 ; (2) Pop genre  308 ; (3) Classical genre  310 ; (4) Techno genre  312 ; (5) Country genre  314 ; (6) Rock genre  316 ; and (7) Soundtrack genre  318 . 
     The size of each sector  50 ″ may be proportional to the number of media items of the associated genre with respect to the whole library. At the same time, sectors  50 ″ may be split into one or more first sub-sectors  302  representing sub-genres associated with the sector  50 ″. For example, sub-genres of Rock genre  316  may include Rock and roll sub-genre  322 , Alternative sub-genre  324 , Psychedelic sub-genre  326 , Folk sub-genre  328 , Instrumental sub-genre  330 , Hard rock sub-genre  332 , and Punk sub-genre  334 . Of course, other sub-genre may be available for other genre. Each first sub-sector may be sized to reflect a ratio between the number of media items associated with the first sub-sector  302  and all the media items in the sector  50 ″. In addition, each first sub-sector  302  may be divided into one or more second sub-sectors  304  representing artists associated with the first sub-sector  302 . Each second sub-sector  304  may be sized to reflect a ratio between the number of media items associated with the second sub-sector  304  and all the media items in the first sub-sector  302 . Further, each second sub-sector  304  may be divided into one or more third sub-sectors  320  representing albums associated with the second sub-sector  304 . Each third sub-sector  320  may be sized to reflect a ratio between the number of media items associated with the third sub-sector  320  and all the media items in the second sub-sector  304 . 
     In a manner similar to that for disk visualization  40  and rectangular visualization  200 , quantitative attributes may be chosen by the user. For example, quantitative attributes may include playcount, rating, last played date, and added date. In addition, other quantitative attributes may include ratings and reviews assigned by critics, artists, or others, or artists having new works forthcoming. The mean value of all the media items in each second sub-sector  304  may be used to color a corresponding second sub-sector  304 . For example, each second sub-sector  304  could have different color or grayscale tonalities indicative of the mean value of the playcount of all media items within that second sub-sector  304 . A spectrum from light blue to black may be used, but other colors would be suitable. 
     Second sub-sectors  304  colored light blue could represent second sub-sector  304  having the most played media items, second sub-sectors  304  colored black could represent second sub-sectors  304  having the least played media items, and second sub-sectors  304  colored according to another part of the spectrum could represent second sub-sectors  304  having media items with a playcount falling between the most played and least played. In addition, each second sub-sector  304  could also be shaded with unique patterns as discussed with reference to  FIGS. 3 and 6 , Furthermore, the mean value of all the media items in each third sub-sector  320  may be used to color a corresponding third sub-sector  320 . 
     The user may also zoom over any sector  50 ″ in a manner similar to that described for disk visualization  40  and rectangular visualization  200  to get a more detailed view of the library. For example, when the zoom feature is activated, a Second Tree-Map visualization  336  may generated with similar visualization and interaction principles but applied to the genre of selected sector  50 ″. The second Tree-Map visualization  336  may be displayed proximate Tree-Map visualization  300  or Tree-Map visualization  300  may simply be updated with new information. By way of example, if the user zooms over sector  50 ″ representing Rock genre  316 , sectors  50 ″ of Tree-Map visualization  300  representing genres may become sectors (not shown) representing sub-genres including Rock and roll sub-genre  322 , Alternative sub-genre  324 , Psychedelic sub-genre  326 , Folk sub-genre  328 , Instrumental sub-genre  330 . Hard rock sub-genre  332 , and Punk sub-genre  334 . Likewise, first sub-sectors  302  of Tree-Map visualization  300  representing sub-genre may become additional sub-sectors (not shown) representing artists. All the other dimensions and general principles could remain the same. 
     The user may perform another level of zoom by selecting any second sector of the second Tree-Map visualization  336  corresponding to a sub-genre. This could generate a third Tree-Map visualization  338  with similar visualization and interaction principles but applied to the sub-genre of the selected second sector. The third Tree-Map visualization  338  may be displayed proximate the second Tree-Map visualization  336  or the second Tree-Map visualization  336  may simply be updated with new information. By way of example, if the user zooms over the second sector representing the Rock and roll sub-genre  322 , sectors of the second Tree-Map visualization representing sub-genre may become sectors (not shown) representing artists. 
     It will be obvious to those having skill in the art that many changes may be made to the details of the above-described embodiments without departing from the underlying principles of the invention. The scope of the present invention should, therefore, be determined only by the following claims.

Metadata:
Filing Date: 20091116
Publication Date: 20120925
Grant Date: 20120925
Priority Date: 20051004
Inventors: TORRENS MARC
HERTZOG PATRICK
ARCOS JOSEP-LLUIS
Assignee: APPLE INC
CPC Classifications: [{"code": "G06F16/68", "inventive": true, "first": false, "tree": "[]"}, {"code": "G06F16/639", "inventive": true, "first": false, "tree": "[]"}, {"code": "G11B27/34", "inventive": true, "first": true, "tree": "[]"}, {"code": "G06F16/64", "inventive": true, "first": false, "tree": "[]"}, {"code": "G06F16/638", "inventive": true, "first": false, "tree": "[]"}, {"code": "G11B27/105", "inventive": true, "first": false, "tree": "[]"}, {"code": "G11B27/329", "inventive": true, "first": false, "tree": "[]"}, {"code": "G06F16/40", "inventive": true, "first": false, "tree": "[]"}, {"code": "G11B27/105", "inventive": true, "first": false, "tree": "[]"}, {"code": "G11B27/34", "inventive": true, "first": true, "tree": "[]"}, {"code": "G06F16/638", "inventive": true, "first": false, "tree": "[]"}, {"code": "G06F16/40", "inventive": true, "first": false, "tree": "[]"}, {"code": "G06F16/686", "inventive": true, "first": false, "tree": "[]"}, {"code": "G11B27/329", "inventive": true, "first": false, "tree": "[]"}, {"code": "G06F16/68", "inventive": true, "first": false, "tree": "[]"}, {"code": "G06F16/639", "inventive": true, "first": false, "tree": "[]"}, {"code": "G06F7/00", "inventive": true, "first": false, "tree": "[]"}, {"code": "G06F16/64", "inventive": true, "first": false, "tree": "[]"}, {"code": "G06F7/06", "inventive": true, "first": true, "tree": "[]"}, {"code": "G06F16/686", "inventive": true, "first": false, "tree": "[]"}]
Family ID: 37943339