VISUALIZATION AND PLAYBACK OF TELEVISION SHOWS AT A SUB-SHOW LEVEL

Abstract: A method and system display content, such as television programs, at a segment level. This includes segmenting the content into at least two segments, displaying a representation of at least one of the at least two segments, and indicating how the at least one of the at least two segments relate to the content. The term "content" relates to any type of programming or information that can be broadcast, stored by a user, or otherwise transmitted to a user.

Description: VISUALIZATION AND PLAYBACK OF TELEVISION SHOWS AT A SUB-SHOW LEVEL CROSS REFERENCE TO RELATED APPLICATIONS This application is a nonprovisional application of U.S. provisional and parent application "VISUALIZATION AND PLAYBACK OF TELEVISION SHOWS AT A SUB-SHOW LEVEL," U.S. Serial No. 60/221,404, filed July 28, 2000 having George Marmaropoulos and John Zimmerman as the inventors and is hereby incorporated by reference in its entirety. BACKGROUND OF THE INVENTION The present invention relates generally to a user interaction paradigm related to the customization of the TV watching process. Digital television and digital information has changed and will continue to change home entertainment by offering a vast amount of digital content. The number of channels and variety of content available will become so large that it will be impossible for any viewer to browse the content using conventional channel surfing methods. Electronic program guides (EPGs) , such as those described in U.S. Patent No. 4,706,121 and 5,353,121, herein incorporated by reference, provide schedule information processing systems which provide a viewer with a convenient way to select programs based on viewer supplied selection criteria. However, even EPGs, despite their current developments will be insufficient to provide a level of personalization for the copious information which will soon become available. Various devices and systems, such as personal TV recorders and agent technologies offer a certain level of personalization. These systems operate at the meta-data level using EPGs and user preferences. Such devices normally have a hard disk with the ability to store several hours of video content in order to facilitate the process of viewing the preferred programs. However, new paradigms that allow the users to intuitively search and find the specific content that they would like to watch or hear are becoming necessary. Currently, users conceptualize content in terms of individual, indivisible shows. Consequently, users can only chose to watch or hear content at a show level . SUMMARY OF THE INVENTION According to one aspect of the invention, a method of displaying content at a segment level includes several steps . One step is segmenting the content into at least two segments. Another step is displaying a representation of at least one of the at least two segments. An additional step is indicating how the at least one of the at least two segments relate to the content. The term "content" relates to any type of programming or information that can be broadcast, stored by a user, or otherwise transmitted to a user. In some embodiments of the invention the segmenting step further includes segmenting based on pixel color analysis in a sampled frame, dialogue analysis, object recognition techniques, written content descriptions, closed captioning, speech to text, MPEG 7, or audio analysis. Segmenting can be performed according to any known method. In some other embodiments of the invention, the indicating step may include symbolically indicating the length of each segment or the length of a segment in relation to the length of the content in which it is contained. The indicating step also may include indicating the temporal position of a segment within the content in which it is contained. In some other embodiments, the indicating step may include generating symbols that may be pictures or text. A user can search for content using the symbols. In another embodiment, a user can select the representation of a segment to display (i.e., play) the segment in a full, or partial format . In another embodiment, the method includes storing a segment in a storage medium. A user may also store and display more than one segment. In another aspect of the invention, a system for displaying content at a segment level includes at least one source of content a means for segmenting the content, and a display means for displaying at least one representation of segmented content. In some embodiments, the display means is a television or monitor. The content is at least one source of television programming, or source of linear media. Further, the source of television programming or streaming media is a satellite source, a land based source, or a broadcast source. In other embodiments, the means for segmenting content operates at a content head end, at a user's location, or both a content head end and a user's location. In other embodiments the means for segmenting content segments content automatically based on a user's individual viewing habits. Further, the display means displays at least one of the at least two segments . In another aspect of the invention, a program stored on a processor-readable medium for displaying content at a segment level includes portions for carrying out steps. The program segment includes portions for segmenting content into at least two segments, portions for displaying at least one of the at least two segments, and portions for indicating how the at least one of the at least two segments relates to the content. The invention provides several advantages. For example purposes only, the system, method, and program segment are capable of segmenting content and displaying segmented content. Users can select only the segments that they wish to watch, and can search vast amounts of content for only specific segments. This will make television viewing easier and more personalized as the number of channels and volume of information continues to grow. Further, copious information can be organized and viewed quickly and simply, without requiring excess scanning. These and many other advantages are elucidated with reference to the embodiments below. BRIEF DESCRIPTION OF THE DRAWING Fig. 1 illustrates a preferred embodiment of a user interface incorporating segment level representations; Fig. 2 illustrates a preferred embodiment of a user interface on which a segment representation contains additional information; Fig. 3 illustrates a preferred embodiment of a user interface that allows a user to search content by segments; Fig. 4 illustrates a preferred embodiment of a system for displaying content at a segment level; Fig. 5 illustrates a block diagram of a program stored on a processor-readable medium for displaying content at a segment level . DETAILED DESCRIPTION OF THE PRIMARY EMBODIMENT The proposed method, system, and program provides a television viewer with the ability to select content at a sub-show level, hereinafter called "segment level." Fig. 1 illustrates a preferred embodiment of the proposed user interface incorporating segment level representations. A user begins by selecting from category menu 10 on user interface 100. Here the user can search for content within a category. In Fig. 1, the user selects talk shows using a conventional input device, such as a remote control or a keyboard. This reveals content (i.e., television programs represented by icons) which fit the selected talk show category. Each portion of content that fits the category may be selected. In Fig. 1, the user selects icon 11 using a conventional input device, such as a remote control or a keyboard. Icon represents a different portion content (i.e., different program) . Icon 11 corresponds to the television program "The Late Show with David Letterman, " hereinafter "The Late Show." This program includes various segments where guests are interviewed, musicians play, comedians perform, etc. There ' are several known methods of segmenting content for display at a segment level. One method breaks content down into segments by perusing closed captioning associated with content to identify cues where segments begin and end. As an example, a cue to identify where a segment begins can be the words "and my next guest tonight is§" . A cue to identify the end of a segment can be where sustained applause accompanies the words "Thank youg. " Another method identifies segments from the inherent structure of a program. This is achieved, for example, by identifying a musical performance in a talk show by recognizing a sustained portion where music is played. The cues would be when the music begins and ends. Another method recognizes sounds associated with segments, such as a whistle being blown at the beginning and end of a quarter of a football game, or portions where applause meets a threshold volume (i.e., notable plays in a sporting event) . Many additional methods of segmenting content are available and may be used in the present invention. Icon 11 is selected in Fig. 1, segment display region 12 displays segment representations 13-17. Segment representations 13-17 represent various segments of The Late Show. For example, segment representation 13 corresponds to the segment of The Late Show where Dolly Parton is the guest .- Segment representation 14 corresponds to the segment of The Late Show where Drew Carey appears . If a user wishes to watch one or more segments of The Late Show, they can select the corresponding segment representations. Once selected, the segment may be displayed or stored. As an example, assume a user selects segment representation 13 from segment display region 12. The user can then watch that segment, compile a series of selected segments and watch them all as an editable montage, or store the segment for later viewing. The area of a segment representation is proportional to the temporal length of a segment. As an example, in Fig. 1, a brief viewing of segment display region 12 reveals that segment representations 13 and 14 are longer than segment representations 15 and 16. Further, a user can quickly and easily compare the length of a segment representation to the length of an entire portion of content (i.e., a program) . As an example, a user may approximate that segment representation 13 is about 1/5 the length of segment display region 12. Consequently the user can determine since The Late Show is 1 hour long, the segment corresponding to segment representation 13 is 1/5 of 1 hour, or 12 minutes long. Alternatively, when a user highlights a segment representation, they can be provided with the segment length and the segment length in comparison to the entire content portion. Fig. 2 illustrates a user interface 101 on which a segment representation provides a user with detailed information about the segments of a content portion. Display region 12 again contains segment representations 13-17 that are indicated by icons, such as icon 21. When a user highlights a segment representation, information may be provided, such as information regarding the celebrity, the cues that form the segment, the theme, etc. In Fig. 2, when a user highlights segment representation 13 corresponding to Dolly Parton, information 20 appears which aides a user in deciding whether to store or view the highlighted segment. Displaying segment representations as indicated above is useful for an additional reason. Generally, a content portion places greater emphasis on certain segments contained therein. For example, a news program will place the greatest emphasis on the "top stories" segment. Further, the "top stories" will usually occur early in the content portion. Displaying content at a segment level allows a user to understand where a segment exists with regard to the entire content portion and how significant the segment is based on its relation to the entire content portion. Fig. 3 displays a user interface that allows a user to search content by segments. According to user interface 102, a user searched for content portions relating to finance, i.e., from category menu 10 in Fig. 1. Content portions represented by icons 31-33 were found according to the user's search. The user can then further search content portions 31-33 on a segment level. The user performs this segment level search by selecting a specific segment 37 from search engine 36. In Fig. 3, the user only wishes to find segments relating to Nokia within content portions relating to finance. As indicated by display regions 34 and 35, segment representations 38 and 39 were found. The user may observe that no segments in the content portion represented by icon 33 contain th ' e desired segments. Further, the user can visualize that the content portion corresponding to icon 32 includes a segment (i.e., segment representation 39) regarding Nokia which is likely more detailed than the content portion regarding Nokia corresponding to icon 31. The user may wish to see or store both the segments found in their search, only the shorter segment (i.e., corresponding to segment representation 38), or only the longer segment (i.e., corresponding to segment representation 39) . Fig. 4 displays a system for displaying content at a segment level. Display screen 401 displays the user interface 101. Segment representations and menus may be selected, edited, and otherwise manipulated using a cursor (not shown) . The cursor may be moved left, right, up, and down using a conventional input device such as a remote control 47 or any other customary input device known in the art . Once a user selects a category of content portions, microprocessor 45 scans content source 44 for the selected content portions. Microprocessor 45 then segments the selected content portions according to the user's input. This can occur, for example, if the user selects an icon representing a content portion. Then microprocessor 45 will segment the program as . indicated above, and display the segments as segment representations. Alternatively, microprocessor 45 can scan content source 44, and segment programs across more than one category. When a user selects a segment representation, microprocessor 45 may direct display 401 to display the segment. Microprocessor '45 may also store a selected segment in storage medium 46. Microprocessor 45 can also suggest segments automatically based on the user's individual viewing habits. Segments level displaying relates more generally to all forms of streaming media, such as radio, and streaming feeds from the Internet. For example, a user interface for a radio device (such as a digital cable radio feed). The. radio content portions can be segmented, searched, and displayed for selection by a user. The block diagram of Fig. 5 depicts a program stored on a processor- eadable medium for displaying content at a segment. The program queries whether the user selected a category of content in step 500. If not, the program directs microprocessor 45 to generate a category menu in step 502. Once generated, the program directs microprocessor 45 to request and receive input in steps 503 and 504, respectively. If the user selected a category in step 500, or once input is received in step 503, the program directs microprocessor 45 to search and/or filter content based on the selected category in step 501. Once the content searched / and filtered based on the selected category, the program queries the user whether they wish to search segments within the category results. This occurs in step 505. If the user does not wish to search segments within the selected category, the program queries whether an icon representing a content portion has been selected. This occurs in step 506. If not the program awaits icon selection in step 507. When the user selects an icon, the content portion the icon represents is segmented in step 508. If the user wishes to search segments within the selected category, the program directs microprocessor 45 to segment all content portions within the category in step 509. In step 510, the program queries whether the user selected a segment category. If not, the program directs microprocessor 45 to generate a segment category menu in step 511. Once generated, the program directs microprocessor 45 to request and receive input in steps 512 and 513, respectively. If the user selected a segment category in step 510, or once input is received in step 513, the program directs microprocessor 45 to search and/or filter segments based on the selected segment category in step 514. Once the content portion the icon represents is segmented in step 508, or the program directs microprocessor 45 to search and/or filter segments based on the selected segment category in step 514, the program directs display 401 to display segments as segment representations in step 515. The preceding expressions and examples are exemplary and are not intended to limit the scope of the claims that follow.

Claims: What is claimed is: 1. A method of displaying content at a segment level comprising: segmenting the content into at least two segments; displaying a representation of at least one of the at least two segments; and indicating how the at least one of the at least two segments relate to the content. 2. The method of Claim 1, wherein the segmenting step further comprises segmenting based on one of: pixel color analysis in a sampled frame, dialogue analysis, object recognition techniques, written content descriptions, closed captioning, speech to text, MPEG 7, and audio analysis. 3. The method of Claim 1 wherein the indicating step further comprises symbolically indicating the length of each segment. 4. The method of Claim 1 wherein the indicating step further comprises indicating the length of the at least one of the at least two segments in relation to the length of the content in which it is contained. 5. The method of Claim 1 wherein the indicating step further comprises indicating the temporal position of the at least one of at least two segments within the content. 6. The method of Claim 1 wherein the representation comprises at least one picture or text portion. 7. The method of Claim 6 wherein a user can search- content using the representation. 8. The method of Claim 1, wherein a user can select the representation of at least one of the at least two segments to display the segment. 9. The method of Claim 1, wherein the method further comprises storing a segment represented by the representation of at least one of the at least two segments on a storage medium. 10. The method of Claim 9, wherein a user can store and display more than one segment. 11. A system for displaying content at a segment level comprising: at least one source of content; means for segmenting the content into at least two segments; and a display means for displaying a representation of at least one of the at least two segments. 12. The system of Claim 11, wherein the display means comprises a television or monitor. 13. The • system of Claim 11, wherein the content f rther comprises at least one source of television programming, or source of linear media. 14. The system of Claim 11, wherein the at least one source of television programming or streaming media is a satellite source, a land based source, or a broadcast source. 15. The system of Claim 11, wherein the means for segmenting content operates at a content head end, at a user's location, or both a content head end and a user's location. 16. The system of Claim 11, wherein the means for segmenting content segments content automatically based on a user's individual viewing habits . 17. The system of Claim 11 further comprising a storage medium. 18. The system of Claim 11, wherein the display means displays at least one of the at least two segments. 19. A program stored on a processor-readable medium for displaying content at a segment level comprising: portions for segmenting content into at least two segments; portions for displaying at least one of the at least two segments; and portions for indicating how the at least one of the at least two segments relates to the content.

Inventors: MARMAROPOULOS GEORGE, VAN HEERDEN CLIVE R, ZIMMERMAN JOHN, MARMAROPOULOS, GEORGE, VAN HEERDEN, CLIVE, R., ZIMMERMAN, JOHN
Applicants: HEERDEN CLIVE R VAN, KONINKL PHILIPS ELECTRONICS NV, MARMAROPOULOS GEORGE, ZIMMERMAN JOHN, KONINKLIJKE PHILIPS ELECTRONICS N.V., MARMAROPOULOS, GEORGE, VAN HEERDEN, CLIVE, R., ZIMMERMAN, JOHN
Application year: 2001
Main classification: H04N5
IPC codes: G11B27, H04N5, H04N7