Source: http://www.google.com/patents/US20030120495?dq=5,941,947
Timestamp: 2017-12-18 15:07:32
Document Index: 42988136

Matched Legal Cases: ['art 112', 'art 122', 'art 24', 'art 135', 'art 142', 'art 122', 'art 142']

Patent US20030120495 - Digest generation method and apparatus for image and sound content - Google Patents
A method for a digest generating apparatus to generate a digest of image content or sound content is provided. The digest generating apparatus obtains an audience rating or an audience count of image content or sound content at established time intervals, and extracts images from the image content or...http://www.google.com/patents/US20030120495?utm_source=gb-gplus-sharePatent US20030120495 - Digest generation method and apparatus for image and sound content
Publication number US20030120495 A1
Application number US 10/323,943
Also published as US7277859
Publication number 10323943, 323943, US 2003/0120495 A1, US 2003/120495 A1, US 20030120495 A1, US 20030120495A1, US 2003120495 A1, US 2003120495A1, US-A1-20030120495, US-A1-2003120495, US2003/0120495A1, US2003/120495A1, US20030120495 A1, US20030120495A1, US2003120495 A1, US2003120495A1
Inventors Tomoki Watanabe, Shinya Uegaki, Katsumi Kishida, Koichiro Yamamoto, Takashi Hosobuchi, Wataru Inoue, Hisashi Matsukawa
Patent Citations (20), Referenced by (17), Classifications (20), Legal Events (3)
US 20030120495 A1
1. A method for a digest generating apparatus to generate a digest of image content or sound content, said method comprising:
an obtaining step of obtaining an audience rating or an audience count of image content or sound content at established time intervals;
an extraction step of extracting images from said image content or extracting sounds from said sound content, wherein the extracted images or the extracted sounds correspond to a time when said audience rating or said audience count exceeds a threshold; and
a generation step of generating a digest by using the extracted images or the extracted sounds.
2. The method as claimed in claim 1, said obtaining step comprising the steps of:
obtaining audience data indicating that an audience has watched or has listened to said image content or said sound content; and
obtaining said audience rating or said audience count by using said audience data for a plurality of audiences.
3. The method as claimed in claim 1, when said image content or said sound content includes a plurality of programs, said method comprising the steps of, instead of said extraction step and said generation step:
obtaining short images corresponding to at least a program, among said plurality of programs, whose audience rating or audience count exceeds a threshold; and
generating a digest by using said short images.
4. The method as claimed in claim 1, said method comprising the steps of:
5. The method as claimed in claim 1, wherein said audience rating or said audience count is obtained by using audience data corresponding to an audience group having a specific user profile at established time intervals.
6. The method as claimed in claim 1, said method comprising the steps of:
increasing or decreasing, by a predetermined amount, said audience rating or said audience count that corresponds to predetermined images or sounds in said image content or said sound content; and
generating said digest by using increased or decreased audience ratings, or by using increased or decreased audience counts.
7. The method as claimed in claim 6, wherein said predetermined images or sounds can be changed over time.
8. The method as claimed in claim 1, said method comprising the step of:
9. The method as claimed in claim 8, wherein said predetermined images or sounds can be changed over time.
10. The method as claimed in claim 1, said method further comprising the steps of:
obtaining differences between first audience ratings or first audience counts obtained at a first time and second audience ratings or second audience counts obtained at a second time; and
adding specific images or sounds in said image content or said sound content to said digest according to said differences, or deleting said specific images or sounds from said digest according to said differences.
11. The method as claimed in claim 1, said method further comprising the steps of:
obtaining differences between first audience ratings or first audience counts, and, second audience ratings or second audience counts, wherein said first audience ratings or said first audience counts correspond to audiences who have watched or listened to said digest generated before, and said second audience ratings or said second audience counts correspond to audiences who have not watched or listened to said digest generated before; and
12. A digest generating apparatus used for generating a digest of image content or sound content, said digest generating apparatus comprising:
an obtaining part for obtaining an audience rating or an audience count of image content or sound content at established time intervals;
an extraction part for extracting images from said image content or extracting sounds from said sound content, wherein the extracted images or the extracted sounds correspond to a time when said audience rating or said audience count exceeds a threshold; and
a generation part for generating a digest by using the extracted images or the extracted sounds.
13. The digest generating apparatus as claimed in claim 12, said obtaining part comprising:
a part for obtaining audience data indicating that an audience has watched or has listened to said image content or said sound content; and
a part for obtaining said audience rating or said audience count by using said audience data for a plurality of audiences.
14. The digest generating apparatus as claimed in claim 12, when said image content or said sound content includes a plurality of programs, said digest generating apparatus comprising, instead of said extraction part and said generation part:
a part for obtaining short images corresponding to at least a program, among said plurality of programs, whose audience rating or audience count exceeds a threshold; and
a part for generating a digest by using said short images.
15. The digest generating apparatus as claimed in claim 12, said digest generating apparatus comprising:
16. The digest generating apparatus as claimed in claim 12, wherein said audience rating or said audience count is obtained by using audience data corresponding to an audience group having a specific user profile at established time intervals.
17. The digest generating apparatus as claimed in claim 12, said digest generating apparatus comprising:
a part for increasing or decreasing, by a predetermined amount, said audience rating or said audience count that corresponds to predetermined images or sounds in said image content or said sound content; and
a part for generating said digest by using increased or decreased audience ratings, or by using increased or decreased audience counts.
18. The digest generating apparatus as claimed in claim 12, wherein said predetermined images or sounds can be changed over time.
19. The digest generating apparatus as claimed in claim 12, said digest generating apparatus comprising:
20. The digest generating apparatus as claimed in claim 19, wherein said predetermined images or sounds can be changed over time.
21. The digest generating apparatus as claimed in claim 12, said digest generating apparatus further comprising:
a part for obtaining differences between first audience ratings or first audience counts obtained at a first time and second audience ratings or second audience counts obtained at a second time; and
a part for adding specific images or sounds in said image content or said sound content to said digest according to said differences, or deleting said specific images or sounds from said digest according to said differences.
22. The digest generating apparatus as claimed in claim 12, said digest generating apparatus further comprising:
a part for obtaining differences between first audience ratings or first audience counts, and, second audience ratings or second audience counts, wherein said first audience ratings or said first audience counts correspond to audiences who have watched or listened to said digest generated before, and said second audience ratings or said second audience counts correspond to audiences who have not watched or listened to said digest generated before; and
23. A computer program for causing a computer to generate a digest of image content or sound content, said computer program comprising:
obtaining program code means for obtaining an audience rating or an audience count of image content or sound content at established time intervals;
extraction program code means for extracting images from said image content or extracting sounds from said sound content, wherein the extracted images or the extracted sounds correspond to a time when said audience rating or said audience count exceeds a threshold; and
generation program code means for generating a digest by using the extracted images or the extracted sounds.
24. The computer program as claimed in claim 23, said obtaining program code means comprising:
program code means for obtaining audience data indicating that an audience has watched or has listened to said image content or said sound content; and
program code means for obtaining said audience rating or said audience count by using said audience data for a plurality of audiences.
25. The computer program as claimed in claim 23, when said image content or said sound content includes a plurality of programs, said computer program comprising, instead of said extraction program code means and said generation program code means:
program code means for obtaining short images corresponding to at least a program, among said plurality of programs, whose audience rating or audience count exceeds a threshold; and
program code means for generating a digest by using said short images.
26. The computer program as claimed in claim 23, said computer program comprising:
27. The computer program as claimed in claim 23, wherein said audience rating or said audience count is obtained by using audience data corresponding to an audience group having a specific user profile at established time interval.
28. The computer program as claimed in claim 23, said computer program comprising:
program code means for increasing or decreasing, by a predetermined amount, said audience rating or said audience count that corresponds to predetermined images or sounds in said image content or said sound content; and
program code means for generating said digest by using increased or decreased audience ratings, or by using increased or decreased audience counts.
29. The computer program as claimed in claim 28, wherein said predetermined images or sounds can be changed over time.
30. The computer program as claimed in claim 23, said computer program comprising:
31. The computer program as claimed in claim 30, wherein said predetermined images or sounds can be changed over time.
32. The computer program as claimed in claim 23, said computer program further comprising:
program code means for obtaining differences between first audience ratings or first audience counts obtained at a first time and second audience ratings or second audience counts obtained at a second time; and
program code means for adding specific images or sounds in said image content or said sound content to said digest according to said differences, or deleting said specific images or sounds from said digest according to said differences.
33. The computer program as claimed in claim 23, said computer program further comprising:
program code means for obtaining differences between first audience ratings or first audience counts, and, second audience ratings or second audience counts, wherein said first audience ratings or said first audience counts correspond to audiences who have watched or listened to said digest generated before, and said second audience ratings or said second audience counts correspond to audiences who have not watched or listened to said digest generated before; and
34. A computer readable medium storing program code for causing a computer to generate a digest of image content or sound content, said computer readable medium comprising:
35. The computer readable medium as claimed in claim 34, said obtaining program code means comprising:
36. The computer readable medium as claimed in claim 34, when said image content or said sound content includes a plurality of programs, said computer program comprising, instead of said extraction program code means and said generation program code means:
37. The computer readable medium as claimed in claim 34, said computer readable medium comprising:
38. The computer readable medium as claimed in claim 34, wherein said audience rating or said audience count is obtained by using audience data corresponding to an audience group having a specific user profile at established time intervals.
39. The computer readable medium as claimed in claim 34, said computer readable medium comprising:
40. The computer readable medium as claimed in claim 39, wherein said predetermined images or sounds can be changed over time.
41. The computer readable medium as claimed in claim 34, said computer readable medium comprising:
42. The computer readable medium as claimed in claim 41, wherein said predetermined images or sounds can be changed over time.
43. The computer readable medium as claimed in claim 34, said computer readable medium further comprising:
44. The computer readable medium as claimed in claim 34, said computer readable medium further comprising:
[0030]FIGS. 1A and 1B are figures for explaining concepts of the embodiments of the present invention;
[0031]FIG. 2 is a block diagram of a system of a first embodiment of the present invention;
[0032]FIG. 3 shows an example of audience data according to the first embodiment of the present invention;
[0033]FIG. 4 shows an example of the digest target program list according to the first embodiment of the present invention;
[0034]FIG. 5A shows examples of audience ratings every 30 seconds for each digest target program;
[0035]FIG. 5B shows image parts extracted as the digest from the table shown in FIG. 5A;
[0036]FIG. 6 shows a flowchart showing a procedure for generating a digest according to the first embodiment of the present invention;
[0037]FIG. 7 shows a block diagram of a system according to a second embodiment of the present invention;
[0038]FIG. 8 shows an example of a digest target program list according to the second embodiment of the present invention;
[0039]FIG. 9 shows an example of audience data according to the second embodiment of the present invention;
[0040]FIG. 10 is a flowchart indicating a procedure of generating a digest according to the second embodiment of the present invention;
[0041]FIG. 11 shows a block diagram of a system according to a third embodiment of the present invention;
[0042]FIG. 12 show s a configuration example of audience data according to the third embodiment of the present invention;
[0043]FIG. 13 shows a process flowchart of a system according to the third embodiment of the present invention;
[0044]FIG. 14 shows an example of audience data stored in an audience data storing part 112 according to the third embodiment of the present invention;
[0045]FIG. 15 shows a flowchart indicating a procedure for generating a histogram according to the third embodiment of the present invention;
[0046]FIG. 16 is a figure for explaining a procedure for generating a digest according to the third embodiment of the present invention;
[0047]FIG. 17 shows a block diagram of a system according to a fourth embodiment of the present invention;
[0048]FIG. 18 shows an example of a user profile stored in an audience data storing part 122 according to the fourth embodiment of the present invention;
[0049]FIG. 19 shows an operation flowchart of a system according to the fourth embodiment of the present invention;
[0050]FIG. 20 is a block diagram of a system according to a fifth embodiment of the present invention;
[0051]FIG. 21 is a figure for explaining a procedure for generating a digest in the fifth embodiment of the present invention;
[0052]FIG. 22 is a figure for explaining a procedure for generating a digest in a sixth embodiment of the present invention;
[0053]FIG. 23 is a block diagram of a system of a seventh embodiment of the present invention;
[0054]FIG. 24 is an operation flowchart of a system of the seventh embodiment of the present invention;
[0055]FIG. 25 is a figure for explaining a procedure for generating a digest according to the seventh embodiment of the present invention;
[0056]FIG. 26 is a block diagram of a computer that can be used as a digest image generating apparatus.
[0059]FIGS. 1A and 1B are figures for explaining concepts of the embodiments of the present invention. FIG. 1A is an example of a graph showing a relationship between time and audience ratings on ◯ month ◯ day. According to the present invention, a threshold of the audience rating is predetermined, and images corresponding to times when the audience rating exceeds the threshold are picked up, so that the digest is generated. In the example of FIG. 1A, images (a) of a variety program are picked up first since the audience ratings of the time of the images exceed the threshold. Images (b) of a news program are picked up next. Then, every time when the audience rating exceeds the threshold, the image of the time is picked up.
[0067]FIG. 2 is a block diagram of the system of the first embodiment. This system includes a digest image generating apparatus 1 for generating a digest, a plurality of audience terminals 2 that are broadcast receive terminals of each audience, a broadcasting station 3 for providing program content by broadcasting, and a network 4 such as the Internet.
[0069]FIG. 3 shows an example of the audience data generated by the audience data generation part 24. The digest image generating apparatus 1 receives the audience data, so as to grasp that a program corresponding to the channel number is watched or listened to at a viewing time (a time interval including the viewing time) indicated in the audience data in the terminal that sends the audience data.
[0073]FIG. 4 shows an example of the digest target program list 51 according to the first embodiment. The digest target program list 51 includes one or more digest target programs that are targets for making a digest. The digest target programs can be specified by the digest maker. For specifying a digest target program, a time period and a channel can be specified as shown in an example of FIG. 4, also, a broadcast station and a time period can be specified. In addition, by preparing the digest target program list including programs of a specific genre, digests for each genre can be generated. Further, the system can be configured such that a genre can be specified from a plurality of genres, so that the system generates a digest including images of programs of the specified genre.
[0079]FIGS. 5A and 5B are figures for explaining extraction of images as the digest according to the first embodiment of the present invention. FIG. 5A shows examples of audience ratings every 30 seconds for each digest target program. The program ID is information for specifying each digest target program. For example, if the threshold is 20%, the circled parts are extracted. FIG. 5B shows image parts extracted as the digest from the table shown in FIG. 5A.
[0081]FIG. 6 shows a flowchart of a procedure for generating a digest according to the first embodiment of the present invention. In step S10, a digest maker sets thresholds for every time period, for example, according to past audience rating statistics or the number of all terminals. Next, processes after step S11 are repeated (step S11) until the digest target program in the digest target program list ends. If the digest target program ends, the process goes to step S18.
[0089]FIG. 7 is a block diagram of a system according to the second embodiment. This system includes a digest image generating apparatus 6 for generating a digest, audience apparatuses 2 that are broadcast receiving terminal of each audience, a broadcasting station 3 for providing program content, and a network 4 such as the Internet.
[0093]FIG. 8 shows an example of the digest target program list according to the second embodiment. The example shown in FIG. 8 corresponds to a case where a climax scene of a program is obtained from the Internet. The list includes program name, program ID, program content URL (Uniform Resource Locator), time period (time period of climax image), and climax image URL. In this example, by specifying the climax image URL, an image of a climax scene can be obtained. In addition, by preparing a digest target program list including programs of a specific genre, a digest of the genre can be generated.
[0098]FIG. 10 is a flowchart indicating a procedure of generating the digest according to the second embodiment. First, a threshold specified by the digest maker according to past audience rating statistics or estimation from the number of all terminals is set in step S20. Then the digest image generating apparatus calculates the highest audience rating for each program from the audience data received from each audience terminal 2 in step S21.
[0106]FIG. 11 shows a block diagram of a system of this embodiment. As shown in the figure, the system includes an audience data extraction apparatus 100 for obtaining audience data sent from the image viewing apparatus 90 and sending the audience data, and a digest generating apparatus 110 for generating a digest on the basis of audience data sent from a plurality of audience data extraction apparatus 100.
[0108]FIG. 12 shows a configuration example of the audience data. Information of (a) indicating “playback” is reflected on an after-mentioned histogram, and the information of “jump” and “search ” is not reflected on the histogram.
[0115]FIG. 13 shows a process flow of the system of the third embodiment. First, the audience data extraction apparatus 100 extracts audience data from the image viewing apparatus 90 in step S101. The extraction of the audience data is performed in real time at the same time when the audience watches or listens to the image content. The audience data can be also obtained from the image viewing apparatus collectively after the image is watched or listened to.
[0120]FIG. 15 shows a flowchart indicating a procedure for generating the histogram according to the third embodiment of the present invention. In this procedure, processes of steps S111-S115 are performed for each piece of the audience data, and the histogram is generated.
[0123]FIG. 16 is a figure for explaining a procedure for generating a digest according to the third embodiment.
[0133]FIG. 17 shows a block diagram of a system according to the fourth embodiment of the present invention. The same numerals are assigned to the same parts as those of the third embodiment.
[0136]FIG. 19 shows an operation flowchart of the system according to the fourth embodiment of the present invention. The operation of the system in the fourth embodiment will be described with reference to FIG. 19.
[0142]FIG. 20 is a block diagram of a system according to the fifth embodiment of the present invention. The system of the fifth embodiment includes a filter storing part 135 that stores the excluding filter, in addition to the configuration of the third embodiment or the fourth embodiment. The excluding filter indicates time intervals in image content that should be excluded from a digest. The excluding filter is provided for each piece of image content as necessary. This excluding filter includes one or more intervals (such as “start time-end time”) each of which interval indicates images that should be excluded from a digest.
[0143]FIG. 21 is a figure for explaining a procedure for generating a digest in the fifth embodiment of the present invention.
[0150]FIG. 22 is a figure for explaining a procedure for generating a digest in the sixth embodiment of the present invention.
(Modification of the Fifth and Sixth Embodiments)
[0159]FIG. 23 is a block diagram of a system of the seventh embodiment of the present invention. In the seventh embodiment, an audience data storing part 142 is used instead of the audience data storing part 122 in the system of the fourth embodiment shown in FIG. 17, in which the audience data storing part 142 stores not only the audience data and the user profile for each piece of image content, but also information indicating whether an audience has viewed a digest corresponding to the image content before.
[0161]FIG. 24 is an operation flowchart of the system of the seventh embodiment of the present invention.
US20060104609 * Nov 8, 2005 May 18, 2006 Kabushiki Kaisha Toshiba Reproducing device and method
US8701031 Oct 11, 2007 Apr 15, 2014 Sharp Kabushiki Kaisha Content reproducing apparatus, content reproducing method, server, content reproducing system, content reproducing program, and storage medium
US9426507 Aug 5, 2014 Aug 23, 2016 Panasonic Intellectual Property Management Co., Ltd. Information recommendation device, information recommendation system, and information recommendation method
US20160343403 * Mar 23, 2016 Nov 24, 2016 Casio Computer Co., Ltd. Moving image generating apparatus, moving image generating method and storage medium
EP2187323A2 * Nov 6, 2009 May 19, 2010 Brother Kogyo Kabushiki Kaisha Information processing device, node device, method for processing reproduction information, and reproduction information processing program
EP2187323A3 * Nov 6, 2009 Jan 19, 2011 Brother Kogyo Kabushiki Kaisha Information processing device, node device, method for processing reproduction information, and reproduction information processing program
U.S. Classification 704/278, 348/E07.07
International Classification H04N7/173, H04N21/258, G10L21/00, H04H9/00, H04H60/07, H04H60/66, H04H60/31, H04H1/00
Cooperative Classification H04H60/31, H04N7/17309, H04N21/25891, H04H60/07, H04H60/66
European Classification H04N21/258U3, H04H60/31, H04N7/173B, H04H60/07, H04H60/66
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:WATANABE, TOMOKI;UEGAKI, SHINYA;KISHIDA, KATSUMI;AND OTHERS;REEL/FRAME:013797/0183