Source: http://www.google.com/patents/US6321024?dq=5,912,661
Timestamp: 2016-05-29 23:21:49
Document Index: 481655855

Matched Legal Cases: ['Application No. 8', 'Application No. 7', 'Application No. 8', 'Application No. 7', 'Application No. 8', 'Application No. 2', 'Application No. 4']

Patent US6321024 - Control method for detecting change points in motion picture images and for ... - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign inPatentsOnly a video cut (containing a frame) designated by a user is automatically and correctly extracted directly from a video image under playing operation at high speed. A judgement is made as to whether or not the frame of the video image is designated by the user. When such a user designation is made,...http://www.google.com/patents/US6321024?utm_source=gb-gplus-sharePatent US6321024 - Control method for detecting change points in motion picture images and for stopping reproduction thereof and control system for monitoring picture images utilizing the sameAdvanced Patent SearchPublication numberUS6321024 B1Publication typeGrantApplication numberUS 09/426,902Publication dateNov 20, 2001Filing dateOct 26, 1999Priority dateOct 11, 1995Fee statusPaidAlso published asUS5974219Publication number09426902, 426902, US 6321024 B1, US 6321024B1, US-B1-6321024, US6321024 B1, US6321024B1InventorsTakehiro Fujita, Takafumi Miyatake, Akio Nagasaka, Katsumi TaniguchiOriginal AssigneeHitachi, Ltd.Export CitationBiBTeX, EndNote, RefManPatent Citations (2), Referenced by (53), Classifications (40), Legal Events (3) External Links: USPTO, USPTO Assignment, EspacenetControl method for detecting change points in motion picture images and for stopping reproduction thereof and control system for monitoring picture images utilizing the same
US 6321024 B1Abstract
This application is a continuation of application Ser. No. 08/727,046 filed Oct. 8, 1996, now U.S. Pat. No. 5,974,219.
The present application relates to subject matter described in application Ser. No. 09/626,119 filed Jul. 26, 2000, which is a continuation of application Ser. No. 08/604,606, filed Feb. 21, 1996, now U.S. Pat. No. 6,157,744, entitled “METHOD AND APPARATUS FOR DETECTING A POINT OF CHANGE IN A MOVING IMAGE” invented by Akio NAGASAKA, Takafumi MIYATAKE, Kazuaki TANAKA, Takehiro FUJITA, and Shigeki NAGAYA, claiming priority based on Japanese Patent as Japanese Laid-Open Patent Application No. 8-227462, the disclosures of which are incorporated herein by reference.
The present application relates to subject matter described in application Ser. No. 08/604,606, filed on Feb. 21, 1996, entitled “METHOD AND APPARATUS FOR DETECTING A POINT OF CHANGE IN A MOVING IMAGE” invented by Akio NAGASAKA, Takafumi MIYATAKE, Kazuaki TANAKA, Takehiro FUJITA, and Shigeki NAGAYA, claiming priority based on Japanese Patent Application No. 7-32027 filed on Feb. 21, 1995, published as Japanese Laid-Open Patent Application No. 8-227462, the disclosure of which is hereby incorporated by reference.
The present invention relates to a technique for detecting a change point of a video cut of a video image (a continuous video image section photographed by a single video camera) stored in a video tape, a disk and the like, and also to a technique for playing/editing the video image by using this detecting technique. In particular, the present invention concerns a change-point-detection control method of a video image suitable for carrying out the editing work of the video image in a high efficiency, to a play-stop control method performed based on this change-point-detection control method, and to a video image editing system with employment of these control methods.
Very recently, video image (moving image) information could be utilized in digital forms since high-speed computers are available and storage devices with large memory capacities are available. Especially, in the editing field of video images, digitalized video images could be handled in photographing apparatuses and editing apparatuses, by which television broadcast programs are manufactured, video programs are formed, and hyper media moving pictures are manufactured. For instance, “Media Composer”, “Video Shop” and the like are marketed by Avid Technology firm in U.S.A. as such video image editing apparatuses.
Although the video cut is automatically segmented, the picture elements must be previously segmented into the video cuts in order to form the list. To precisely segment the picture elements in the frame wise with respect to each video cut, the frame images contained in the video image must be compared with each other one by one. As a result, to execute the list forming process by the automatic video segment, the same or more time is required, as compared with the time required to play the overall video image. Thus, the preparation time until the user can commence the editing work would be prolonged. For instance, more than 1 hour is needed when picture elements for 1 hour are segmented into video cuts. This problem is not negligible with respect to such a quick-operable editing work, e.g., editing works of news programs. According to the experience rule available in the actual editing word, it is believed that “picture elements actually used in editing works are less than 10% of entire picture elements”. Normally, since the video cuts actually used by the user are small among the photographed picture elements, it is not always preferable to segment all of the picture elements into the video cuts.
As described above, since a mark is attached to the frame 201 and also the IN frame 205 and the OUT frame 207 of the video cut containing this frame 201 are automatically detected to find out the first frame and the last frame, the user is no longer required to find out a head and a tail of the video cut by using a jog-shuttle dial in a manual manner. In this case, the frame 201 to be marked may be selected from any frame contained in the scene. As a consequence, the user merely marks such a vague designation “a cut is needed around a certain frame”, so that a desirable video cut can be detected.
In the video image display region 308, the frame image entered from the video image input apparatus 103 of FIG. 3 is displayed. In the frame number display box 309, the frame number of the frame displayed in the video image display region 308 is displayed. In this example, since a video image is constituted by 30 pieces of frames per one second, the frame number is converted into the time code which is displayed in such a form “hh:mm:ss:ff (hh=hour, mm=minute, ss=second, ff=frame). Since the frame number is displayed in such a time form rather than the number, as explained above, the position and the length can be intuitively grasped, which is very convenient to the users.
A mark setting button 310 is arranged on the mark setting panel 304. The mark setting button 310 is a command button used to mark a frame. When the user finds out a desirable scene while observing the display of the monitor 302, the user clicks the mark setting button 310 to set the mark. As a result, the user may issue such a rough instruction that “a cut is needed around a certain frame” while confirming the content of the video image.
A video image file name of a video cut stored by the section extracting button 323 may be made of such a numeral series as “hhmmssff” in accordance with the frame number of the marked frame. Alternatively, an input means may be separately provided by which the file name may be set. Since the extracted video cuts can be immediately utilized in the subsequent editing states, the preparation time required for the editing work can be reduced.
At the step 404, a flag group indicative of a process condition is initialized. In this case, “flagQUIT” indicates that an end request is issued from the user “status” shows the operation condition of the video image playing apparatus 101. “flagMARK” indicates that the mark is set by the user “flagIN” denotes that the IN frame of the video cut has already been detected. “flagOUT” shows that the OUT frame of the video cut has already been detected.
It is possible to avoid that either the head or the tail is mistakenly detected while the mark is not set by the flag “flagMark”. As to the marked frame, it is possible to avoid such a wasted operation that either the head or the tail is detected several times by the flags “flagIN” and “flagOUT”.
Next, at a step 409, a request of a user is detected. The request of the user is inputted by clicking the command button by using the mouse of FIG. 2. Accordingly, a judgement is made as to whether or not clicking of the command button is present to thereby detect whether or not a use request, for instance, a frame desired by the user is designated. In other words, when the mouse 105 of FIG. 2 is clicked, the clicked position is compared with the position of each of the command buttons on the interactive playing process window 301 of FIG. 3, in order to discriminate the selected command button from other command buttons. In the case that the command button is clicked, it is judged as to whether or not the designated command button corresponds to an end button 307 (step 410). If the designated button is the end button, then the flag “flagQUIT” is set to “TRUE” (step 411). If the designated button is other button, then a process operation is executed in accordance with the designated command button (step 412).
At a step 603, the response status is judged. When an error happens to occur, an error message is displayed on the display apparatus 101 and the control process is interrupted at a step 604. When the control process can be done under normal state, “status” indicative of the operation condition of the video image playing apparatus 101 of FIG. 2 is updated in response to the transmitted control command at the next steps 605 to 611. For example, when the control command corresponds to the frame feed and the frame return, since the motion image picture playing apparatus 101 is brought into the pause condition after the execution, “status” is updated to “PAUSE” (steps 609, 610).
As a result, the frame number is fine-adjusted in accordance with the operation condition “status” of the video image playing apparatus 110 of FIG. 2 as explained at steps 701 to 705.
At the step 701, the operation condition “status” is judged. When the “status” is “PAUSE”, since the above-described acquired frame difference is not produced, the frame image and the frame number which are inputted at the process operation of the steps 406 and 407 can be directly utilized as the mark information. In other words, the frame number acquired at the step 407 is substituted for the marked number “Nmark” (step 702). When “status” is the status other than “PAUSE”, since there is time required to judge the command button at the step 409, a shift is produced between the frames entered at the steps 406 and 407, and the frame under play.
Therefore, the frame image and the frame number are again entered. In other words, at the step 703, the frame image is again inputted in a similar manner to the step 406, and at the step 704, the frame number is again inputted in a similar manner to the step 407. Furthermore, considering the above-described difference, the frame difference caused by “status” is subtracted from the frame number inputted at the step 704, and the subtraction result is fine-adjusted, and then the fine-adjusted subtraction result is substituted for “Nmark”.
At a step 706, the image and the number “Nmark” of the marked frame are store as the mark information into another region of the memory 109 of FIG. 2. As to the frame image, an image of a frame buffer 103 shown in FIG. 11 is duplicated into a region for the mark information. At this time, the frame images may be thinned to have dimensions required for the representation. Furthermore, the mark information is displayed in the frame image display region 312 and the frame number display box 313 on the mark display panel 305 of FIG. 3.
At a step 707, “TRUE” is substituted for “flagMark”, which registers that the mark is set by the user.
While the user confirms the content of the video image, the user can make such a rough designation that “a cut is needed around a certain frame” in the above-described manner.
At steps 708 and 709, the information related to the IN frame and the OUT frame of the video cut which has been detected based on the previous mark information is reset. That is, at the step 708, “FALSE” is substituted for “flagIN” and “flagOUT” to be initialized, which represents detection states of the IN frame and the OUT frame. At the step 709, the indications of the images and the numbers for the IN frame and the OUT frame displayed on the cut display panel 306 of FIG. 3 are erased.
At a step 802, both the frame number “Nmark” of the marked frame and a retrieve command are transmitted to the video image playing apparatus 110 of FIG. 3, and then the video image playing apparatus 110 is brought into the pause state in the frame of “Nmark”.
Next, a feature amount of an image is calculated in this frame wise, and a correlation coefficient between the successive frames is calculated between this calculated feature amount and another feature amount calculated immediately before this feature amount. A change point such that the value of this correlation coefficient is present outside a preselected allowable range, and thus a frame number “n” immediately after the video cut is changed is calculated. The technique for detecting the change point may be realized by utilizing the previously explained technique as described in application Ser. No. 08/604,606 claiming priority based on Japanese Patent Application No. 7-32027 published as Japanese Laid-Open Patent Application No. 8-227462. It should be noted that this detection operation will be described later with reference to FIG. 10.
At a step 804, a frame number immediately before the change point is calculated. That is, the frame number immediately before the change point is obtained from the frame number “n” immediately after the change point, and then is substituted for an IN (OUT) frame number NchangeI (NchangeO).
At a step 807, “TRUE” is substituted for either “flagIN” or “flagOUT” to thereby register that either the IN frame or the OUT frame has been detected.
At a step 808, a judgement is made of the detecting contain for the IN frame or the OUT frame. When both the frames are detected, “FALSE” is substituted for “flagMark”. In accordance with the process operation defined at this step 809, it is possible to avoid such a waste detection that the same IN (OUT) frame is detected several times even when the command button 315 (316) of FIG. 3 is designated for the same mark.
At a step 901, it is judged as to whether or not the video cut has already been detected. If both the value of “flagIN” and “flagOUT” indicative of the detection states are equal to “TRUE”, a process operation defined at a step 902 is executed. If either one of the detecting states is equal to “FALSE”, then no process operation is executed, but the process operation is returned to the process operation within the loop of the step 405 shown in FIG. 4.
In the case of the section playing operation, the frame numbers “NchangeI” and “NchangeO” of the IN frame and the OUT frame are read out which have been stored in the memory 109 of FIG. 2 at the step 805 of FIG. 8, the section playing commands from the frame numbers “NchangeI” to “NchangeO” are transmitted to the video image playing apparatus 110 of FIG. 2, and then the played frames are read to be displayed on the monitor 302. In the case of the section extracting operation, the read frame is stored in the auxiliary storage apparatus 106 of FIG. 2. Alternatively, the frame image to be stored may be directly stored from the video image input apparatus 103 of FIG. 2 into the auxiliary storage apparatus 106, and this frame image has an image quality and and a size which are sufficient for the editing operation. For example, a file name to be stored is set by converting the value of “NchangeI” into a character series. In this case, since the extracted video cut can be immediately used in the subsequent editing operation, the preparation time required for the editing operation can be reduced, and the video cut segmenting function may be effectively cooperated with the conventional video image editing apparatus.
This change point detecting technique will now be simply explained. It should be noted that this example represents such a case that the video image is played in the past time domain direction (reverse playing direction), and then the frame numbers are decremented in this manner “n+1, n, n−1” while the frame images are played.
In this change point detecting technique, a histogram of colors “Hn” is formed as a feature amount of a frame image “fn” every frame. A histogram of colors corresponds to a frequency at which the same colored pixels appear in the entire frame image. For instance, in such a case that a histogram of colors “64 colors, each of 2-bit R, G, B colors” is formed, upper 2 bits of the respective RGB pixels of the frame image “fn” are derived to reduce the entire colors into 64 colors. The pixel numbers of the respective colors are counted to form a histogram of colors 1002. The color histogram is represented by an arrangement “Hn(i) (i=0,1, . . . ,63)”. Next, a correlation coefficient “Rln” of the color histograms “Hn+1” and “Hn” is calculated between the frame image “fn+1” and the frame image “fn” adjacent to the first-mentioned frame image “fn+1”.
Furthermore, another correlation coefficient “R2n” of the color histograms “Hn+2” and “Hn” is calculated between the frame image “fn+2” and the frame image “fn”. These correlation coefficients “R1n ”, R2n” may be calculated by employing the χ2 test chi-square test calculation formula widely used in the statistical process, and the calculation formula as described in U.S. Pat. No. 5,083,860 claiming priority based on Japanese Patent Application No. 2-230930 published as Japanese Laid-Open Patent Application No. 4-111181. The values of the correlation coefficients “R1n”, “R2n” become small when the colors and pictorial patterns of the frame images are similar to each other. Conversely, these values of the correlation coefficients become large when the colors and pictorial patterns of the frame images are not similar to each other. Therefore, the correlation coefficients “R1n”, “R2” are compared with a predetermined threshold value to judge whether or not one correlation coefficient is larger than the other correlation coefficient. If “R1n+1” becomes large, “R1” becomes small, and “R2n” becomes large, then it is judged that a change point is present between the frame image “fn+2” and the frame image “fn+1”, so that a change point 1001 can be detected. At this time, in this detection process, the frame number “n+1” immediate after the frame change is recorded as the change point.
Reference numeral 1003 shown in FIG. 10 indicates a frame stored in the frame buffer 1103 of FIG. 11. As described above, the change point 1001 is detected at a time instant when the frame image “fn” is acquired to be evaluated. As a result, if at least three frame images are stored into the buffer as in the frame 1003, the frame image “fn+2” immediately before the change point 1001 may be displayed on the cut display panel 320 of FIG. 3.
The respective data are stored in the memory 109, or the auxiliary storage apparatus 106 shown in FIG. 2. It should be understood in this case that the present frame is indicated as “m”, the frame immediately before the present frame is denoted as “m−1”, and the further frame immediately before the present frame is indicated as “m−2”.
A color histogram buffer 1102 corresponds to a ring buffer used to detect the change point shown in FIG. 10, which continuously stores the color histograms for the three current frames. The information concerning the overall color histogram buffer 1102 is stored in a header 1108, and this information is a data size of an array element for storing a total number of colors used in the histogram (64 colors in case of FIG. 10), and a frequency value. A head offset 1109 corresponds to a value of a head position for indicating that the color histogram of the respective frames has been stored from which position within the color histogram buffer 1102. The present offset 1110 corresponds to a value indicative of a storage starting point of a color histogram array of the present frame “m”.
In FIG. 11, reference numerals 1111 to 1113 indicate an array of color histograms with respect to each of frames. Since a data size of this array may be obtained by multiplying a total number of colors of the header 1108 by the data size of the array element, the offset of the each color histograms 1111 to 1113 may be readily calculated from a head offset 1109 and the data size of the array. When a color histogram of the next frame is obtained, the histogram of the oldest frame “m−2” is overwritten by this histogram. In this case, the color histogram 1113 is overwritten by this histogram. At this time, the present offset is rewritten from the offset of the color histogram 1112 to the offset of the color histogram 1113.
The present offset 1116 is such a value for indicating a storage starting position of frame image data of the present frame “m”.
Similarly, a head offset 1117 of the attribute data indicates a value of a storage head position in the frame buffer 1103 of an image attribute buffer 1120, whereas an offset 1118 of the present attribute data is a value indicative of a storage start position of the attribute data of the present frame “m”.
The frame image data of the respective frames are stored in the frame image data buffer 1119, and the image attribute data of the respective frames are stored in the respective frames. In this case, an “image attribute” implies information related to the respective frame images such as a frame number. Similar to the above-described color histogram buffer 1102, the offsets of the respective frame image data and the attribute data may be easily calculated by using the information about the header 1114. Also, the data are rewrite in a similar manner to the color histogram buffer 1102. The information stored in the frame image data buffer 1119 and the image attribute buffer 1120 with respect to each of the frames is stored in the same sequence, and therefore, the information about the same frame can be stored in one-to-one correspondence.
Since the video image is played at high speed, the list of the typical images can be quickly formed. For instance, it is now assumed that the “ε-cam” video deck which is, widely used in professional editing work is employed as the video image playing apparatus 110 of FIG. 2. Since a video image can be played at eight-times high speed by this video deck, it is possible to form a list of typical images from one hour of picture elements within 8 minutes.
To calculate a difference degree between images, the correlation coefficient for detecting the change point, as described with respect to FIG. 10, is utilized. A correlation efficient “R” between a color histogram of the frame image 1205 and a color histogram of the typical image 1206 is calculated. This “R” is compared with a predetermined threshold value, and then only when it is judged that the value of “R” is larger than the predetermined threshold value, the frame image 1205 is displayed as the typical image. Conversely, when it is so judged that the value of “R” is smaller than the predetermined threshold value, the thickness of the typical image 1206 is increased as indicated as the typical image 1204, and a plurality of images are combined with each other to form a single image, which can be readily grasped by the user.
Also, if the video cut information number on the video cut information display panel 1502 is clicked by using the mouse, this relevant video cut can be selected. At this time, the cut information 1506 is reverse-displayed, which may indicate that this video cut information 1506 has been selected. Reference numeral 1207 is a mouse cursor. In the example of FIG. 15, the video cut information of the number “2” is selected. As a consequence, the video cut which has been detected by the command button on the video cut operation panel 32 may be again played, or may be digitalized to be acquired.
In the feature amount check box 1702, a list of feature amounts is present which can be used to detect a change point, from which the user can select the feature amount, depending on his desire. In this case, there are represented a feature amount of an image (described as “Image” in the drawing), a feature amount of a sound (described as “Sound” in the drawing), and a combination between then (described as “Image+Sound” in the drawing). In this example, the combination of both the image and sound feature amounts (Image+Sound) is selected. When the user selects “Image”, a change point is detected based on a feature amount of an image, as described above.
In such a case that “Image+Sound” is selected as in this example, the change point is first detected based upon the feature amount of the image. At the time when the change point is detected, the process operation is switched to a change point detection of a sound feature amount. In this change point detection of the sound, a sound (audio) signal is checked after a time instant when a change point in an image is detected. Next, a point where the sound is changed is detected, and the change point of the sound is recorded as a change point of a video image.
In this FIG. 18, an abscissa indicates time, and an ordinate denotes an amplitude of a sound signal. A no sound section is a section where an absolute value of an amplitude is smaller than a predetermined threshold value “Sth”. A no sound point may be detected as a starting point of the no sound section. However, there is a certain case that a conversation is instantaneously interrupted during personal conversation, and thus an amplitude is lowered. In order not to erroneously detect a no sound point due to an occurrence of such an instantaneous no sound section, a check is done as to whether or not the no sound section is present every sound data for 1 frame. When the amplitudes are low over a preselected frame number, the no sound point is detected. In the case that the conversation end point where the conversation of the cast is interrupted and then only the background sounds such as BGM are present is detected, an autocorrelation coefficient of a audio signal is employed as a feature amount replaceable from a color histogram of an image.
In general, it is known that a human voice has a high autocorrelation. When sample values {xn}, n=0,1, . . . , n−1 of a voice waveform x(t) are given, an autocorrelation coefficient “ri” may be calculated based on the following formula: r   i = 1 N  ∑ n = o N - 1 - i  X   n   X   n + i [ Formula   1 ] where symbol “ri” is regarded as “Hn(i)”, a change point is detected. Since the basic frequencies of human voice are on the order of 50 Hz to 500 Hz, a maximum value of “i” may be obtained by employing a number of data obtained when the sample values {xn} are sampled at a frequency of approximately 1 kHz (=1 msec).
It should be noted that a data structure used to detect the sound change point is similar to that of the frame buffer 1103 in the case of the image in FIG. 11. Instead of the frame image a sound signal for 1 frame is stored. When the sound signal is checked, the sound signal data for a predetermined time period (for instance, 1 second=30 frames) are always stored in the ring buffer in the memory 109 of FIG. 2. When the sound data are acquired at the sampling frequency of 10 kHz, with 16 bits, and in a stereophonic system, since the data amount for 1 second is about 40 KB, no heavy load is given to the memory. When the sound data for 1 frame is read, the sound data of the oldest frame in the buffer are replaced by the sound data of the latest frame which are then stored. At this time, a judgement is made as to whether or not the no sound section is present from the sound data for 1 frame, and then a condition label for denoting whether or not the no sound section is present is stored into sound attribute data. Also, the autocorrelation coefficient of the sound signal is calculated. The autocorrelation coefficient of sound corresponds to the color histogram in case of the image. Furthermore, the correlation coefficient “R” between the frames is calculated from this autocorrelation coefficient, and then is stored into the sound attribute data.
Patent CitationsCited PatentFiling datePublication dateApplicantTitleUS5126851 *Dec 19, 1990Jun 30, 1992Canon Kabushiki KaishaVideo system using two different kinds of recording mediaUS5568275 *Jun 26, 1995Oct 22, 1996Avid Technology, Inc.Method for visually and audibly representing computer instructions for editing* Cited by examinerReferenced byCiting PatentFiling datePublication dateApplicantTitleUS6628889 *Dec 9, 1997Sep 30, 2003Sony CorporationEditing device, editing system and editing methodUS6762766 *Jul 6, 2000Jul 13, 2004Pentax CorporationImage processing computer system for photogrammetric analytical measurementUS6925602 *Mar 20, 2000Aug 2, 2005Intel CorporationFacilitating access to digital videoUS6961903 *Apr 5, 1999Nov 1, 2005Sony CorporationApparatus and method for reproducing character information recorded on a recording mediumUS7024095 *Nov 30, 1999Apr 4, 2006Sony CorporationEditing apparatus and method for extracting specified portions of editing materialUS7055100 *Sep 19, 1997May 30, 2006Sony CorporationEditing system, editing method, clip management apparatus, and clip management methodUS7143353 *Mar 30, 2001Nov 28, 2006Koninklijke Philips Electronics, N.V.Streaming video bookmarksUS7274864 *Jan 29, 2002Sep 25, 2007Intervideo Digital Technology CorporationMethod and device for digital video captureUS7280738 *Apr 9, 2001Oct 9, 2007International Business Machines CorporationMethod and system for specifying a selection of content segments stored in different formatsUS7280740 *Apr 5, 2001Oct 9, 2007Pioneer CorporationInformation recording medium, information recording apparatus and method, information reproducing apparatus and method, computer data signal embodied in a carrier waveUS7428006 *Apr 19, 2001Sep 23, 2008Ricoh Company, Ltd.Digital camera, mobile terminal, and method of displaying images for user controlled image connectionUS7540011 *Apr 19, 2002May 26, 2009Arrowsight, Inc.Caching graphical interface for displaying video and ancillary data from a saved videoUS7755566 *Jul 13, 2010Nokia CorporationDisplaying an imageUS7847806 *Dec 7, 2010Canon Kabushiki KaishaImage processing method, image processing apparatus, and printing apparatusUS8077940 *Dec 13, 2011Siemens AktiengesellschaftMethod for reconstructing a three-dimensional target volume in realtime and displaying itUS8149286Jun 13, 2007Apr 3, 2012Canon Kabushiki KaishaImage sensing apparatus and control method for same, and information processing apparatus, printing apparatus, and print data generation method, using correlation information recorded as attribute information of image data of frameUS8195028Nov 29, 2006Jun 5, 2012Thomson LicensingMethod for identifying a document recorded by a display, selection of key images and an associated receptorUS8345769 *Apr 10, 2007Jan 1, 2013Nvidia CorporationReal-time video segmentation on a GPU for scene and take indexingUS8358381Jan 22, 2013Nvidia CorporationReal-time video segmentation on a GPU for scene and take indexingUS8532458Jul 6, 2005Sep 10, 2013Samsung Electronics Co., Ltd.Picture search method and apparatus for digital reproductionUS8630528 *Jul 13, 2007Jan 14, 2014International Business Machines CorporationMethod and system for specifying a selection of content segments stored in different formatsUS8761581 *Oct 7, 2011Jun 24, 2014Sony CorporationEditing device, editing method, and editing programUS8854473 *Feb 11, 2011Oct 7, 2014Industrial Technology Research InstituteRemote tracking system and method for image object region using image-backward searchUS9241101May 4, 2011Jan 19, 2016Intellectual Ventures Fund 83 LlcDigital camera user interface for text entryUS9311962 *Sep 30, 2008Apr 12, 2016Sony United Kingdom LimitedAudio and/or video generation apparatus and method of generating audio and/or video signalsUS20010028788 *Apr 5, 2001Oct 11, 2001Pioneer CorporationInformation recording medium, information recording apparatus and method, information reproducing apparatus and method, computer data signal embodied in a carrier waveUS20010055070 *Apr 19, 2001Dec 27, 2001Ricoh Company, LimitedDigital camera, mobile terminal, and method of displaying imagesUS20020113757 *Dec 27, 2001Aug 22, 2002Jyrki HoiskoDisplaying an imageUS20020146236 *Apr 9, 2001Oct 10, 2002International Business Machines CorporationMethod and system for specifying a selection of content segments stored in different formatsUS20020163532 *Mar 30, 2001Nov 7, 2002Koninklijke Philips Electronics N.V.Streaming video bookmarksUS20020168181 *Jan 29, 2002Nov 14, 2002Kenny HsiaoMethod and device for digital video captureUS20030007663 *Apr 19, 2002Jan 9, 2003Lambert WixsonCaching graphical interface for displaying video and ancillary data from a saved videoUS20040070689 *Sep 25, 2003Apr 15, 2004Canon Kabushiki KaishaImage processing method, image processing apparatus, and printing apparatusUS20050204288 *Mar 25, 2005Sep 15, 2005Clapper Edward O.Facilitating access to digital videoUS20060013560 *Jul 6, 2005Jan 19, 2006Samsung Electronics Co., Ltd.Picture search method and apparatus for digital reproductionUS20060119620 *Jun 3, 2005Jun 8, 2006Fuji Xerox Co., Ltd.Storage medium storing image display program, image display method and image display apparatusUS20070153090 *Mar 1, 2007Jul 5, 2007Creative Technology LtdSystem for operating a plurality of mobile image capturing devicesUS20070233739 *Mar 20, 2007Oct 4, 2007Siemens AktiengesellschaftMethod for reconstructing a three-dimensional target volume in realtime and displaying itUS20070297757 *Jul 13, 2007Dec 27, 2007International Business Machines CorporationMethod and system for specifying a selection of content segments stored in different formatsUS20090028528 *Sep 30, 2008Jan 29, 2009Sony United Kingdom LimitedAudio and/or video generation apparatus and method of generating audio and/or video signalsUS20090051814 *Jul 11, 2008Feb 26, 2009Sony CorporationInformation processing device and information processing methodUS20090135257 *Jun 13, 2007May 28, 2009Canon Kabushiki KaishaImage sensing apparatus and control method for same, and information processing apparatus, printing apparatus, and print data generation methodUS20090185028 *Apr 20, 2007Jul 23, 2009Opt CorporationCamera apparatus and image recording/reproducing methodUS20090222730 *Apr 20, 2009Sep 3, 2009Arrowsight, IncCaching graphical interface for displaying video and ancillary data from a saved videoUS20100046909 *Nov 29, 2006Feb 25, 2010Louis ChevallierMethod for Identifying a Document Recorded by a Display, Selection of Key Images and an Associated ReceptorUS20110106879 *Oct 29, 2010May 5, 2011Samsung Electronics Co., Ltd.Apparatus and method for reproducing multimedia contentUS20120133778 *Feb 11, 2011May 31, 2012Industrial Technology Research InstituteTracking system and method for image object region and computer program product thereofUS20120281960 *Nov 8, 2012Alison Rose BonchaDigital camera user interface for video trimmingUS20160006944 *Jun 28, 2013Jan 7, 2016Thomson LicensingMethod and apparatus for automatic video segmentationCN100512402CJan 14, 2003Jul 8, 2009索尼株式会社Information-signal process apparatus and information-signal processing methodCN101326584BNov 29, 2006Jul 17, 2013汤姆森许可贸易公司Method for identifying a document recorded by a display, selection of key images and an associated receptorCN102547077A *Sep 29, 2011Jul 4, 2012索尼公司Editing device, editing method, and editing programWO2007065818A1 *Nov 29, 2006Jun 14, 2007Thomson LicensingMethod for identifying a document recorded by a display, selection of key images and an associated receptor* Cited by examinerClassifications U.S. Classification386/281, G9B/27.029, 348/E05.067, G9B/27.051, G9B/27.012, 707/E17.028, G9B/27.019, 386/243, 386/241, 386/282, 386/230, 386/285, 386/224International ClassificationG06T13/00, H04N5/91, G06T13/80, H04N5/14, G11B27/10, G11B27/034, G11B27/28, G06F17/30, G11B27/34, G11B27/22Cooperative ClassificationG11B2220/90, G06F17/3084, G11B27/22, G11B27/34, G11B27/28, H04N5/147, G11B2220/20, G11B27/105, G11B27/034, G06F17/30825European ClassificationG06F17/30V3E, G06F17/30V4R, G11B27/28, G11B27/10A1, H04N5/14S, G11B27/34, G11B27/034Legal EventsDateCodeEventDescriptionMay 16, 2005FPAYFee paymentYear of fee payment: 4Apr 22, 2009FPAYFee paymentYear of fee payment: 8Mar 7, 2013FPAYFee paymentYear of fee payment: 12RotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services