Patent ID: 8223269
Filing Date: 2012-07-17
Classification: G11B,H04N

Abstract:
1. A closed caption production device that produces synthesized video including video of a sound generating object that generates sound and a closed caption of the sound generated from the sound generating object based on a video signal and a sound signal, the sound signal including sound signals of a plurality of channels, said device comprising: a video recognizer that acquires information related to the video of the sound generating object as video information based on the video signal; a video position detector that detects a display position of the video of the sound generating object, based on the video information acquired by said video recognizer; a sound recognizer that acquires information related to the sound of the sound generating object as sound information based on the sound signals of the plurality of channels; a sound position estimator that estimates a generation position of the sound of the sound generating object by comparing the sound signals of the plurality of channels having a same frequency, based on the sound information acquired by said sound recognizer; a closed caption producer that produces a closed caption that represents, by at least one character, the sound generated from the sound generating object based on the sound information acquired by said sound recognizer; an association processor that associates the display position of the video of the sound generating object detected by said video position detector and the generation position of the sound of the sound generating object estimated by said sound position estimator; and a synthesized video producer that produces the synthesized video by arranging the closed caption produced by said closed caption producer in a position corresponding to the display position of the video detected by said video position detector based on the display position of the video and the generation position of the sound that have been associated with each other by said association processor, wherein the sound generating object includes a plurality of working objects, said video recognizer acquires the information related to the video of each working object as the video information based on the video signal, said video position detector detects the display position of the video of each working object based on the video information acquired by said video recognizer, said sound recognizer recognizes each working object and associates the sound information that has been acquired with each working object that has been recognized, said sound position estimator estimates the generation position of the sound of each working object based on the sound information associated with each working object by said sound recognizer, said closed caption producer produces the closed caption that represents, by the at least one character, the sound generated from each working object based on the sound information acquired by said sound recognizer, said association processor associates the display position of the video of each working object detected by said video position detector with the generation position of the sound of each working object estimated by said sound position estimator, said synthesized video producer produces the synthesized video by arranging the closed caption of the sound generated from each working object produced by said closed caption producer in the position corresponding to the display position of the video of each working object detected by said video position detector based on the display position of the video of each working object and the generation position of the sound of each working object that are associated with each other by said association processor, the plurality of working objects include a plurality of persons, and the sound information includes information related to frequency characteristics of the sound generated from each person, and said sound recognizer recognizes each person that generates the sound by comparing the information related to the frequency characteristics of the sound that is newly acquired with the information related to the frequency characteristics of the sound that was previously acquired, and by determining whether or not a degree of coincidence indicating a level of coincidence between the information related to the frequency characteristics of the sound that is newly acquired and the information related to the frequency characteristics of the sound that was previously acquired exceeds a predetermined reference value.