Patent ID: 8396351

Claim:
An information processing apparatus, comprising: a storage unit that stores object metadata created by associating object present time information indicating a time when an object is present in video of audio/video data with object identification information to identify the object present in the video, music metadata containing music present time information indicating the time when music is present in audio of the audio/video data, and object background music (BGM) correspondence information created by associating the object identification information with BGM identification information; and a control unit that determines whether any time in the audio/video data satisfies a first condition in which a time in the audio/video data matches a time indicated by the object present time information and determines whether the time in the audio/video data also satisfies a second condition in which the time in the audio/video data does not match a time in the music present time information in which the music is present in the audio of the audio/video data, and if the time in the audio/video data satisfies the first and second conditions, the control unit automatically outputs BGM identified by the BGM identification information associated with the object identification information associated with the object present time information when reproduction advances to the time concerned.