Patent ID: 11871068
Assignee: AMAZON TECHNOLOGIES, INC.
Field: Audio-visual technology (Electrical engineering)
Classification: CPC H  G | IPC G  H

Claim 0:
1. A computer-implemented method comprising:
obtaining, by a server computer, audio and video corresponding to media content;
identifying, by the server computer, audio segments from a plurality of audio segments of the audio based at least in part on: 1) identifying, from the plurality of audio segments, a first subset of audio segments that have a sound level that falls below a sound level threshold, 2) determining, from the first subset of audio segments, a second subset of audio segments that exceed a threshold duration, and 3) selecting, from the second subset of audio segments, a third subset of audio segments, the third subset of audio segments being selected based at least in part on identifying that a number of frames of a given audio segment that individually have sound levels that fall below the sound level threshold exceeds a threshold number:
determining, by the server computer, that an audio segment of the identified audio segments corresponds to a conversation segment of the media content based at least in part on identifying that a number of audio frames of the audio segment that: 1) have respective sound levels that fall below the threshold sound level and 2) correspond to video frames of the media content that comprise a facial image, exceeds a second threshold number;
identifying, by the server computer, a synchronization error in the conversation segment based at least in part on identifying that a second number of frames of the conversation segment correspond to video comprising open mouth facial images and corresponding audio that lacks sounds exceeds a second threshold, the second threshold determined based at least in part on a type of media content corresponding to the media content; and
in response to identifying the synchronization error, modifying, by the server computer, at least one of: 1) an encoding file of the media content or 2)
metadata of the media content, the modifying of the metadata of the media content comprising modifying one or more associations between audio frames and corresponding video frames of the conversation segment.