Patent ID: 11908449
Assignee: DEEP MEDIA INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 13:
14. A non-transitory computer-readable medium for generating a synthetic media with translated speech corresponding to an input media file, comprising instructions stored thereon, that when executed on at least one processor, cause the at least one processor to:
acquire the input media file, wherein the input media file includes input video and input audio in a first input language;
segment the input audio into one or more vocal segments, wherein each vocal segment includes a speaker identification to identify the speaker of each vocal segment;
for each vocal segment:
acquire an input transcription, wherein the input transcription includes text corresponding to the words spoken in each vocal segment;
acquire input meta information, the meta information including emotion data and tone data, wherein emotion data corresponds to one or more detectable emotions from a list of predetermined emotions;
translate the input transcription and input meta information into a first output language that is distinct from the first input language; and
generate translated audio by providing the translated input transcription and meta information to an audio translation generator configured to generate the translated audio, wherein the audio translation generator is a generative adversarial network generator.