Patent ID: 11908449
Assignee: DEEP MEDIA INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A system configured to generate a synthetic media with translated speech corresponding to an input media file, comprising:
at least one processor; and
memory including instructions that, when executed by the at least one processor, cause the system to:
digitally acquire the input media file, wherein the input media file includes input audio in a first input language;
segment the input audio into one or more vocal segments, wherein each vocal segment includes a speaker identification to identify the speaker of each vocal segment;
for each vocal segment:
acquire an input transcription, wherein the input transcription includes text corresponding to the words spoken in each vocal segment;
acquire input meta information, the meta information including emotion data and tone data, wherein emotion data corresponds to one or more detectable emotions from a list of predetermined emotions;
input the input meta information and input transcription into a transcription and meta translation generator, wherein the transcription and meta translation generator is a generative adversarial network generator; and
translate, by the transcription and meta translation generator, the input transcription and input meta information into a first output language that is distinct from the first input language, wherein translating is based at least on the emotion data.