Transcribing multiple languages in single audio file

#56
by supercharge19 - opened

What about recordings of people speaking in multiple languages like in pod casts, some utterances are in English even when majority is some other language? If I choose language as spoken language then transcription is better than if no language tag is provided or English was chosen as language, however, when audio reaches the part where they speak English then it becomes troublesome for model to transcribe properly unless English was chosen in first place but that would do badly while transcribing other languages.

What is the best way to transcribe? Should I use pipeline and with what kwargs, like word level time stamps or no time stamps, and should I choose language in start or do what, please guide.

Hi,

Have the same problem. Did you figure this out :) ?

Best,
Adi

Not exactly a solution but it worked best:

set language to auto and then put translate as task.

any updates with this? I am trying to make a transcription of an audiofile containing Korean, Japanese and English being Korean the main language

Sign up or log in to comment