Multi task finetuning (transcribe and translate)

#174
by Phil-AB - opened

I want to finetune this model for multi-tasking (Transcribe and translate)

Essentially, I want to transcribe (Akan speech to Akan text) and translate (Akan speech to English text).

Individually, it works
but I want to use one model and finetune for both transcription and translation to English language.

My datasets contain Akan speech with its transcription and its translated English text.

Any help as to how I can go about this will be greatly appreciated.

Also is there a notebook with a multitask done that I can use for reference or any resource I could draw insights from?

Thank you.

Sign up or log in to comment