Apply for community grant: Personal project

#1
by ales - opened

Hello, @sanchit-gandhi and @reach-vb !
I would like to apply for community grant to launch this demo of a Belarusian Whisper Small model on a GPU for faster inference.

Training is still in progress. The current WER on a Belarusian Common Voice 11 validation split is 6.464%. I have not evluated model on a test split of the same dataset because the training is not finished yet.

Original openai/whisper-small model was not evaluated on a Common Voice dataset according to a section D.2.2 of a paper https://cdn.openai.com/papers/whisper.pdf. It was evaluated on a Fleurs (section D.2.4) - Belarusian Whisper Small had 75.1% WER reported.

Once training will finish, I will evaluate my model both on test set of Common Voice 11 and on Fleurs as well

First training run have finished - validation WER on Common Voice 11 is 6.3672%
I'm planning to laungh a second run tomorrow and will try to decrease WER even further.

I've evaluated model on a test set of Common Voice 11. test WER = 6.79%

Sign up or log in to comment