sanchit-gandhi HF staff commited on
Commit
6ebccf5
1 Parent(s): 192f30e

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +53 -0
README.md ADDED
@@ -0,0 +1,53 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ metrics:
4
+ - wer
5
+ model-index:
6
+ - name: whisper_small_hi_flax
7
+ results:
8
+ - task:
9
+ name: Automatic Speech Recognition
10
+ type: automatic-speech-recognition
11
+ dataset:
12
+ name: Common Voice 13.0
13
+ type: mozilla-foundation/common_voice_13_0
14
+ config: hi
15
+ split: test
16
+ metrics:
17
+ - name: Wer
18
+ type: wer
19
+ value: 33.968280
20
+ datasets:
21
+ - mozilla-foundation/common_voice_13_0
22
+ language:
23
+ - ar
24
+ pipeline_tag: automatic-speech-recognition
25
+ ---
26
+
27
+ # Whisper Small Hi - Sanchit Gandhi
28
+
29
+ This model is a fine-tuned version of [openai/whisper-small](https://huggingface.co/openai/whisper-small) on the Common Voice 13.0 dataset in Flax.
30
+ It is trained using the Transformers **Flax** examples script, and achieves the following results on the evaluation set:
31
+ - Loss: 0.02091
32
+ - Wer: 33.96828
33
+
34
+ The training run can be reproduced in approximately 25 minutes by executing the script [`run.sh`](https://huggingface.co/sanchit-gandhi/whisper-small-hi-flax/blob/main/run.sh).
35
+
36
+ ## Training procedure
37
+
38
+ ### Training hyperparameters
39
+
40
+ The following hyperparameters were used during training:
41
+ - learning_rate: 1e-04
42
+ - train_batch_size: 64
43
+ - eval_batch_size: 64
44
+ - seed: 42
45
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
46
+ - lr_scheduler_type: linear
47
+ - lr_scheduler_warmup_steps: 500
48
+ - num_train_epochs: 10
49
+
50
+ ### Training results
51
+
52
+ See [Tensorboard logs](https://huggingface.co/sanchit-gandhi/whisper-small-hi-flax/tensorboard) for details.
53
+