ouob commited on
Commit
1d81fb5
1 Parent(s): 02ae1bf

End of training

Browse files
Files changed (4) hide show
  1. README.md +67 -0
  2. generation_config.json +34 -0
  3. pytorch_model.bin +1 -1
  4. training_args.bin +1 -1
README.md ADDED
@@ -0,0 +1,67 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - hi
4
+ license: apache-2.0
5
+ base_model: openai/whisper-base
6
+ tags:
7
+ - hf-asr-leaderboard
8
+ - generated_from_trainer
9
+ datasets:
10
+ - mozilla-foundation/common_voice_11_0
11
+ model-index:
12
+ - name: Whisper base Hi - Sanchit Gandhi
13
+ results: []
14
+ ---
15
+
16
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
17
+ should probably proofread and complete it, then remove this comment. -->
18
+
19
+ # Whisper base Hi - Sanchit Gandhi
20
+
21
+ This model is a fine-tuned version of [openai/whisper-base](https://huggingface.co/openai/whisper-base) on the Common Voice 11.0 dataset.
22
+ It achieves the following results on the evaluation set:
23
+ - Loss: 0.1381
24
+ - Cer: 8.5165
25
+
26
+ ## Model description
27
+
28
+ More information needed
29
+
30
+ ## Intended uses & limitations
31
+
32
+ More information needed
33
+
34
+ ## Training and evaluation data
35
+
36
+ More information needed
37
+
38
+ ## Training procedure
39
+
40
+ ### Training hyperparameters
41
+
42
+ The following hyperparameters were used during training:
43
+ - learning_rate: 1e-05
44
+ - train_batch_size: 16
45
+ - eval_batch_size: 8
46
+ - seed: 42
47
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
48
+ - lr_scheduler_type: linear
49
+ - lr_scheduler_warmup_steps: 500
50
+ - training_steps: 4000
51
+
52
+ ### Training results
53
+
54
+ | Training Loss | Epoch | Step | Validation Loss | Cer |
55
+ |:-------------:|:-----:|:----:|:---------------:|:-------:|
56
+ | 0.3106 | 0.87 | 1000 | 0.3352 | 16.9784 |
57
+ | 0.1609 | 1.74 | 2000 | 0.1887 | 10.5303 |
58
+ | 0.0889 | 2.6 | 3000 | 0.1510 | 9.2926 |
59
+ | 0.0596 | 3.47 | 4000 | 0.1381 | 8.5165 |
60
+
61
+
62
+ ### Framework versions
63
+
64
+ - Transformers 4.32.0.dev0
65
+ - Pytorch 2.0.1+cu117
66
+ - Datasets 2.14.4
67
+ - Tokenizers 0.13.3
generation_config.json CHANGED
@@ -1,4 +1,38 @@
1
  {
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  "begin_suppress_tokens": [
3
  220,
4
  50257
 
1
  {
2
+ "alignment_heads": [
3
+ [
4
+ 3,
5
+ 1
6
+ ],
7
+ [
8
+ 4,
9
+ 2
10
+ ],
11
+ [
12
+ 4,
13
+ 3
14
+ ],
15
+ [
16
+ 4,
17
+ 7
18
+ ],
19
+ [
20
+ 5,
21
+ 1
22
+ ],
23
+ [
24
+ 5,
25
+ 2
26
+ ],
27
+ [
28
+ 5,
29
+ 4
30
+ ],
31
+ [
32
+ 5,
33
+ 6
34
+ ]
35
+ ],
36
  "begin_suppress_tokens": [
37
  220,
38
  50257
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9712231be4437ad7749f1958e681093d0c77cb4810077fe74ee9afc13664417c
3
  size 290458785
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:46815212c03bee9064490ba29b680d3ae59dd90316317867375af9b83490c64c
3
  size 290458785
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dbcd30a580871fb5bcf7d42acb343b8dd49ac7a77ea1d9f7a78028545ce5c97c
3
  size 4155
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:134ff8e4b79a1c454c7916c5d9282d4ac5370ec09a7103a0ca4d3c0905af02db
3
  size 4155