kingabzpro commited on
Commit
8b6b174
1 Parent(s): db1804b

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -60
README.md CHANGED
@@ -1,57 +1,12 @@
1
  ---
2
- language:
3
- - ar
4
-
5
  license: apache-2.0
6
  tags:
7
- - automatic-speech-recognition
8
- - robust-speech-event
9
  datasets:
10
- - mozilla-foundation/common_voice_7_0
11
- metrics:
12
- - wer
13
- - cer
14
  model-index:
15
- - name: wav2vec2-xls-r-300m-arabic
16
- results:
17
- - task:
18
- type: automatic-speech-recognition # Required. Example: automatic-speech-recognition
19
- name: Speech Recognition # Optional. Example: Speech Recognition
20
- dataset:
21
- type: mozilla-foundation/common_voice_7_0 # Required. Example: common_voice. Use dataset id from https://hf.co/datasets
22
- name: Common Voice ar # Required. Example: Common Voice zh-CN
23
- args: ar # Optional. Example: zh-CN
24
- metrics:
25
- - type: wer # Required. Example: wer
26
- value: 31.05 # Required. Example: 20.90
27
- name: Test WER # Optional. Example: Test WER
28
- args:
29
- - learning_rate: 0.0003
30
- - train_batch_size: 64
31
- - eval_batch_size: 8
32
- - seed: 42
33
- - gradient_accumulation_steps: 2
34
- - total_train_batch_size: 128
35
- - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
36
- - lr_scheduler_type: linear
37
- - lr_scheduler_warmup_steps: 1000
38
- - num_epochs: 10
39
- - mixed_precision_training: Native AMP # Optional. Example for BLEU: max_order
40
- - type: cer # Required. Example: wer
41
- value: 8.78 # Required. Example: 20.90
42
- name: Test CER # Optional. Example: Test WER
43
- args:
44
- - learning_rate: 0.0003
45
- - train_batch_size: 64
46
- - eval_batch_size: 8
47
- - seed: 42
48
- - gradient_accumulation_steps: 2
49
- - total_train_batch_size: 128
50
- - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
51
- - lr_scheduler_type: linear
52
- - lr_scheduler_warmup_steps: 1000
53
- - num_epochs: 10
54
- - mixed_precision_training: Native AMP # Optional. Example for BLEU: max_order
55
  ---
56
 
57
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -61,9 +16,21 @@ should probably proofread and complete it, then remove this comment. -->
61
 
62
  This model is a fine-tuned version of [facebook/wav2vec2-xls-r-300m](https://huggingface.co/facebook/wav2vec2-xls-r-300m) on the common_voice dataset.
63
  It achieves the following results on the evaluation set:
64
- - Loss: 0.3384
65
- - Wer: 0.3105
66
- - Cer: 0.0879
 
 
 
 
 
 
 
 
 
 
 
 
67
 
68
  ## Training procedure
69
 
@@ -86,16 +53,16 @@ The following hyperparameters were used during training:
86
 
87
  | Training Loss | Epoch | Step | Validation Loss | Wer | Cer |
88
  |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|
89
- | 0.7383 | 1.8 | 500 | 0.4292 | 0.4065 | 0.1189 |
90
- | 0.664 | 3.6 | 1000 | 0.4245 | 0.3978 | 0.1175 |
91
- | 0.6064 | 5.4 | 1500 | 0.3854 | 0.3625 | 0.1048 |
92
- | 0.5221 | 7.19 | 2000 | 0.3819 | 0.3400 | 0.0976 |
93
- | 0.4591 | 8.99 | 2500 | 0.3384 | 0.3105 | 0.0879 |
94
 
95
 
96
  ### Framework versions
97
 
98
- - Transformers 4.16.0.dev0
99
- - Pytorch 1.10.1+cu102
100
- - Datasets 1.17.1.dev0
101
  - Tokenizers 0.11.0
 
1
  ---
 
 
 
2
  license: apache-2.0
3
  tags:
4
+ - generated_from_trainer
 
5
  datasets:
6
+ - common_voice
 
 
 
7
  model-index:
8
+ - name: wav2vec2-large-xlsr-300-arabic
9
+ results: []
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
  ---
11
 
12
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
16
 
17
  This model is a fine-tuned version of [facebook/wav2vec2-xls-r-300m](https://huggingface.co/facebook/wav2vec2-xls-r-300m) on the common_voice dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.4514
20
+ - Wer: 0.4256
21
+ - Cer: 0.1528
22
+
23
+ ## Model description
24
+
25
+ More information needed
26
+
27
+ ## Intended uses & limitations
28
+
29
+ More information needed
30
+
31
+ ## Training and evaluation data
32
+
33
+ More information needed
34
 
35
  ## Training procedure
36
 
 
53
 
54
  | Training Loss | Epoch | Step | Validation Loss | Wer | Cer |
55
  |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|
56
+ | 5.4375 | 1.8 | 500 | 3.3330 | 1.0 | 1.0 |
57
+ | 2.2187 | 3.6 | 1000 | 0.7790 | 0.6501 | 0.2338 |
58
+ | 0.9471 | 5.4 | 1500 | 0.5353 | 0.5015 | 0.1822 |
59
+ | 0.7416 | 7.19 | 2000 | 0.4889 | 0.4490 | 0.1640 |
60
+ | 0.6358 | 8.99 | 2500 | 0.4514 | 0.4256 | 0.1528 |
61
 
62
 
63
  ### Framework versions
64
 
65
+ - Transformers 4.17.0.dev0
66
+ - Pytorch 1.10.2+cu102
67
+ - Datasets 1.18.2.dev0
68
  - Tokenizers 0.11.0