update model card README.md

README.md

@@ -1,48 +1,32 @@
 ---
-language:
-- fr
-license: apache-2.0
 tags:
-- automatic-speech-recognition
-- mozilla-foundation/common_voice_8_0
 - generated_from_trainer
-- robust-speech-event
 model-index:
-- name: XLS-R-1B - French
-  results:
-  - task: 
-      name: Automatic Speech Recognition 
-      type: automatic-speech-recognition
-    dataset:
-      name: Common Voice 8
-      type: mozilla-foundation/common_voice_8_0
-      args: fr
-    metrics:
-       - name: Test WER
-         type: wer
-         value: 18.33
-       - name: Test CER
-         type: cer
-         value: 5.60
-  - task:
-      name: Automatic Speech Recognition
-      type: automatic-speech-recognition
-    dataset:
-      name: Robust Speech Event - Dev Data
-      type: speech-recognition-community-v2/dev_data
-      args: fr
-    metrics:
-       - name: Test WER
-         type: wer
-         value: 60.25
-       - name: Test CER
-         type: cer
-         value: 15.68
+- name: ''
+  results: []
 ---
 
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# 
+
+This model is a fine-tuned version of [./checkpoint-13000](https://huggingface.co/./checkpoint-13000) on the None dataset.
+It achieves the following results on the evaluation set:
+- Loss: inf
+- Wer: 0.1854
+
 ## Model description
 
-This model is a fine-tuned version of [facebook/wav2vec2-xls-r-1b](https://huggingface.co/facebook/wav2vec2-xls-r-1b) on the MOZILLA-FOUNDATION/COMMON_VOICE_8_0 - FR dataset.
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
 
 ## Training procedure
 
@@ -58,7 +42,7 @@ The following hyperparameters were used during training:
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
 - lr_scheduler_warmup_steps: 2000
-- num_epochs: 4.0
+- num_epochs: 6.0
 - mixed_precision_training: Native AMP
 
 ### Training results
@@ -78,11 +62,14 @@ The following hyperparameters were used during training:
 | 0.8156        | 3.15  | 11000 | inf             | 0.1936 |
 | 0.8015        | 3.44  | 12000 | inf             | 0.1880 |
 | 0.774         | 3.73  | 13000 | inf             | 0.1834 |
+| 0.8372        | 4.01  | 14000 | inf             | 0.1934 |
+| 0.8075        | 4.3   | 15000 | inf             | 0.1923 |
+| 0.8069        | 4.59  | 16000 | inf             | 0.1877 |
+| 0.8064        | 4.87  | 17000 | inf             | 0.1955 |
+| 0.801         | 5.16  | 18000 | inf             | 0.1891 |
+| 0.8022        | 5.45  | 19000 | inf             | 0.1895 |
+| 0.792         | 5.73  | 20000 | inf             | 0.1854 |
 
-It achieves the best result on the validation set on STEP 13000:
-- Wer: 0.1834
-
-Some problem occurs when calculating the validation loss.
 
 ### Framework versions
 
@@ -90,16 +77,3 @@ Some problem occurs when calculating the validation loss.
 - Pytorch 1.10.2+cu102
 - Datasets 1.18.3.dev0
 - Tokenizers 0.11.0
-
-### Evaluation Commands
-1. To evaluate on `mozilla-foundation/common_voice_8` with split `test`
-
-```bash
-python eval.py --model_id Plim/xls-r-1b-cv_8-fr --dataset mozilla-foundation/common_voice_8_0 --config fr --split test
-```
-
-2. To evaluate on `speech-recognition-community-v2/dev_data`
-
-```bash
-python eval.py --model_id Plim/xls-r-1b-cv_8-fr --dataset speech-recognition-community-v2/dev_data --config fr --split validation --chunk_length_s 5.0 --stride_length_s 1.0
-```

wandb/run-20220206_201634-uhiy9e2t/files/output.log

@@ -11355,3 +11355,17 @@ Configuration saved in ./preprocessor_config.json
 Saving model checkpoint to ./
 Configuration saved in ./config.json
 Model weights saved in ./pytorch_model.bin
+Configuration saved in ./preprocessor_config.json
+Several commits (2) will be pushed upstream.
+The progress bars may be unreliable.
+02/08/2022 03:24:48 - WARNING - huggingface_hub.repository - Several commits (2) will be pushed upstream.
+02/08/2022 03:24:48 - WARNING - huggingface_hub.repository - The progress bars may be unreliable.
+
+
+
+Upload file wandb/run-20220206_201634-uhiy9e2t/run-uhiy9e2t.wandb:  98%|██████████████████████████████████████████████████████████████████▎ | 114M/117M [00:06<00:00, 21.0MB/s]
+02/08/2022 03:24:58 - WARNING - huggingface_hub.repository - To https://huggingface.co/Plim/xls-r-1b-cv_8-fr
+Upload file wandb/run-20220206_201634-uhiy9e2t/run-uhiy9e2t.wandb:  98%|██████████████████████████████████████████████████████████████████▎ | 114M/117M [00:06<00:00, 21.0MB/s]To https://huggingface.co/Plim/xls-r-1b-cv_8-fr
+   89ae304..5c2523c  main -> main
+Upload file wandb/run-20220206_201634-uhiy9e2t/run-uhiy9e2t.wandb: 100%|████████████████████████████████████████████████████████████████████| 117M/117M [00:08<00:00, 15.1MB/s]
+Dropping the following result as it does not have all the necessary fields:

wandb/run-20220206_201634-uhiy9e2t/logs/debug-internal.log

@@ -32484,3 +32484,15 @@ requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url:
 2022-02-08 03:24:36,740 DEBUG   HandlerThread:10249 [handler.py:handle_request():131] handle_request: stop_status
 2022-02-08 03:24:36,741 DEBUG   SenderThread:10249 [sender.py:send_request():249] send_request: stop_status
 2022-02-08 03:24:39,519 DEBUG   SenderThread:10249 [sender.py:send():235] send: stats
+2022-02-08 03:24:51,012 INFO    Thread-8  :10249 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-1b-cv_8-fr/wandb/run-20220206_201634-uhiy9e2t/files/output.log
+2022-02-08 03:24:51,911 DEBUG   HandlerThread:10249 [handler.py:handle_request():131] handle_request: stop_status
+2022-02-08 03:24:51,912 DEBUG   SenderThread:10249 [sender.py:send_request():249] send_request: stop_status
+2022-02-08 03:24:53,013 INFO    Thread-8  :10249 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-1b-cv_8-fr/wandb/run-20220206_201634-uhiy9e2t/files/output.log
+2022-02-08 03:24:55,014 INFO    Thread-8  :10249 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-1b-cv_8-fr/wandb/run-20220206_201634-uhiy9e2t/files/output.log
+2022-02-08 03:24:57,016 INFO    Thread-8  :10249 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-1b-cv_8-fr/wandb/run-20220206_201634-uhiy9e2t/files/output.log
+2022-02-08 03:24:59,017 INFO    Thread-8  :10249 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-1b-cv_8-fr/wandb/run-20220206_201634-uhiy9e2t/files/output.log
+2022-02-08 03:25:01,018 INFO    Thread-8  :10249 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-1b-cv_8-fr/wandb/run-20220206_201634-uhiy9e2t/files/output.log
+2022-02-08 03:25:05,021 INFO    Thread-8  :10249 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-1b-cv_8-fr/wandb/run-20220206_201634-uhiy9e2t/files/output.log
+2022-02-08 03:25:07,248 DEBUG   HandlerThread:10249 [handler.py:handle_request():131] handle_request: stop_status
+2022-02-08 03:25:07,248 DEBUG   SenderThread:10249 [sender.py:send_request():249] send_request: stop_status
+2022-02-08 03:25:09,751 DEBUG   SenderThread:10249 [sender.py:send():235] send: stats

wandb/run-20220206_201634-uhiy9e2t/run-uhiy9e2t.wandb

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b990101dc5be3963b20992a79f5b2fa802fc6f88d9fb12ceade05980531d5087
-size 123073975
+oid sha256:160673feed9ea3ddc328247490fe7d2950cd358fb40b4b827edc8123c80ab0af
+size 123076744