update model card README.md

README.md

@@ -0,0 +1,73 @@
+---
+license: apache-2.0
+tags:
+- generated_from_trainer
+model-index:
+- name: ''
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# 
+
+This model is a fine-tuned version of [facebook/wav2vec2-xls-r-1b](https://huggingface.co/facebook/wav2vec2-xls-r-1b) on the None dataset.
+It achieves the following results on the evaluation set:
+- Loss: inf
+- Wer: 0.1834
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 7.5e-05
+- train_batch_size: 16
+- eval_batch_size: 16
+- seed: 42
+- gradient_accumulation_steps: 8
+- total_train_batch_size: 128
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- lr_scheduler_warmup_steps: 2000
+- num_epochs: 4.0
+- mixed_precision_training: Native AMP
+
+### Training results
+
+| Training Loss | Epoch | Step  | Validation Loss | Wer    |
+|:-------------:|:-----:|:-----:|:---------------:|:------:|
+| 0.9827        | 0.29  | 1000  | inf             | 0.2937 |
+| 1.0203        | 0.57  | 2000  | inf             | 0.2711 |
+| 1.0048        | 0.86  | 3000  | inf             | 0.2620 |
+| 0.9858        | 1.15  | 4000  | inf             | 0.2522 |
+| 0.9709        | 1.43  | 5000  | inf             | 0.2365 |
+| 0.9347        | 1.72  | 6000  | inf             | 0.2332 |
+| 0.9256        | 2.01  | 7000  | inf             | 0.2261 |
+| 0.8936        | 2.29  | 8000  | inf             | 0.2203 |
+| 0.877         | 2.58  | 9000  | inf             | 0.2096 |
+| 0.8393        | 2.87  | 10000 | inf             | 0.2017 |
+| 0.8156        | 3.15  | 11000 | inf             | 0.1936 |
+| 0.8015        | 3.44  | 12000 | inf             | 0.1880 |
+| 0.774         | 3.73  | 13000 | inf             | 0.1834 |
+
+
+### Framework versions
+
+- Transformers 4.17.0.dev0
+- Pytorch 1.10.2+cu102
+- Datasets 1.18.3.dev0
+- Tokenizers 0.11.0

wandb/run-20220203_170643-2fkfdtzb/files/output.log

@@ -20361,3 +20361,13 @@ Configuration saved in ./preprocessor_config.json
 Saving model checkpoint to ./
 Configuration saved in ./config.json
 Model weights saved in ./pytorch_model.bin
+Configuration saved in ./preprocessor_config.json
+
+
+
+Upload file wandb/run-20220203_170643-2fkfdtzb/run-2fkfdtzb.wandb:  86%|██████████████████████████████████████████████████████████▍         | 167M/194M [00:06<00:00, 31.1MB/s]
+02/05/2022 19:46:56 - WARNING - huggingface_hub.repository - To https://huggingface.co/Plim/xls-r-1b-cv_8-fr
+Upload file wandb/run-20220203_170643-2fkfdtzb/run-2fkfdtzb.wandb:  86%|██████████████████████████████████████████████████████████▍         | 167M/194M [00:06<00:00, 31.1MB/s]To https://huggingface.co/Plim/xls-r-1b-cv_8-fr
+   1c48dab..1a7f79b  main -> main
+Upload file wandb/run-20220203_170643-2fkfdtzb/run-2fkfdtzb.wandb: 100%|████████████████████████████████████████████████████████████████████| 194M/194M [00:09<00:00, 22.0MB/s]
+Dropping the following result as it does not have all the necessary fields:

wandb/run-20220203_170643-2fkfdtzb/logs/debug-internal.log

@@ -53239,3 +53239,15 @@
 2022-02-05 19:46:17,682 DEBUG   SenderThread:5297 [sender.py:send_request():249] send_request: stop_status
 2022-02-05 19:46:32,860 DEBUG   HandlerThread:5297 [handler.py:handle_request():131] handle_request: stop_status
 2022-02-05 19:46:32,860 DEBUG   SenderThread:5297 [sender.py:send_request():249] send_request: stop_status
+2022-02-05 19:46:46,549 DEBUG   SenderThread:5297 [sender.py:send():235] send: stats
+2022-02-05 19:46:48,039 DEBUG   HandlerThread:5297 [handler.py:handle_request():131] handle_request: stop_status
+2022-02-05 19:46:48,040 DEBUG   SenderThread:5297 [sender.py:send_request():249] send_request: stop_status
+2022-02-05 19:46:50,427 INFO    Thread-8  :5297 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-1b-cv_8-fr/wandb/run-20220203_170643-2fkfdtzb/files/output.log
+2022-02-05 19:46:52,428 INFO    Thread-8  :5297 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-1b-cv_8-fr/wandb/run-20220203_170643-2fkfdtzb/files/output.log
+2022-02-05 19:46:54,430 INFO    Thread-8  :5297 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-1b-cv_8-fr/wandb/run-20220203_170643-2fkfdtzb/files/output.log
+2022-02-05 19:46:56,432 INFO    Thread-8  :5297 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-1b-cv_8-fr/wandb/run-20220203_170643-2fkfdtzb/files/output.log
+2022-02-05 19:46:57,432 INFO    Thread-8  :5297 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-1b-cv_8-fr/wandb/run-20220203_170643-2fkfdtzb/files/output.log
+2022-02-05 19:46:58,433 INFO    Thread-8  :5297 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-1b-cv_8-fr/wandb/run-20220203_170643-2fkfdtzb/files/output.log
+2022-02-05 19:47:02,436 INFO    Thread-8  :5297 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-1b-cv_8-fr/wandb/run-20220203_170643-2fkfdtzb/files/output.log
+2022-02-05 19:47:03,241 DEBUG   HandlerThread:5297 [handler.py:handle_request():131] handle_request: stop_status
+2022-02-05 19:47:03,241 DEBUG   SenderThread:5297 [sender.py:send_request():249] send_request: stop_status

wandb/run-20220203_170643-2fkfdtzb/run-2fkfdtzb.wandb

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:7ee7017c192268f2feb610a37ff3581dba01be278d3aba2d3b20f118276df06e
-size 203389284
+oid sha256:95f71866effbc7f9aeb35f7267344a2c9a8f4c1cec93bed8051cd281f07148b4
+size 203391171