update model card README.md

README.md

@@ -0,0 +1,77 @@
+---
+license: apache-2.0
+tags:
+- generated_from_trainer
+model-index:
+- name: ''
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# 
+
+This model is a fine-tuned version of [facebook/wav2vec2-xls-r-300m](https://huggingface.co/facebook/wav2vec2-xls-r-300m) on the None dataset.
+It achieves the following results on the evaluation set:
+- Loss: inf
+- Wer: 0.2172
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 7.5e-05
+- train_batch_size: 16
+- eval_batch_size: 16
+- seed: 42
+- gradient_accumulation_steps: 8
+- total_train_batch_size: 128
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- lr_scheduler_warmup_steps: 2000
+- num_epochs: 5.0
+- mixed_precision_training: Native AMP
+
+### Training results
+
+| Training Loss | Epoch | Step  | Validation Loss | Wer    |
+|:-------------:|:-----:|:-----:|:---------------:|:------:|
+| 2.9114        | 0.29  | 1000  | inf             | 0.9997 |
+| 1.2436        | 0.57  | 2000  | inf             | 0.4310 |
+| 1.0552        | 0.86  | 3000  | inf             | 0.3144 |
+| 1.0044        | 1.15  | 4000  | inf             | 0.2814 |
+| 0.9718        | 1.43  | 5000  | inf             | 0.2658 |
+| 0.9502        | 1.72  | 6000  | inf             | 0.2566 |
+| 0.9418        | 2.01  | 7000  | inf             | 0.2476 |
+| 0.9215        | 2.29  | 8000  | inf             | 0.2420 |
+| 0.9236        | 2.58  | 9000  | inf             | 0.2388 |
+| 0.9014        | 2.87  | 10000 | inf             | 0.2354 |
+| 0.8814        | 3.15  | 11000 | inf             | 0.2312 |
+| 0.8809        | 3.44  | 12000 | inf             | 0.2285 |
+| 0.8717        | 3.73  | 13000 | inf             | 0.2263 |
+| 0.8787        | 4.01  | 14000 | inf             | 0.2218 |
+| 0.8567        | 4.3   | 15000 | inf             | 0.2193 |
+| 0.8488        | 4.59  | 16000 | inf             | 0.2187 |
+| 0.8359        | 4.87  | 17000 | inf             | 0.2172 |
+
+
+### Framework versions
+
+- Transformers 4.17.0.dev0
+- Pytorch 1.10.2+cu102
+- Datasets 1.18.3.dev0
+- Tokenizers 0.11.0

wandb/run-20220203_135844-2tzexn1o/files/output.log

@@ -23531,3 +23531,10 @@ Saving model checkpoint to ./
 Saving model checkpoint to ./                                                                                                                                   | 81/1002 [00:50<10:06,  1.52it/s]
 {'train_runtime': 143109.8834, 'train_samples_per_second': 15.599, 'train_steps_per_second': 0.122, 'train_loss': 1.187884036554109, 'epoch': 5.0}
 Saving model checkpoint to ./                                                                                                                                   | 81/1002 [00:50<10:06,  1.52it/s]
+Saving model checkpoint to ./                                                                                                                                   | 81/1002 [00:50<10:06,  1.52it/s]
+Saving model checkpoint to ./                                                                                                                                   | 81/1002 [00:50<10:06,  1.52it/s]
+Saving model checkpoint to ./                                                                                                                                   | 81/1002 [00:50<10:06,  1.52it/s]
+Saving model checkpoint to ./                                                                                                                                   | 81/1002 [00:50<10:06,  1.52it/s]
+02/05/2022 05:45:28 - WARNING - huggingface_hub.repository - To https://huggingface.co/Plim/xls-r-300m-cv_8-fr
+Upload file wandb/run-20220203_135844-2tzexn1o/run-2tzexn1o.wandb: 100%|███████████████████████████████████████████████████████████████████████████████████████| 125M/125M [00:06<00:00, 21.3MB/s]
+Upload file wandb/run-20220203_135844-2tzexn1o/run-2tzexn1o.wandb: 100%|███████████████████████████████████████████████████████████████████████████████████████| 125M/125M [00:06<00:00, 21.3MB/s]

wandb/run-20220203_135844-2tzexn1o/logs/debug-internal.log

@@ -48942,3 +48942,11 @@
 2022-02-05 05:44:59,230 DEBUG   SenderThread:3742 [sender.py:send_request():249] send_request: stop_status
 2022-02-05 05:45:14,392 DEBUG   HandlerThread:3742 [handler.py:handle_request():131] handle_request: stop_status
 2022-02-05 05:45:14,392 DEBUG   SenderThread:3742 [sender.py:send_request():249] send_request: stop_status
+2022-02-05 05:45:24,973 INFO    Thread-8  :3742 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-cv_8-fr/wandb/run-20220203_135844-2tzexn1o/files/output.log
+2022-02-05 05:45:26,974 INFO    Thread-8  :3742 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-cv_8-fr/wandb/run-20220203_135844-2tzexn1o/files/output.log
+2022-02-05 05:45:28,192 DEBUG   SenderThread:3742 [sender.py:send():235] send: stats
+2022-02-05 05:45:28,976 INFO    Thread-8  :3742 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-cv_8-fr/wandb/run-20220203_135844-2tzexn1o/files/output.log
+2022-02-05 05:45:29,771 DEBUG   HandlerThread:3742 [handler.py:handle_request():131] handle_request: stop_status
+2022-02-05 05:45:29,771 DEBUG   SenderThread:3742 [sender.py:send_request():249] send_request: stop_status
+2022-02-05 05:45:30,977 INFO    Thread-8  :3742 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-cv_8-fr/wandb/run-20220203_135844-2tzexn1o/files/output.log
+2022-02-05 05:45:34,980 INFO    Thread-8  :3742 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-cv_8-fr/wandb/run-20220203_135844-2tzexn1o/files/output.log

wandb/run-20220203_135844-2tzexn1o/run-2tzexn1o.wandb

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:16778d7647e5649a67b93699fa64a7d5752d469690253f71dd4aecd2ab1af7de
-size 131078471
+oid sha256:5ccd05a52613cf7428d8f8839c3c3aebb2cd3cdd63d287214b797522ecbd7077
+size 131081989