update model card README.md

README.md

@@ -1 +1,82 @@
-Hello!
+---
+license: apache-2.0
+tags:
+- generated_from_trainer
+datasets:
+- common_voice_11_0
+metrics:
+- wer
+model-index:
+- name: openai/whisper-small
+  results:
+  - task:
+      name: Automatic Speech Recognition
+      type: automatic-speech-recognition
+    dataset:
+      name: common_voice_11_0
+      type: common_voice_11_0
+      config: es
+      split: test
+      args: es
+    metrics:
+    - name: Wer
+      type: wer
+      value: 8.44550699028117
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# openai/whisper-small
+
+This model is a fine-tuned version of [openai/whisper-small](https://huggingface.co/openai/whisper-small) on the common_voice_11_0 dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.2520
+- Wer: 8.4455
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 1e-05
+- train_batch_size: 64
+- eval_batch_size: 64
+- seed: 42
+- gradient_accumulation_steps: 2
+- total_train_batch_size: 128
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- lr_scheduler_warmup_steps: 500
+- training_steps: 5000
+- mixed_precision_training: Native AMP
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Wer    |
+|:-------------:|:-----:|:----:|:---------------:|:------:|
+| 0.1386        | 4.01  | 1000 | 0.2464          | 9.8000 |
+| 0.1098        | 8.01  | 2000 | 0.2272          | 8.6229 |
+| 0.028         | 12.02 | 3000 | 0.2577          | 8.6956 |
+| 0.1083        | 16.02 | 4000 | 0.2210          | 8.2123 |
+| 0.0189        | 20.03 | 5000 | 0.2520          | 8.4455 |
+
+
+### Framework versions
+
+- Transformers 4.29.0.dev0
+- Pytorch 2.0.0+cu117
+- Datasets 2.12.1.dev0
+- Tokenizers 0.13.3

training.log

@@ -1670,3 +1670,16 @@ Training completed. Do not forget to share your model on huggingface.co/models =
 [INFO|configuration_utils.py:364] 2023-05-12 06:45:07,589 >> Configuration saved in ./generation_config.json
 [INFO|modeling_utils.py:1855] 2023-05-12 06:45:10,742 >> Model weights saved in ./pytorch_model.bin
 [INFO|feature_extraction_utils.py:369] 2023-05-12 06:45:10,746 >> Feature extractor saved in ./preprocessor_config.json
+Several commits (2) will be pushed upstream.
+{'eval_loss': 0.25196951627731323, 'eval_wer': 8.44550699028117, 'eval_runtime': 3402.3954, 'eval_samples_per_second': 4.561, 'eval_steps_per_second': 0.071, 'epoch': 20.03}
+{'train_runtime': 162214.2802, 'train_samples_per_second': 3.945, 'train_steps_per_second': 0.031, 'train_loss': 0.10428944413661957, 'epoch': 20.03}
+05/12/2023 06:45:57 - WARNING - huggingface_hub.repository - Several commits (2) will be pushed upstream.
+The progress bars may be unreliable.
+05/12/2023 06:45:57 - WARNING - huggingface_hub.repository - The progress bars may be unreliable.
+
+   cbe0ded..ac68b76  main -> main
+
+05/12/2023 06:47:27 - WARNING - huggingface_hub.repository - To https://huggingface.co/danielizham/whisper-small-es
+   cbe0ded..ac68b76  main -> main
+
+

wandb/run-20230510_094132-lvsln7ks/files/output.log

@@ -5473,3 +5473,50 @@ Reading metadata...: 1it [00:01,  1.78s/it]
 [INFO|configuration_utils.py:458] 2023-05-12 06:45:07,586 >> Configuration saved in ./config.json
 [INFO|configuration_utils.py:364] 2023-05-12 06:45:07,589 >> Configuration saved in ./generation_config.json
 [INFO|modeling_utils.py:1855] 2023-05-12 06:45:10,742 >> Model weights saved in ./pytorch_model.bin
+[INFO|feature_extraction_utils.py:369] 2023-05-12 06:45:10,746 >> Feature extractor saved in ./preprocessor_config.json
+Several commits (2) will be pushed upstream.
+The progress bars may be unreliable.
+05/12/2023 06:45:57 - WARNING - huggingface_hub.repository - Several commits (2) will be pushed upstream.
+05/12/2023 06:45:57 - WARNING - huggingface_hub.repository - The progress bars may be unreliable.
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+Upload file pytorch_model.bin: 931MB [01:20, 15.4MB/s]                           To https://huggingface.co/danielizham/whisper-small-es
+   cbe0ded..ac68b76  main -> main
+05/12/2023 06:47:27 - WARNING - huggingface_hub.repository - To https://huggingface.co/danielizham/whisper-small-es
+   cbe0ded..ac68b76  main -> main

wandb/run-20230510_094132-lvsln7ks/logs/debug-internal.log

@@ -70084,3 +70084,84 @@
 2023-05-12 06:45:52,576 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: stop_status
 2023-05-12 06:45:52,577 DEBUG   SenderThread:116166 [sender.py:send_request():402] send_request: stop_status
 2023-05-12 06:45:55,825 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: status_report
+2023-05-12 06:45:58,448 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:46:01,694 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: status_report
+2023-05-12 06:46:05,301 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: keepalive
+2023-05-12 06:46:06,453 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:46:06,703 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: status_report
+2023-05-12 06:46:07,576 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: stop_status
+2023-05-12 06:46:07,577 DEBUG   SenderThread:116166 [sender.py:send_request():402] send_request: stop_status
+2023-05-12 06:46:10,456 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:46:11,708 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: status_report
+2023-05-12 06:46:12,458 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:46:14,460 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:46:15,726 DEBUG   SenderThread:116166 [sender.py:send():375] send: stats
+2023-05-12 06:46:16,462 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:46:16,727 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: status_report
+2023-05-12 06:46:18,464 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:46:20,301 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: keepalive
+2023-05-12 06:46:20,466 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:46:22,468 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:46:22,576 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: stop_status
+2023-05-12 06:46:22,577 DEBUG   SenderThread:116166 [sender.py:send_request():402] send_request: stop_status
+2023-05-12 06:46:22,823 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: status_report
+2023-05-12 06:46:24,470 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:46:26,473 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:46:28,474 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:46:28,729 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: status_report
+2023-05-12 06:46:30,477 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:46:32,479 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:46:33,737 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: status_report
+2023-05-12 06:46:34,482 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:46:35,301 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: keepalive
+2023-05-12 06:46:36,484 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:46:37,576 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: stop_status
+2023-05-12 06:46:37,577 DEBUG   SenderThread:116166 [sender.py:send_request():402] send_request: stop_status
+2023-05-12 06:46:38,487 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:46:38,745 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: status_report
+2023-05-12 06:46:40,489 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:46:42,492 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:46:43,751 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: status_report
+2023-05-12 06:46:44,494 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:46:45,727 DEBUG   SenderThread:116166 [sender.py:send():375] send: stats
+2023-05-12 06:46:46,496 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:46:48,499 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:46:48,758 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: status_report
+2023-05-12 06:46:50,302 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: keepalive
+2023-05-12 06:46:50,501 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:46:52,504 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:46:52,576 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: stop_status
+2023-05-12 06:46:52,577 DEBUG   SenderThread:116166 [sender.py:send_request():402] send_request: stop_status
+2023-05-12 06:46:55,217 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: status_report
+2023-05-12 06:46:56,508 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:46:58,511 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:47:00,514 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:47:00,775 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: status_report
+2023-05-12 06:47:02,516 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:47:04,519 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:47:05,301 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: keepalive
+2023-05-12 06:47:05,782 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: status_report
+2023-05-12 06:47:06,521 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:47:07,577 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: stop_status
+2023-05-12 06:47:07,577 DEBUG   SenderThread:116166 [sender.py:send_request():402] send_request: stop_status
+2023-05-12 06:47:08,523 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:47:10,526 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:47:10,789 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: status_report
+2023-05-12 06:47:12,529 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:47:14,532 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:47:15,728 DEBUG   SenderThread:116166 [sender.py:send():375] send: stats
+2023-05-12 06:47:15,797 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: status_report
+2023-05-12 06:47:16,534 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:47:18,536 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:47:20,302 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: keepalive
+2023-05-12 06:47:20,539 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:47:20,803 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: status_report
+2023-05-12 06:47:22,541 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:47:22,577 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: stop_status
+2023-05-12 06:47:22,577 DEBUG   SenderThread:116166 [sender.py:send_request():402] send_request: stop_status
+2023-05-12 06:47:24,544 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:47:25,810 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: status_report
+2023-05-12 06:47:26,546 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:47:28,549 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:47:30,552 INFO    Thread-12 :116166 [dir_watcher.py:_on_file_modified():295] file/dir modified: /home/local/QCRI/dizham/kanari/whisper/whisper-small-es/wandb/run-20230510_094132-lvsln7ks/files/output.log
+2023-05-12 06:47:30,816 DEBUG   HandlerThread:116166 [handler.py:handle_request():144] handle_request: status_report