Training in progress, step 2000

.gitattributes

@@ -25,3 +25,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zstandard filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+wandb/run-20220202_223026-1j0459xm/run-1j0459xm.wandb filter=lfs diff=lfs merge=lfs -text

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d0862aa2d3971991ce599ac21449fce85407fae2ec83b0114af97a7dc8c839f1
+oid sha256:facea9db39d2e3f652ba8c7cd632cd25d2353d7f746ccf2e8b54656cdd52e5e3
 size 1262075377

runs/Feb02_22-30-13_brutasse/events.out.tfevents.1643841025.brutasse.21084.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b70f929b28e8e9c51ccf6a550567a21ae0e42c065facfe1cf393d91a881ab426
-size 7987
+oid sha256:9f4030af01613001f35413cdb644507cd85c0c2778120df6972366374b5da650
+size 9090

wandb/run-20220202_223026-1j0459xm/files/output.log

@@ -1211,3 +1211,409 @@ Configuration saved in ./checkpoint-1500/config.json
 {'eval_loss': 1.1156758069992065, 'eval_wer': 0.8358501277320466, 'eval_runtime': 192.2259, 'eval_samples_per_second': 25.194, 'eval_steps_per_second': 3.153, 'epoch': 4.11}
 Model weights saved in ./checkpoint-1500/pytorch_model.bin
 Configuration saved in ./checkpoint-1500/preprocessor_config.json
+Configuration saved in ./preprocessor_config.json
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+  9%|████▍                                              | 1599/18250 [44:08<4:42:57,  1.02s/it]
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+  9%|████▊                                              | 1700/18250 [46:10<4:34:22,  1.01it/s]
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ 10%|█████                                              | 1799/18250 [48:09<4:40:25,  1.02s/it]
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ 10%|█████▎                                             | 1899/18250 [50:13<5:50:39,  1.29s/it]
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ 11%|█████▌                                             | 2000/18250 [52:14<5:35:32,  1.24s/it]The following columns in the evaluation set  don't have a corresponding argument in `Wav2Vec2ForCTC.forward` and have been ignored: input_length. If input_length are not expected by `Wav2Vec2ForCTC.forward`,  you can safely ignore this message.
+***** Running Evaluation *****
+  Num examples = 4843
+  Batch size = 8
+  0%|▏                                                         | 2/606 [00:00<01:53,  5.31it/s]
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+Configuration saved in ./checkpoint-2000/config.json
+{'eval_loss': 0.6002867221832275, 'eval_wer': 0.6314220834516038, 'eval_runtime': 191.4975, 'eval_samples_per_second': 25.29, 'eval_steps_per_second': 3.165, 'epoch': 5.48}
+Model weights saved in ./checkpoint-2000/pytorch_model.bin
+Configuration saved in ./checkpoint-2000/preprocessor_config.json
+Configuration saved in ./preprocessor_config.json
+02/02/2022 23:26:52 - WARNING - huggingface_hub.repository - Adding files tracked by Git LFS: ['wandb/run-20220202_223026-1j0459xm/run-1j0459xm.wandb']. This may take a bit of time if the files are large.