Hugging Face's logo

espnet
/
chendali_librimix_asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual

Automatic Speech Recognition
ESPnet
English
audio
Model card Files Community
lichenda commited on
Commit
b6296fe
•
1 Parent(s): 3ede66d

Update model

Browse files
Files changed (20) hide show
  1. README.md +0 -0
  2. exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/20epoch.pth +3 -0
  3. exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/RESULTS.md +44 -0
  4. exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/config.yaml +0 -0
  5. exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/acc.png +0 -0
  6. exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/backward_time.png +0 -0
  7. exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/cer.png +0 -0
  8. exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/clip.png +0 -0
  9. exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/forward_time.png +0 -0
  10. exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/gpu_max_cached_mem_GB.png +0 -0
  11. exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/grad_norm.png +0 -0
  12. exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/iter_time.png +0 -0
  13. exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/loss.png +0 -0
  14. exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/loss_att.png +0 -0
  15. exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/loss_scale.png +0 -0
  16. exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/optim0_lr0.png +0 -0
  17. exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/optim_step_time.png +0 -0
  18. exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/train_time.png +0 -0
  19. exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/wer.png +0 -0
  20. meta.yaml +8 -0
README.md CHANGED
The diff for this file is too large to render. See raw diff
 
exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/20epoch.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:741166d0d5aaec62c814b5be6bdeca887de50b328c8fa5ced8e34595826640d0
3
+ size 967122753
exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/RESULTS.md ADDED
@@ -0,0 +1,44 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ <!-- Generated by scripts/utils/show_asr_result.sh -->
2
+ # RESULTS
3
+ ## Environments
4
+ - date: `Thu Jul 27 19:07:11 CST 2023`
5
+ - python version: `3.9.16 (main, Mar 8 2023, 14:00:05) [GCC 11.2.0]`
6
+ - espnet version: `espnet 202304`
7
+ - pytorch version: `pytorch 2.0.1+cu118`
8
+ - Git hash: `bfa5a6ca2d1697c88443b2eaecdfdec72524e05d`
9
+ - Commit date: `Tue Jul 25 18:31:13 2023 +0800`
10
+
11
+ ## exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual
12
+ ### WER
13
+
14
+ |dataset|Snt|Wrd|Corr|Sub|Del|Ins|Err|S.Err|
15
+ |---|---|---|---|---|---|---|---|---|
16
+ |decode_sot_asr_model_valid.acc.ave/test|3000|114243|77.8|17.1|5.1|2.8|25.0|100.0|
17
+
18
+ ### CER
19
+
20
+ |dataset|Snt|Wrd|Corr|Sub|Del|Ins|Err|S.Err|
21
+ |---|---|---|---|---|---|---|---|---|
22
+ |decode_sot_asr_model_valid.acc.ave/test|3000|608408|87.7|6.2|6.1|3.4|15.7|100.0|
23
+
24
+ ### TER
25
+
26
+ |dataset|Snt|Wrd|Corr|Sub|Del|Ins|Err|S.Err|
27
+ |---|---|---|---|---|---|---|---|---|
28
+ ## exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/decode_sot_asr_model_valid.acc.ave
29
+ ### WER
30
+
31
+ |dataset|Snt|Wrd|Corr|Sub|Del|Ins|Err|S.Err|
32
+ |---|---|---|---|---|---|---|---|---|
33
+ |org/dev|3000|126853|76.7|18.5|4.7|2.7|26.0|100.0|
34
+
35
+ ### CER
36
+
37
+ |dataset|Snt|Wrd|Corr|Sub|Del|Ins|Err|S.Err|
38
+ |---|---|---|---|---|---|---|---|---|
39
+ |org/dev|3000|673222|87.3|6.8|5.9|3.6|16.4|100.0|
40
+
41
+ ### TER
42
+
43
+ |dataset|Snt|Wrd|Corr|Sub|Del|Ins|Err|S.Err|
44
+ |---|---|---|---|---|---|---|---|---|
exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/config.yaml ADDED
The diff for this file is too large to render. See raw diff
 
exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/acc.png ADDED
exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/backward_time.png ADDED
exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/cer.png ADDED
exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/clip.png ADDED
exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/forward_time.png ADDED
exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/gpu_max_cached_mem_GB.png ADDED
exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/grad_norm.png ADDED
exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/iter_time.png ADDED
exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/loss.png ADDED
exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/loss_att.png ADDED
exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/loss_scale.png ADDED
exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/optim0_lr0.png ADDED
exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/optim_step_time.png ADDED
exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/train_time.png ADDED
exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/images/wer.png ADDED
meta.yaml ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ espnet: '202304'
2
+ files:
3
+ asr_model_file: exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/20epoch.pth
4
+ python: "3.9.16 (main, Mar 8 2023, 14:00:05) \n[GCC 11.2.0]"
5
+ timestamp: 1690456286.588426
6
+ torch: 2.0.1+cu118
7
+ yaml_files:
8
+ asr_train_config: exp/asr_train_sot_asr_whisper_small_raw_en_whisper_multilingual/config.yaml