csukuangfj commited on
Commit
f8d7faa
1 Parent(s): 97e0ed5

Add decoding results.

Browse files
Files changed (49) hide show
  1. decoding_results/fast_beam_search/errs-test-clean-beam_4_max_contexts_4_max_states_8-epoch-25-avg-8-beam-4-max-contexts-4-max-states-8.txt +0 -0
  2. decoding_results/fast_beam_search/errs-test-clean-beam_4_max_contexts_4_max_states_8-epoch-34-avg-10-beam-4-max-contexts-4-max-states-8.txt +0 -0
  3. decoding_results/fast_beam_search/errs-test-clean-beam_4_max_contexts_4_max_states_8-epoch-38-avg-10-beam-4-max-contexts-4-max-states-8.txt +0 -0
  4. decoding_results/fast_beam_search/errs-test-other-beam_4_max_contexts_4_max_states_8-epoch-25-avg-8-beam-4-max-contexts-4-max-states-8.txt +0 -0
  5. decoding_results/fast_beam_search/errs-test-other-beam_4_max_contexts_4_max_states_8-epoch-34-avg-10-beam-4-max-contexts-4-max-states-8.txt +0 -0
  6. decoding_results/fast_beam_search/errs-test-other-beam_4_max_contexts_4_max_states_8-epoch-38-avg-10-beam-4-max-contexts-4-max-states-8.txt +0 -0
  7. decoding_results/fast_beam_search/log-decode-epoch-25-avg-8-beam-4-max-contexts-4-max-states-8-2022-04-29-14-24-21 +63 -0
  8. decoding_results/fast_beam_search/log-decode-epoch-34-avg-10-beam-4-max-contexts-4-max-states-8-2022-04-29-14-30-30 +63 -0
  9. decoding_results/fast_beam_search/log-decode-epoch-38-avg-10-beam-4-max-contexts-4-max-states-8-2022-04-29-14-32-02 +63 -0
  10. decoding_results/fast_beam_search/recogs-test-clean-beam_4_max_contexts_4_max_states_8-epoch-25-avg-8-beam-4-max-contexts-4-max-states-8.txt +0 -0
  11. decoding_results/fast_beam_search/recogs-test-clean-beam_4_max_contexts_4_max_states_8-epoch-34-avg-10-beam-4-max-contexts-4-max-states-8.txt +0 -0
  12. decoding_results/fast_beam_search/recogs-test-clean-beam_4_max_contexts_4_max_states_8-epoch-38-avg-10-beam-4-max-contexts-4-max-states-8.txt +0 -0
  13. decoding_results/fast_beam_search/recogs-test-other-beam_4_max_contexts_4_max_states_8-epoch-25-avg-8-beam-4-max-contexts-4-max-states-8.txt +0 -0
  14. decoding_results/fast_beam_search/recogs-test-other-beam_4_max_contexts_4_max_states_8-epoch-34-avg-10-beam-4-max-contexts-4-max-states-8.txt +0 -0
  15. decoding_results/fast_beam_search/recogs-test-other-beam_4_max_contexts_4_max_states_8-epoch-38-avg-10-beam-4-max-contexts-4-max-states-8.txt +0 -0
  16. decoding_results/fast_beam_search/wer-summary-test-clean-beam_4_max_contexts_4_max_states_8-epoch-25-avg-8-beam-4-max-contexts-4-max-states-8.txt +2 -0
  17. decoding_results/fast_beam_search/wer-summary-test-clean-beam_4_max_contexts_4_max_states_8-epoch-34-avg-10-beam-4-max-contexts-4-max-states-8.txt +2 -0
  18. decoding_results/fast_beam_search/wer-summary-test-clean-beam_4_max_contexts_4_max_states_8-epoch-38-avg-10-beam-4-max-contexts-4-max-states-8.txt +2 -0
  19. decoding_results/fast_beam_search/wer-summary-test-other-beam_4_max_contexts_4_max_states_8-epoch-25-avg-8-beam-4-max-contexts-4-max-states-8.txt +2 -0
  20. decoding_results/fast_beam_search/wer-summary-test-other-beam_4_max_contexts_4_max_states_8-epoch-34-avg-10-beam-4-max-contexts-4-max-states-8.txt +2 -0
  21. decoding_results/fast_beam_search/wer-summary-test-other-beam_4_max_contexts_4_max_states_8-epoch-38-avg-10-beam-4-max-contexts-4-max-states-8.txt +2 -0
  22. decoding_results/greedy_search/errs-test-clean-greedy_search-epoch-25-avg-8-context-2-max-sym-per-frame-1.txt +0 -0
  23. decoding_results/greedy_search/errs-test-clean-greedy_search-epoch-34-avg-10-context-2-max-sym-per-frame-1.txt +0 -0
  24. decoding_results/greedy_search/errs-test-clean-greedy_search-epoch-38-avg-10-context-2-max-sym-per-frame-1.txt +0 -0
  25. decoding_results/greedy_search/errs-test-other-greedy_search-epoch-25-avg-8-context-2-max-sym-per-frame-1.txt +0 -0
  26. decoding_results/greedy_search/errs-test-other-greedy_search-epoch-34-avg-10-context-2-max-sym-per-frame-1.txt +0 -0
  27. decoding_results/greedy_search/errs-test-other-greedy_search-epoch-38-avg-10-context-2-max-sym-per-frame-1.txt +0 -0
  28. decoding_results/greedy_search/log-decode-epoch-25-avg-8-context-2-max-sym-per-frame-1-2022-04-29-14-22-17 +25 -0
  29. decoding_results/greedy_search/log-decode-epoch-34-avg-10-context-2-max-sym-per-frame-1-2022-04-29-14-30-13 +25 -0
  30. decoding_results/greedy_search/log-decode-epoch-38-avg-10-context-2-max-sym-per-frame-1-2022-04-29-14-31-08 +25 -0
  31. decoding_results/greedy_search/recogs-test-clean-greedy_search-epoch-25-avg-8-context-2-max-sym-per-frame-1.txt +0 -0
  32. decoding_results/greedy_search/recogs-test-clean-greedy_search-epoch-34-avg-10-context-2-max-sym-per-frame-1.txt +0 -0
  33. decoding_results/greedy_search/recogs-test-clean-greedy_search-epoch-38-avg-10-context-2-max-sym-per-frame-1.txt +0 -0
  34. decoding_results/greedy_search/recogs-test-other-greedy_search-epoch-25-avg-8-context-2-max-sym-per-frame-1.txt +0 -0
  35. decoding_results/greedy_search/recogs-test-other-greedy_search-epoch-34-avg-10-context-2-max-sym-per-frame-1.txt +0 -0
  36. decoding_results/greedy_search/recogs-test-other-greedy_search-epoch-38-avg-10-context-2-max-sym-per-frame-1.txt +0 -0
  37. decoding_results/greedy_search/wer-summary-test-clean-greedy_search-epoch-25-avg-8-context-2-max-sym-per-frame-1.txt +2 -0
  38. decoding_results/greedy_search/wer-summary-test-clean-greedy_search-epoch-34-avg-10-context-2-max-sym-per-frame-1.txt +2 -0
  39. decoding_results/greedy_search/wer-summary-test-clean-greedy_search-epoch-38-avg-10-context-2-max-sym-per-frame-1.txt +2 -0
  40. decoding_results/greedy_search/wer-summary-test-other-greedy_search-epoch-25-avg-8-context-2-max-sym-per-frame-1.txt +2 -0
  41. decoding_results/greedy_search/wer-summary-test-other-greedy_search-epoch-34-avg-10-context-2-max-sym-per-frame-1.txt +2 -0
  42. decoding_results/greedy_search/wer-summary-test-other-greedy_search-epoch-38-avg-10-context-2-max-sym-per-frame-1.txt +2 -0
  43. decoding_results/modified_beam_search/errs-test-clean-beam_size_4-epoch-25-avg-8-modified_beam_search-beam-size-4.txt +0 -0
  44. decoding_results/modified_beam_search/errs-test-other-beam_size_4-epoch-25-avg-8-modified_beam_search-beam-size-4.txt +0 -0
  45. decoding_results/modified_beam_search/log-decode-epoch-25-avg-8-modified_beam_search-beam-size-4-2022-04-29-14-26-00 +63 -0
  46. decoding_results/modified_beam_search/recogs-test-clean-beam_size_4-epoch-25-avg-8-modified_beam_search-beam-size-4.txt +0 -0
  47. decoding_results/modified_beam_search/recogs-test-other-beam_size_4-epoch-25-avg-8-modified_beam_search-beam-size-4.txt +0 -0
  48. decoding_results/modified_beam_search/wer-summary-test-clean-beam_size_4-epoch-25-avg-8-modified_beam_search-beam-size-4.txt +2 -0
  49. decoding_results/modified_beam_search/wer-summary-test-other-beam_size_4-epoch-25-avg-8-modified_beam_search-beam-size-4.txt +2 -0
decoding_results/fast_beam_search/errs-test-clean-beam_4_max_contexts_4_max_states_8-epoch-25-avg-8-beam-4-max-contexts-4-max-states-8.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/fast_beam_search/errs-test-clean-beam_4_max_contexts_4_max_states_8-epoch-34-avg-10-beam-4-max-contexts-4-max-states-8.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/fast_beam_search/errs-test-clean-beam_4_max_contexts_4_max_states_8-epoch-38-avg-10-beam-4-max-contexts-4-max-states-8.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/fast_beam_search/errs-test-other-beam_4_max_contexts_4_max_states_8-epoch-25-avg-8-beam-4-max-contexts-4-max-states-8.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/fast_beam_search/errs-test-other-beam_4_max_contexts_4_max_states_8-epoch-34-avg-10-beam-4-max-contexts-4-max-states-8.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/fast_beam_search/errs-test-other-beam_4_max_contexts_4_max_states_8-epoch-38-avg-10-beam-4-max-contexts-4-max-states-8.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/fast_beam_search/log-decode-epoch-25-avg-8-beam-4-max-contexts-4-max-states-8-2022-04-29-14-24-21 ADDED
@@ -0,0 +1,63 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2022-04-29 14:24:21,765 INFO [decode.py:475] Decoding started
2
+ 2022-04-29 14:24:21,766 INFO [decode.py:481] Device: cuda:0
3
+ 2022-04-29 14:24:21,768 INFO [decode.py:491] {'best_train_loss': inf, 'best_valid_loss': inf, 'best_train_epoch': -1, 'best_valid_epoch': -1, 'batch_idx_train': 0, 'log_interval': 50, 'reset_interval': 200, 'valid_interval': 3000, 'feature_dim': 80, 'subsampling_factor': 4, 'encoder_dim': 512, 'nhead': 8, 'dim_feedforward': 2048, 'num_encoder_layers': 12, 'decoder_dim': 512, 'joiner_dim': 512, 'model_warm_step': 3000, 'env_info': {'k2-version': '1.15.1', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': 'f8d2dba06c000ffee36aab5b66f24e7c9809f116', 'k2-git-date': 'Thu Apr 21 12:20:34 2022', 'lhotse-version': '1.1.0.dev+missing.version.file', 'torch-version': '1.10.0+cu102', 'torch-cuda-available': True, 'torch-cuda-version': '10.2', 'python-version': '3.8', 'icefall-git-branch': 'modified-conformer-with-multi-datasets', 'icefall-git-sha1': 'fb61e31-dirty', 'icefall-git-date': 'Fri Apr 29 14:15:19 2022', 'icefall-path': '/ceph-fj/fangjun/open-source-2/icefall-multi-4', 'k2-path': '/ceph-fj/fangjun/open-source-2/k2-multi-22/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-fj/fangjun/open-source-2/lhotse-multi-3/lhotse/__init__.py', 'hostname': 'de-74279-k2-train-3-0307202051-57dc848959-8tmmp', 'IP address': '10.177.24.138'}, 'epoch': 25, 'iter': 0, 'avg': 8, 'exp_dir': PosixPath('pruned_transducer_stateless2/exp'), 'bpe_model': 'data/lang_bpe_500/bpe.model', 'decoding_method': 'fast_beam_search', 'beam_size': 4, 'beam': 4, 'max_contexts': 4, 'max_states': 8, 'context_size': 2, 'max_sym_per_frame': 1, 'full_libri': True, 'manifest_dir': PosixPath('data/fbank'), 'max_duration': 600, 'bucketing_sampler': True, 'num_buckets': 30, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'res_dir': PosixPath('pruned_transducer_stateless2/exp/fast_beam_search'), 'suffix': 'epoch-25-avg-8-beam-4-max-contexts-4-max-states-8', 'blank_id': 0, 'unk_id': 2, 'vocab_size': 500}
4
+ 2022-04-29 14:24:21,768 INFO [decode.py:493] About to create model
5
+ 2022-04-29 14:24:22,165 INFO [decode.py:521] averaging ['pruned_transducer_stateless2/exp/epoch-18.pt', 'pruned_transducer_stateless2/exp/epoch-19.pt', 'pruned_transducer_stateless2/exp/epoch-20.pt', 'pruned_transducer_stateless2/exp/epoch-21.pt', 'pruned_transducer_stateless2/exp/epoch-22.pt', 'pruned_transducer_stateless2/exp/epoch-23.pt', 'pruned_transducer_stateless2/exp/epoch-24.pt', 'pruned_transducer_stateless2/exp/epoch-25.pt']
6
+ 2022-04-29 14:24:31,939 INFO [decode.py:535] Number of model parameters: 78648040
7
+ 2022-04-29 14:24:31,939 INFO [asr_datamodule.py:422] About to get test-clean cuts
8
+ 2022-04-29 14:24:32,040 INFO [asr_datamodule.py:427] About to get test-other cuts
9
+ 2022-04-29 14:24:33,393 INFO [decode.py:389] batch 0/?, cuts processed until now is 123
10
+ 2022-04-29 14:24:34,924 INFO [decode.py:389] batch 2/?, cuts processed until now is 389
11
+ 2022-04-29 14:24:36,910 INFO [decode.py:389] batch 4/?, cuts processed until now is 500
12
+ 2022-04-29 14:24:38,299 INFO [decode.py:389] batch 6/?, cuts processed until now is 635
13
+ 2022-04-29 14:24:40,462 INFO [decode.py:389] batch 8/?, cuts processed until now is 723
14
+ 2022-04-29 14:24:42,024 INFO [decode.py:389] batch 10/?, cuts processed until now is 945
15
+ 2022-04-29 14:24:45,606 INFO [decode.py:389] batch 12/?, cuts processed until now is 983
16
+ 2022-04-29 14:24:47,883 INFO [decode.py:389] batch 14/?, cuts processed until now is 1086
17
+ 2022-04-29 14:24:49,357 INFO [decode.py:389] batch 16/?, cuts processed until now is 1184
18
+ 2022-04-29 14:24:51,065 INFO [decode.py:389] batch 18/?, cuts processed until now is 1364
19
+ 2022-04-29 14:24:52,595 INFO [decode.py:389] batch 20/?, cuts processed until now is 1558
20
+ 2022-04-29 14:24:53,858 INFO [decode.py:389] batch 22/?, cuts processed until now is 1783
21
+ 2022-04-29 14:24:56,172 INFO [decode.py:389] batch 24/?, cuts processed until now is 1872
22
+ 2022-04-29 14:24:57,481 INFO [decode.py:389] batch 26/?, cuts processed until now is 1985
23
+ 2022-04-29 14:24:58,305 INFO [decode.py:389] batch 28/?, cuts processed until now is 2247
24
+ 2022-04-29 14:25:00,027 INFO [decode.py:389] batch 30/?, cuts processed until now is 2383
25
+ 2022-04-29 14:25:02,146 INFO [decode.py:389] batch 32/?, cuts processed until now is 2448
26
+ 2022-04-29 14:25:04,646 INFO [decode.py:389] batch 34/?, cuts processed until now is 2515
27
+ 2022-04-29 14:25:06,008 INFO [decode.py:389] batch 36/?, cuts processed until now is 2558
28
+ 2022-04-29 14:25:07,662 INFO [decode.py:389] batch 38/?, cuts processed until now is 2620
29
+ 2022-04-29 14:25:07,800 INFO [decode.py:406] The transcripts are stored in pruned_transducer_stateless2/exp/fast_beam_search/recogs-test-clean-beam_4_max_contexts_4_max_states_8-epoch-25-avg-8-beam-4-max-contexts-4-max-states-8.txt
30
+ 2022-04-29 14:25:07,866 INFO [utils.py:405] [test-clean-beam_4_max_contexts_4_max_states_8] %WER 2.61% [1372 / 52576, 143 ins, 118 del, 1111 sub ]
31
+ 2022-04-29 14:25:08,027 INFO [decode.py:419] Wrote detailed error stats to pruned_transducer_stateless2/exp/fast_beam_search/errs-test-clean-beam_4_max_contexts_4_max_states_8-epoch-25-avg-8-beam-4-max-contexts-4-max-states-8.txt
32
+ 2022-04-29 14:25:08,027 INFO [decode.py:436]
33
+ For test-clean, WER of different settings are:
34
+ beam_4_max_contexts_4_max_states_8 2.61 best for test-clean
35
+
36
+ 2022-04-29 14:25:09,138 INFO [decode.py:389] batch 0/?, cuts processed until now is 138
37
+ 2022-04-29 14:25:10,588 INFO [decode.py:389] batch 2/?, cuts processed until now is 425
38
+ 2022-04-29 14:25:12,450 INFO [decode.py:389] batch 4/?, cuts processed until now is 551
39
+ 2022-04-29 14:25:13,708 INFO [decode.py:389] batch 6/?, cuts processed until now is 719
40
+ 2022-04-29 14:25:15,691 INFO [decode.py:389] batch 8/?, cuts processed until now is 824
41
+ 2022-04-29 14:25:17,175 INFO [decode.py:389] batch 10/?, cuts processed until now is 1070
42
+ 2022-04-29 14:25:20,550 INFO [decode.py:389] batch 12/?, cuts processed until now is 1112
43
+ 2022-04-29 14:25:22,693 INFO [decode.py:389] batch 14/?, cuts processed until now is 1230
44
+ 2022-04-29 14:25:24,073 INFO [decode.py:389] batch 16/?, cuts processed until now is 1341
45
+ 2022-04-29 14:25:25,733 INFO [decode.py:389] batch 18/?, cuts processed until now is 1547
46
+ 2022-04-29 14:25:27,257 INFO [decode.py:389] batch 20/?, cuts processed until now is 1765
47
+ 2022-04-29 14:25:28,471 INFO [decode.py:389] batch 22/?, cuts processed until now is 2131
48
+ 2022-04-29 14:25:30,444 INFO [decode.py:389] batch 24/?, cuts processed until now is 2288
49
+ 2022-04-29 14:25:31,675 INFO [decode.py:389] batch 26/?, cuts processed until now is 2413
50
+ 2022-04-29 14:25:32,812 INFO [decode.py:389] batch 28/?, cuts processed until now is 2533
51
+ 2022-04-29 14:25:34,080 INFO [decode.py:389] batch 30/?, cuts processed until now is 2653
52
+ 2022-04-29 14:25:36,137 INFO [decode.py:389] batch 32/?, cuts processed until now is 2763
53
+ 2022-04-29 14:25:37,694 INFO [decode.py:389] batch 34/?, cuts processed until now is 2813
54
+ 2022-04-29 14:25:38,987 INFO [decode.py:389] batch 36/?, cuts processed until now is 2860
55
+ 2022-04-29 14:25:41,040 INFO [decode.py:389] batch 38/?, cuts processed until now is 2939
56
+ 2022-04-29 14:25:41,179 INFO [decode.py:406] The transcripts are stored in pruned_transducer_stateless2/exp/fast_beam_search/recogs-test-other-beam_4_max_contexts_4_max_states_8-epoch-25-avg-8-beam-4-max-contexts-4-max-states-8.txt
57
+ 2022-04-29 14:25:41,247 INFO [utils.py:405] [test-other-beam_4_max_contexts_4_max_states_8] %WER 6.17% [3231 / 52343, 333 ins, 286 del, 2612 sub ]
58
+ 2022-04-29 14:25:41,531 INFO [decode.py:419] Wrote detailed error stats to pruned_transducer_stateless2/exp/fast_beam_search/errs-test-other-beam_4_max_contexts_4_max_states_8-epoch-25-avg-8-beam-4-max-contexts-4-max-states-8.txt
59
+ 2022-04-29 14:25:41,532 INFO [decode.py:436]
60
+ For test-other, WER of different settings are:
61
+ beam_4_max_contexts_4_max_states_8 6.17 best for test-other
62
+
63
+ 2022-04-29 14:25:41,532 INFO [decode.py:563] Done!
decoding_results/fast_beam_search/log-decode-epoch-34-avg-10-beam-4-max-contexts-4-max-states-8-2022-04-29-14-30-30 ADDED
@@ -0,0 +1,63 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2022-04-29 14:30:30,923 INFO [decode.py:475] Decoding started
2
+ 2022-04-29 14:30:30,923 INFO [decode.py:481] Device: cuda:0
3
+ 2022-04-29 14:30:30,925 INFO [decode.py:491] {'best_train_loss': inf, 'best_valid_loss': inf, 'best_train_epoch': -1, 'best_valid_epoch': -1, 'batch_idx_train': 0, 'log_interval': 50, 'reset_interval': 200, 'valid_interval': 3000, 'feature_dim': 80, 'subsampling_factor': 4, 'encoder_dim': 512, 'nhead': 8, 'dim_feedforward': 2048, 'num_encoder_layers': 12, 'decoder_dim': 512, 'joiner_dim': 512, 'model_warm_step': 3000, 'env_info': {'k2-version': '1.15.1', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': 'f8d2dba06c000ffee36aab5b66f24e7c9809f116', 'k2-git-date': 'Thu Apr 21 12:20:34 2022', 'lhotse-version': '1.1.0.dev+missing.version.file', 'torch-version': '1.10.0+cu102', 'torch-cuda-available': True, 'torch-cuda-version': '10.2', 'python-version': '3.8', 'icefall-git-branch': 'modified-conformer-with-multi-datasets', 'icefall-git-sha1': 'fb61e31-dirty', 'icefall-git-date': 'Fri Apr 29 14:15:19 2022', 'icefall-path': '/ceph-fj/fangjun/open-source-2/icefall-multi-4', 'k2-path': '/ceph-fj/fangjun/open-source-2/k2-multi-22/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-fj/fangjun/open-source-2/lhotse-multi-3/lhotse/__init__.py', 'hostname': 'de-74279-k2-train-3-0307202051-57dc848959-8tmmp', 'IP address': '10.177.24.138'}, 'epoch': 34, 'iter': 0, 'avg': 10, 'exp_dir': PosixPath('pruned_transducer_stateless2/exp'), 'bpe_model': 'data/lang_bpe_500/bpe.model', 'decoding_method': 'fast_beam_search', 'beam_size': 4, 'beam': 4, 'max_contexts': 4, 'max_states': 8, 'context_size': 2, 'max_sym_per_frame': 1, 'full_libri': True, 'manifest_dir': PosixPath('data/fbank'), 'max_duration': 600, 'bucketing_sampler': True, 'num_buckets': 30, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'res_dir': PosixPath('pruned_transducer_stateless2/exp/fast_beam_search'), 'suffix': 'epoch-34-avg-10-beam-4-max-contexts-4-max-states-8', 'blank_id': 0, 'unk_id': 2, 'vocab_size': 500}
4
+ 2022-04-29 14:30:30,925 INFO [decode.py:493] About to create model
5
+ 2022-04-29 14:30:31,302 INFO [decode.py:521] averaging ['pruned_transducer_stateless2/exp/epoch-25.pt', 'pruned_transducer_stateless2/exp/epoch-26.pt', 'pruned_transducer_stateless2/exp/epoch-27.pt', 'pruned_transducer_stateless2/exp/epoch-28.pt', 'pruned_transducer_stateless2/exp/epoch-29.pt', 'pruned_transducer_stateless2/exp/epoch-30.pt', 'pruned_transducer_stateless2/exp/epoch-31.pt', 'pruned_transducer_stateless2/exp/epoch-32.pt', 'pruned_transducer_stateless2/exp/epoch-33.pt', 'pruned_transducer_stateless2/exp/epoch-34.pt']
6
+ 2022-04-29 14:30:41,771 INFO [decode.py:535] Number of model parameters: 78648040
7
+ 2022-04-29 14:30:41,771 INFO [asr_datamodule.py:422] About to get test-clean cuts
8
+ 2022-04-29 14:30:41,871 INFO [asr_datamodule.py:427] About to get test-other cuts
9
+ 2022-04-29 14:30:43,192 INFO [decode.py:389] batch 0/?, cuts processed until now is 123
10
+ 2022-04-29 14:30:44,628 INFO [decode.py:389] batch 2/?, cuts processed until now is 389
11
+ 2022-04-29 14:30:46,531 INFO [decode.py:389] batch 4/?, cuts processed until now is 500
12
+ 2022-04-29 14:30:47,781 INFO [decode.py:389] batch 6/?, cuts processed until now is 635
13
+ 2022-04-29 14:30:49,866 INFO [decode.py:389] batch 8/?, cuts processed until now is 723
14
+ 2022-04-29 14:30:51,385 INFO [decode.py:389] batch 10/?, cuts processed until now is 945
15
+ 2022-04-29 14:30:54,853 INFO [decode.py:389] batch 12/?, cuts processed until now is 983
16
+ 2022-04-29 14:30:57,058 INFO [decode.py:389] batch 14/?, cuts processed until now is 1086
17
+ 2022-04-29 14:30:58,492 INFO [decode.py:389] batch 16/?, cuts processed until now is 1184
18
+ 2022-04-29 14:31:00,183 INFO [decode.py:389] batch 18/?, cuts processed until now is 1364
19
+ 2022-04-29 14:31:01,670 INFO [decode.py:389] batch 20/?, cuts processed until now is 1558
20
+ 2022-04-29 14:31:02,928 INFO [decode.py:389] batch 22/?, cuts processed until now is 1783
21
+ 2022-04-29 14:31:05,165 INFO [decode.py:389] batch 24/?, cuts processed until now is 1872
22
+ 2022-04-29 14:31:06,432 INFO [decode.py:389] batch 26/?, cuts processed until now is 1985
23
+ 2022-04-29 14:31:07,243 INFO [decode.py:389] batch 28/?, cuts processed until now is 2247
24
+ 2022-04-29 14:31:08,937 INFO [decode.py:389] batch 30/?, cuts processed until now is 2383
25
+ 2022-04-29 14:31:11,037 INFO [decode.py:389] batch 32/?, cuts processed until now is 2448
26
+ 2022-04-29 14:31:13,499 INFO [decode.py:389] batch 34/?, cuts processed until now is 2515
27
+ 2022-04-29 14:31:14,852 INFO [decode.py:389] batch 36/?, cuts processed until now is 2558
28
+ 2022-04-29 14:31:16,487 INFO [decode.py:389] batch 38/?, cuts processed until now is 2620
29
+ 2022-04-29 14:31:16,613 INFO [decode.py:406] The transcripts are stored in pruned_transducer_stateless2/exp/fast_beam_search/recogs-test-clean-beam_4_max_contexts_4_max_states_8-epoch-34-avg-10-beam-4-max-contexts-4-max-states-8.txt
30
+ 2022-04-29 14:31:16,681 INFO [utils.py:405] [test-clean-beam_4_max_contexts_4_max_states_8] %WER 2.66% [1400 / 52576, 148 ins, 111 del, 1141 sub ]
31
+ 2022-04-29 14:31:16,848 INFO [decode.py:419] Wrote detailed error stats to pruned_transducer_stateless2/exp/fast_beam_search/errs-test-clean-beam_4_max_contexts_4_max_states_8-epoch-34-avg-10-beam-4-max-contexts-4-max-states-8.txt
32
+ 2022-04-29 14:31:16,849 INFO [decode.py:436]
33
+ For test-clean, WER of different settings are:
34
+ beam_4_max_contexts_4_max_states_8 2.66 best for test-clean
35
+
36
+ 2022-04-29 14:31:17,943 INFO [decode.py:389] batch 0/?, cuts processed until now is 138
37
+ 2022-04-29 14:31:19,395 INFO [decode.py:389] batch 2/?, cuts processed until now is 425
38
+ 2022-04-29 14:31:21,213 INFO [decode.py:389] batch 4/?, cuts processed until now is 551
39
+ 2022-04-29 14:31:22,481 INFO [decode.py:389] batch 6/?, cuts processed until now is 719
40
+ 2022-04-29 14:31:24,382 INFO [decode.py:389] batch 8/?, cuts processed until now is 824
41
+ 2022-04-29 14:31:25,795 INFO [decode.py:389] batch 10/?, cuts processed until now is 1070
42
+ 2022-04-29 14:31:29,085 INFO [decode.py:389] batch 12/?, cuts processed until now is 1112
43
+ 2022-04-29 14:31:31,132 INFO [decode.py:389] batch 14/?, cuts processed until now is 1230
44
+ 2022-04-29 14:31:32,459 INFO [decode.py:389] batch 16/?, cuts processed until now is 1341
45
+ 2022-04-29 14:31:34,075 INFO [decode.py:389] batch 18/?, cuts processed until now is 1547
46
+ 2022-04-29 14:31:35,549 INFO [decode.py:389] batch 20/?, cuts processed until now is 1765
47
+ 2022-04-29 14:31:36,842 INFO [decode.py:389] batch 22/?, cuts processed until now is 2131
48
+ 2022-04-29 14:31:38,766 INFO [decode.py:389] batch 24/?, cuts processed until now is 2288
49
+ 2022-04-29 14:31:39,985 INFO [decode.py:389] batch 26/?, cuts processed until now is 2413
50
+ 2022-04-29 14:31:41,107 INFO [decode.py:389] batch 28/?, cuts processed until now is 2533
51
+ 2022-04-29 14:31:42,356 INFO [decode.py:389] batch 30/?, cuts processed until now is 2653
52
+ 2022-04-29 14:31:44,351 INFO [decode.py:389] batch 32/?, cuts processed until now is 2763
53
+ 2022-04-29 14:31:45,865 INFO [decode.py:389] batch 34/?, cuts processed until now is 2813
54
+ 2022-04-29 14:31:47,136 INFO [decode.py:389] batch 36/?, cuts processed until now is 2860
55
+ 2022-04-29 14:31:49,089 INFO [decode.py:389] batch 38/?, cuts processed until now is 2939
56
+ 2022-04-29 14:31:49,223 INFO [decode.py:406] The transcripts are stored in pruned_transducer_stateless2/exp/fast_beam_search/recogs-test-other-beam_4_max_contexts_4_max_states_8-epoch-34-avg-10-beam-4-max-contexts-4-max-states-8.txt
57
+ 2022-04-29 14:31:49,318 INFO [utils.py:405] [test-other-beam_4_max_contexts_4_max_states_8] %WER 6.00% [3140 / 52343, 314 ins, 322 del, 2504 sub ]
58
+ 2022-04-29 14:31:49,486 INFO [decode.py:419] Wrote detailed error stats to pruned_transducer_stateless2/exp/fast_beam_search/errs-test-other-beam_4_max_contexts_4_max_states_8-epoch-34-avg-10-beam-4-max-contexts-4-max-states-8.txt
59
+ 2022-04-29 14:31:49,486 INFO [decode.py:436]
60
+ For test-other, WER of different settings are:
61
+ beam_4_max_contexts_4_max_states_8 6.0 best for test-other
62
+
63
+ 2022-04-29 14:31:49,486 INFO [decode.py:563] Done!
decoding_results/fast_beam_search/log-decode-epoch-38-avg-10-beam-4-max-contexts-4-max-states-8-2022-04-29-14-32-02 ADDED
@@ -0,0 +1,63 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2022-04-29 14:32:02,892 INFO [decode.py:475] Decoding started
2
+ 2022-04-29 14:32:02,892 INFO [decode.py:481] Device: cuda:0
3
+ 2022-04-29 14:32:02,894 INFO [decode.py:491] {'best_train_loss': inf, 'best_valid_loss': inf, 'best_train_epoch': -1, 'best_valid_epoch': -1, 'batch_idx_train': 0, 'log_interval': 50, 'reset_interval': 200, 'valid_interval': 3000, 'feature_dim': 80, 'subsampling_factor': 4, 'encoder_dim': 512, 'nhead': 8, 'dim_feedforward': 2048, 'num_encoder_layers': 12, 'decoder_dim': 512, 'joiner_dim': 512, 'model_warm_step': 3000, 'env_info': {'k2-version': '1.15.1', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': 'f8d2dba06c000ffee36aab5b66f24e7c9809f116', 'k2-git-date': 'Thu Apr 21 12:20:34 2022', 'lhotse-version': '1.1.0.dev+missing.version.file', 'torch-version': '1.10.0+cu102', 'torch-cuda-available': True, 'torch-cuda-version': '10.2', 'python-version': '3.8', 'icefall-git-branch': 'modified-conformer-with-multi-datasets', 'icefall-git-sha1': 'fb61e31-dirty', 'icefall-git-date': 'Fri Apr 29 14:15:19 2022', 'icefall-path': '/ceph-fj/fangjun/open-source-2/icefall-multi-4', 'k2-path': '/ceph-fj/fangjun/open-source-2/k2-multi-22/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-fj/fangjun/open-source-2/lhotse-multi-3/lhotse/__init__.py', 'hostname': 'de-74279-k2-train-3-0307202051-57dc848959-8tmmp', 'IP address': '10.177.24.138'}, 'epoch': 38, 'iter': 0, 'avg': 10, 'exp_dir': PosixPath('pruned_transducer_stateless2/exp'), 'bpe_model': 'data/lang_bpe_500/bpe.model', 'decoding_method': 'fast_beam_search', 'beam_size': 4, 'beam': 4, 'max_contexts': 4, 'max_states': 8, 'context_size': 2, 'max_sym_per_frame': 1, 'full_libri': True, 'manifest_dir': PosixPath('data/fbank'), 'max_duration': 600, 'bucketing_sampler': True, 'num_buckets': 30, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'res_dir': PosixPath('pruned_transducer_stateless2/exp/fast_beam_search'), 'suffix': 'epoch-38-avg-10-beam-4-max-contexts-4-max-states-8', 'blank_id': 0, 'unk_id': 2, 'vocab_size': 500}
4
+ 2022-04-29 14:32:02,894 INFO [decode.py:493] About to create model
5
+ 2022-04-29 14:32:03,285 INFO [decode.py:521] averaging ['pruned_transducer_stateless2/exp/epoch-29.pt', 'pruned_transducer_stateless2/exp/epoch-30.pt', 'pruned_transducer_stateless2/exp/epoch-31.pt', 'pruned_transducer_stateless2/exp/epoch-32.pt', 'pruned_transducer_stateless2/exp/epoch-33.pt', 'pruned_transducer_stateless2/exp/epoch-34.pt', 'pruned_transducer_stateless2/exp/epoch-35.pt', 'pruned_transducer_stateless2/exp/epoch-36.pt', 'pruned_transducer_stateless2/exp/epoch-37.pt', 'pruned_transducer_stateless2/exp/epoch-38.pt']
6
+ 2022-04-29 14:32:14,284 INFO [decode.py:535] Number of model parameters: 78648040
7
+ 2022-04-29 14:32:14,284 INFO [asr_datamodule.py:422] About to get test-clean cuts
8
+ 2022-04-29 14:32:14,382 INFO [asr_datamodule.py:427] About to get test-other cuts
9
+ 2022-04-29 14:32:15,765 INFO [decode.py:389] batch 0/?, cuts processed until now is 123
10
+ 2022-04-29 14:32:17,276 INFO [decode.py:389] batch 2/?, cuts processed until now is 389
11
+ 2022-04-29 14:32:19,229 INFO [decode.py:389] batch 4/?, cuts processed until now is 500
12
+ 2022-04-29 14:32:20,530 INFO [decode.py:389] batch 6/?, cuts processed until now is 635
13
+ 2022-04-29 14:32:22,689 INFO [decode.py:389] batch 8/?, cuts processed until now is 723
14
+ 2022-04-29 14:32:24,234 INFO [decode.py:389] batch 10/?, cuts processed until now is 945
15
+ 2022-04-29 14:32:27,814 INFO [decode.py:389] batch 12/?, cuts processed until now is 983
16
+ 2022-04-29 14:32:30,105 INFO [decode.py:389] batch 14/?, cuts processed until now is 1086
17
+ 2022-04-29 14:32:31,575 INFO [decode.py:389] batch 16/?, cuts processed until now is 1184
18
+ 2022-04-29 14:32:33,287 INFO [decode.py:389] batch 18/?, cuts processed until now is 1364
19
+ 2022-04-29 14:32:34,827 INFO [decode.py:389] batch 20/?, cuts processed until now is 1558
20
+ 2022-04-29 14:32:36,096 INFO [decode.py:389] batch 22/?, cuts processed until now is 1783
21
+ 2022-04-29 14:32:38,380 INFO [decode.py:389] batch 24/?, cuts processed until now is 1872
22
+ 2022-04-29 14:32:39,712 INFO [decode.py:389] batch 26/?, cuts processed until now is 1985
23
+ 2022-04-29 14:32:40,558 INFO [decode.py:389] batch 28/?, cuts processed until now is 2247
24
+ 2022-04-29 14:32:42,265 INFO [decode.py:389] batch 30/?, cuts processed until now is 2383
25
+ 2022-04-29 14:32:44,384 INFO [decode.py:389] batch 32/?, cuts processed until now is 2448
26
+ 2022-04-29 14:32:46,866 INFO [decode.py:389] batch 34/?, cuts processed until now is 2515
27
+ 2022-04-29 14:32:48,245 INFO [decode.py:389] batch 36/?, cuts processed until now is 2558
28
+ 2022-04-29 14:32:49,881 INFO [decode.py:389] batch 38/?, cuts processed until now is 2620
29
+ 2022-04-29 14:32:50,014 INFO [decode.py:406] The transcripts are stored in pruned_transducer_stateless2/exp/fast_beam_search/recogs-test-clean-beam_4_max_contexts_4_max_states_8-epoch-38-avg-10-beam-4-max-contexts-4-max-states-8.txt
30
+ 2022-04-29 14:32:50,080 INFO [utils.py:405] [test-clean-beam_4_max_contexts_4_max_states_8] %WER 2.57% [1351 / 52576, 145 ins, 102 del, 1104 sub ]
31
+ 2022-04-29 14:32:50,246 INFO [decode.py:419] Wrote detailed error stats to pruned_transducer_stateless2/exp/fast_beam_search/errs-test-clean-beam_4_max_contexts_4_max_states_8-epoch-38-avg-10-beam-4-max-contexts-4-max-states-8.txt
32
+ 2022-04-29 14:32:50,247 INFO [decode.py:436]
33
+ For test-clean, WER of different settings are:
34
+ beam_4_max_contexts_4_max_states_8 2.57 best for test-clean
35
+
36
+ 2022-04-29 14:32:51,408 INFO [decode.py:389] batch 0/?, cuts processed until now is 138
37
+ 2022-04-29 14:32:52,902 INFO [decode.py:389] batch 2/?, cuts processed until now is 425
38
+ 2022-04-29 14:32:54,765 INFO [decode.py:389] batch 4/?, cuts processed until now is 551
39
+ 2022-04-29 14:32:56,050 INFO [decode.py:389] batch 6/?, cuts processed until now is 719
40
+ 2022-04-29 14:32:58,021 INFO [decode.py:389] batch 8/?, cuts processed until now is 824
41
+ 2022-04-29 14:32:59,496 INFO [decode.py:389] batch 10/?, cuts processed until now is 1070
42
+ 2022-04-29 14:33:02,941 INFO [decode.py:389] batch 12/?, cuts processed until now is 1112
43
+ 2022-04-29 14:33:05,121 INFO [decode.py:389] batch 14/?, cuts processed until now is 1230
44
+ 2022-04-29 14:33:06,471 INFO [decode.py:389] batch 16/?, cuts processed until now is 1341
45
+ 2022-04-29 14:33:08,128 INFO [decode.py:389] batch 18/?, cuts processed until now is 1547
46
+ 2022-04-29 14:33:09,654 INFO [decode.py:389] batch 20/?, cuts processed until now is 1765
47
+ 2022-04-29 14:33:10,980 INFO [decode.py:389] batch 22/?, cuts processed until now is 2131
48
+ 2022-04-29 14:33:12,984 INFO [decode.py:389] batch 24/?, cuts processed until now is 2288
49
+ 2022-04-29 14:33:14,240 INFO [decode.py:389] batch 26/?, cuts processed until now is 2413
50
+ 2022-04-29 14:33:15,403 INFO [decode.py:389] batch 28/?, cuts processed until now is 2533
51
+ 2022-04-29 14:33:16,703 INFO [decode.py:389] batch 30/?, cuts processed until now is 2653
52
+ 2022-04-29 14:33:18,771 INFO [decode.py:389] batch 32/?, cuts processed until now is 2763
53
+ 2022-04-29 14:33:20,325 INFO [decode.py:389] batch 34/?, cuts processed until now is 2813
54
+ 2022-04-29 14:33:21,632 INFO [decode.py:389] batch 36/?, cuts processed until now is 2860
55
+ 2022-04-29 14:33:23,672 INFO [decode.py:389] batch 38/?, cuts processed until now is 2939
56
+ 2022-04-29 14:33:23,812 INFO [decode.py:406] The transcripts are stored in pruned_transducer_stateless2/exp/fast_beam_search/recogs-test-other-beam_4_max_contexts_4_max_states_8-epoch-38-avg-10-beam-4-max-contexts-4-max-states-8.txt
57
+ 2022-04-29 14:33:23,891 INFO [utils.py:405] [test-other-beam_4_max_contexts_4_max_states_8] %WER 5.95% [3113 / 52343, 308 ins, 302 del, 2503 sub ]
58
+ 2022-04-29 14:33:24,058 INFO [decode.py:419] Wrote detailed error stats to pruned_transducer_stateless2/exp/fast_beam_search/errs-test-other-beam_4_max_contexts_4_max_states_8-epoch-38-avg-10-beam-4-max-contexts-4-max-states-8.txt
59
+ 2022-04-29 14:33:24,059 INFO [decode.py:436]
60
+ For test-other, WER of different settings are:
61
+ beam_4_max_contexts_4_max_states_8 5.95 best for test-other
62
+
63
+ 2022-04-29 14:33:24,059 INFO [decode.py:563] Done!
decoding_results/fast_beam_search/recogs-test-clean-beam_4_max_contexts_4_max_states_8-epoch-25-avg-8-beam-4-max-contexts-4-max-states-8.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/fast_beam_search/recogs-test-clean-beam_4_max_contexts_4_max_states_8-epoch-34-avg-10-beam-4-max-contexts-4-max-states-8.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/fast_beam_search/recogs-test-clean-beam_4_max_contexts_4_max_states_8-epoch-38-avg-10-beam-4-max-contexts-4-max-states-8.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/fast_beam_search/recogs-test-other-beam_4_max_contexts_4_max_states_8-epoch-25-avg-8-beam-4-max-contexts-4-max-states-8.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/fast_beam_search/recogs-test-other-beam_4_max_contexts_4_max_states_8-epoch-34-avg-10-beam-4-max-contexts-4-max-states-8.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/fast_beam_search/recogs-test-other-beam_4_max_contexts_4_max_states_8-epoch-38-avg-10-beam-4-max-contexts-4-max-states-8.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/fast_beam_search/wer-summary-test-clean-beam_4_max_contexts_4_max_states_8-epoch-25-avg-8-beam-4-max-contexts-4-max-states-8.txt ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ settings WER
2
+ beam_4_max_contexts_4_max_states_8 2.61
decoding_results/fast_beam_search/wer-summary-test-clean-beam_4_max_contexts_4_max_states_8-epoch-34-avg-10-beam-4-max-contexts-4-max-states-8.txt ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ settings WER
2
+ beam_4_max_contexts_4_max_states_8 2.66
decoding_results/fast_beam_search/wer-summary-test-clean-beam_4_max_contexts_4_max_states_8-epoch-38-avg-10-beam-4-max-contexts-4-max-states-8.txt ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ settings WER
2
+ beam_4_max_contexts_4_max_states_8 2.57
decoding_results/fast_beam_search/wer-summary-test-other-beam_4_max_contexts_4_max_states_8-epoch-25-avg-8-beam-4-max-contexts-4-max-states-8.txt ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ settings WER
2
+ beam_4_max_contexts_4_max_states_8 6.17
decoding_results/fast_beam_search/wer-summary-test-other-beam_4_max_contexts_4_max_states_8-epoch-34-avg-10-beam-4-max-contexts-4-max-states-8.txt ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ settings WER
2
+ beam_4_max_contexts_4_max_states_8 6.0
decoding_results/fast_beam_search/wer-summary-test-other-beam_4_max_contexts_4_max_states_8-epoch-38-avg-10-beam-4-max-contexts-4-max-states-8.txt ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ settings WER
2
+ beam_4_max_contexts_4_max_states_8 5.95
decoding_results/greedy_search/errs-test-clean-greedy_search-epoch-25-avg-8-context-2-max-sym-per-frame-1.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/greedy_search/errs-test-clean-greedy_search-epoch-34-avg-10-context-2-max-sym-per-frame-1.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/greedy_search/errs-test-clean-greedy_search-epoch-38-avg-10-context-2-max-sym-per-frame-1.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/greedy_search/errs-test-other-greedy_search-epoch-25-avg-8-context-2-max-sym-per-frame-1.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/greedy_search/errs-test-other-greedy_search-epoch-34-avg-10-context-2-max-sym-per-frame-1.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/greedy_search/errs-test-other-greedy_search-epoch-38-avg-10-context-2-max-sym-per-frame-1.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/greedy_search/log-decode-epoch-25-avg-8-context-2-max-sym-per-frame-1-2022-04-29-14-22-17 ADDED
@@ -0,0 +1,25 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2022-04-29 14:22:17,547 INFO [decode.py:475] Decoding started
2
+ 2022-04-29 14:22:17,548 INFO [decode.py:481] Device: cuda:0
3
+ 2022-04-29 14:22:17,550 INFO [decode.py:491] {'best_train_loss': inf, 'best_valid_loss': inf, 'best_train_epoch': -1, 'best_valid_epoch': -1, 'batch_idx_train': 0, 'log_interval': 50, 'reset_interval': 200, 'valid_interval': 3000, 'feature_dim': 80, 'subsampling_factor': 4, 'encoder_dim': 512, 'nhead': 8, 'dim_feedforward': 2048, 'num_encoder_layers': 12, 'decoder_dim': 512, 'joiner_dim': 512, 'model_warm_step': 3000, 'env_info': {'k2-version': '1.15.1', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': 'f8d2dba06c000ffee36aab5b66f24e7c9809f116', 'k2-git-date': 'Thu Apr 21 12:20:34 2022', 'lhotse-version': '1.1.0.dev+missing.version.file', 'torch-version': '1.10.0+cu102', 'torch-cuda-available': True, 'torch-cuda-version': '10.2', 'python-version': '3.8', 'icefall-git-branch': 'modified-conformer-with-multi-datasets', 'icefall-git-sha1': 'fb61e31-dirty', 'icefall-git-date': 'Fri Apr 29 14:15:19 2022', 'icefall-path': '/ceph-fj/fangjun/open-source-2/icefall-multi-4', 'k2-path': '/ceph-fj/fangjun/open-source-2/k2-multi-22/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-fj/fangjun/open-source-2/lhotse-multi-3/lhotse/__init__.py', 'hostname': 'de-74279-k2-train-3-0307202051-57dc848959-8tmmp', 'IP address': '10.177.24.138'}, 'epoch': 25, 'iter': 0, 'avg': 8, 'exp_dir': PosixPath('pruned_transducer_stateless2/exp'), 'bpe_model': 'data/lang_bpe_500/bpe.model', 'decoding_method': 'greedy_search', 'beam_size': 4, 'beam': 4, 'max_contexts': 4, 'max_states': 8, 'context_size': 2, 'max_sym_per_frame': 1, 'full_libri': True, 'manifest_dir': PosixPath('data/fbank'), 'max_duration': 600, 'bucketing_sampler': True, 'num_buckets': 30, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'res_dir': PosixPath('pruned_transducer_stateless2/exp/greedy_search'), 'suffix': 'epoch-25-avg-8-context-2-max-sym-per-frame-1', 'blank_id': 0, 'unk_id': 2, 'vocab_size': 500}
4
+ 2022-04-29 14:22:17,550 INFO [decode.py:493] About to create model
5
+ 2022-04-29 14:22:17,953 INFO [decode.py:521] averaging ['pruned_transducer_stateless2/exp/epoch-18.pt', 'pruned_transducer_stateless2/exp/epoch-19.pt', 'pruned_transducer_stateless2/exp/epoch-20.pt', 'pruned_transducer_stateless2/exp/epoch-21.pt', 'pruned_transducer_stateless2/exp/epoch-22.pt', 'pruned_transducer_stateless2/exp/epoch-23.pt', 'pruned_transducer_stateless2/exp/epoch-24.pt', 'pruned_transducer_stateless2/exp/epoch-25.pt']
6
+ 2022-04-29 14:23:05,691 INFO [decode.py:535] Number of model parameters: 78648040
7
+ 2022-04-29 14:23:05,691 INFO [asr_datamodule.py:422] About to get test-clean cuts
8
+ 2022-04-29 14:23:05,794 INFO [asr_datamodule.py:427] About to get test-other cuts
9
+ 2022-04-29 14:23:06,710 INFO [decode.py:389] batch 0/?, cuts processed until now is 123
10
+ 2022-04-29 14:23:22,439 INFO [decode.py:406] The transcripts are stored in pruned_transducer_stateless2/exp/greedy_search/recogs-test-clean-greedy_search-epoch-25-avg-8-context-2-max-sym-per-frame-1.txt
11
+ 2022-04-29 14:23:22,504 INFO [utils.py:405] [test-clean-greedy_search] %WER 2.65% [1391 / 52576, 142 ins, 129 del, 1120 sub ]
12
+ 2022-04-29 14:23:22,667 INFO [decode.py:419] Wrote detailed error stats to pruned_transducer_stateless2/exp/greedy_search/errs-test-clean-greedy_search-epoch-25-avg-8-context-2-max-sym-per-frame-1.txt
13
+ 2022-04-29 14:23:22,667 INFO [decode.py:436]
14
+ For test-clean, WER of different settings are:
15
+ greedy_search 2.65 best for test-clean
16
+
17
+ 2022-04-29 14:23:23,432 INFO [decode.py:389] batch 0/?, cuts processed until now is 138
18
+ 2022-04-29 14:23:38,226 INFO [decode.py:406] The transcripts are stored in pruned_transducer_stateless2/exp/greedy_search/recogs-test-other-greedy_search-epoch-25-avg-8-context-2-max-sym-per-frame-1.txt
19
+ 2022-04-29 14:23:38,394 INFO [utils.py:405] [test-other-greedy_search] %WER 6.30% [3300 / 52343, 328 ins, 322 del, 2650 sub ]
20
+ 2022-04-29 14:23:38,563 INFO [decode.py:419] Wrote detailed error stats to pruned_transducer_stateless2/exp/greedy_search/errs-test-other-greedy_search-epoch-25-avg-8-context-2-max-sym-per-frame-1.txt
21
+ 2022-04-29 14:23:38,563 INFO [decode.py:436]
22
+ For test-other, WER of different settings are:
23
+ greedy_search 6.3 best for test-other
24
+
25
+ 2022-04-29 14:23:38,563 INFO [decode.py:563] Done!
decoding_results/greedy_search/log-decode-epoch-34-avg-10-context-2-max-sym-per-frame-1-2022-04-29-14-30-13 ADDED
@@ -0,0 +1,25 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2022-04-29 14:30:13,461 INFO [decode.py:475] Decoding started
2
+ 2022-04-29 14:30:13,461 INFO [decode.py:481] Device: cuda:0
3
+ 2022-04-29 14:30:13,464 INFO [decode.py:491] {'best_train_loss': inf, 'best_valid_loss': inf, 'best_train_epoch': -1, 'best_valid_epoch': -1, 'batch_idx_train': 0, 'log_interval': 50, 'reset_interval': 200, 'valid_interval': 3000, 'feature_dim': 80, 'subsampling_factor': 4, 'encoder_dim': 512, 'nhead': 8, 'dim_feedforward': 2048, 'num_encoder_layers': 12, 'decoder_dim': 512, 'joiner_dim': 512, 'model_warm_step': 3000, 'env_info': {'k2-version': '1.15.1', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': 'f8d2dba06c000ffee36aab5b66f24e7c9809f116', 'k2-git-date': 'Thu Apr 21 12:20:34 2022', 'lhotse-version': '1.1.0.dev+missing.version.file', 'torch-version': '1.10.0+cu102', 'torch-cuda-available': True, 'torch-cuda-version': '10.2', 'python-version': '3.8', 'icefall-git-branch': 'modified-conformer-with-multi-datasets', 'icefall-git-sha1': 'fb61e31-dirty', 'icefall-git-date': 'Fri Apr 29 14:15:19 2022', 'icefall-path': '/ceph-fj/fangjun/open-source-2/icefall-multi-4', 'k2-path': '/ceph-fj/fangjun/open-source-2/k2-multi-22/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-fj/fangjun/open-source-2/lhotse-multi-3/lhotse/__init__.py', 'hostname': 'de-74279-k2-train-3-0307202051-57dc848959-8tmmp', 'IP address': '10.177.24.138'}, 'epoch': 34, 'iter': 0, 'avg': 10, 'exp_dir': PosixPath('pruned_transducer_stateless2/exp'), 'bpe_model': 'data/lang_bpe_500/bpe.model', 'decoding_method': 'greedy_search', 'beam_size': 4, 'beam': 4, 'max_contexts': 4, 'max_states': 8, 'context_size': 2, 'max_sym_per_frame': 1, 'full_libri': True, 'manifest_dir': PosixPath('data/fbank'), 'max_duration': 600, 'bucketing_sampler': True, 'num_buckets': 30, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'res_dir': PosixPath('pruned_transducer_stateless2/exp/greedy_search'), 'suffix': 'epoch-34-avg-10-context-2-max-sym-per-frame-1', 'blank_id': 0, 'unk_id': 2, 'vocab_size': 500}
4
+ 2022-04-29 14:30:13,464 INFO [decode.py:493] About to create model
5
+ 2022-04-29 14:30:13,852 INFO [decode.py:521] averaging ['pruned_transducer_stateless2/exp/epoch-25.pt', 'pruned_transducer_stateless2/exp/epoch-26.pt', 'pruned_transducer_stateless2/exp/epoch-27.pt', 'pruned_transducer_stateless2/exp/epoch-28.pt', 'pruned_transducer_stateless2/exp/epoch-29.pt', 'pruned_transducer_stateless2/exp/epoch-30.pt', 'pruned_transducer_stateless2/exp/epoch-31.pt', 'pruned_transducer_stateless2/exp/epoch-32.pt', 'pruned_transducer_stateless2/exp/epoch-33.pt', 'pruned_transducer_stateless2/exp/epoch-34.pt']
6
+ 2022-04-29 14:30:24,814 INFO [decode.py:535] Number of model parameters: 78648040
7
+ 2022-04-29 14:30:24,814 INFO [asr_datamodule.py:422] About to get test-clean cuts
8
+ 2022-04-29 14:30:24,915 INFO [asr_datamodule.py:427] About to get test-other cuts
9
+ 2022-04-29 14:30:25,894 INFO [decode.py:389] batch 0/?, cuts processed until now is 123
10
+ 2022-04-29 14:30:41,584 INFO [decode.py:406] The transcripts are stored in pruned_transducer_stateless2/exp/greedy_search/recogs-test-clean-greedy_search-epoch-34-avg-10-context-2-max-sym-per-frame-1.txt
11
+ 2022-04-29 14:30:41,651 INFO [utils.py:405] [test-clean-greedy_search] %WER 2.69% [1416 / 52576, 145 ins, 123 del, 1148 sub ]
12
+ 2022-04-29 14:30:41,817 INFO [decode.py:419] Wrote detailed error stats to pruned_transducer_stateless2/exp/greedy_search/errs-test-clean-greedy_search-epoch-34-avg-10-context-2-max-sym-per-frame-1.txt
13
+ 2022-04-29 14:30:41,818 INFO [decode.py:436]
14
+ For test-clean, WER of different settings are:
15
+ greedy_search 2.69 best for test-clean
16
+
17
+ 2022-04-29 14:30:42,600 INFO [decode.py:389] batch 0/?, cuts processed until now is 138
18
+ 2022-04-29 14:30:57,425 INFO [decode.py:406] The transcripts are stored in pruned_transducer_stateless2/exp/greedy_search/recogs-test-other-greedy_search-epoch-34-avg-10-context-2-max-sym-per-frame-1.txt
19
+ 2022-04-29 14:30:57,495 INFO [utils.py:405] [test-other-greedy_search] %WER 6.04% [3163 / 52343, 315 ins, 331 del, 2517 sub ]
20
+ 2022-04-29 14:30:57,664 INFO [decode.py:419] Wrote detailed error stats to pruned_transducer_stateless2/exp/greedy_search/errs-test-other-greedy_search-epoch-34-avg-10-context-2-max-sym-per-frame-1.txt
21
+ 2022-04-29 14:30:57,665 INFO [decode.py:436]
22
+ For test-other, WER of different settings are:
23
+ greedy_search 6.04 best for test-other
24
+
25
+ 2022-04-29 14:30:57,665 INFO [decode.py:563] Done!
decoding_results/greedy_search/log-decode-epoch-38-avg-10-context-2-max-sym-per-frame-1-2022-04-29-14-31-08 ADDED
@@ -0,0 +1,25 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2022-04-29 14:31:08,183 INFO [decode.py:475] Decoding started
2
+ 2022-04-29 14:31:08,183 INFO [decode.py:481] Device: cuda:0
3
+ 2022-04-29 14:31:08,185 INFO [decode.py:491] {'best_train_loss': inf, 'best_valid_loss': inf, 'best_train_epoch': -1, 'best_valid_epoch': -1, 'batch_idx_train': 0, 'log_interval': 50, 'reset_interval': 200, 'valid_interval': 3000, 'feature_dim': 80, 'subsampling_factor': 4, 'encoder_dim': 512, 'nhead': 8, 'dim_feedforward': 2048, 'num_encoder_layers': 12, 'decoder_dim': 512, 'joiner_dim': 512, 'model_warm_step': 3000, 'env_info': {'k2-version': '1.15.1', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': 'f8d2dba06c000ffee36aab5b66f24e7c9809f116', 'k2-git-date': 'Thu Apr 21 12:20:34 2022', 'lhotse-version': '1.1.0.dev+missing.version.file', 'torch-version': '1.10.0+cu102', 'torch-cuda-available': True, 'torch-cuda-version': '10.2', 'python-version': '3.8', 'icefall-git-branch': 'modified-conformer-with-multi-datasets', 'icefall-git-sha1': 'fb61e31-dirty', 'icefall-git-date': 'Fri Apr 29 14:15:19 2022', 'icefall-path': '/ceph-fj/fangjun/open-source-2/icefall-multi-4', 'k2-path': '/ceph-fj/fangjun/open-source-2/k2-multi-22/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-fj/fangjun/open-source-2/lhotse-multi-3/lhotse/__init__.py', 'hostname': 'de-74279-k2-train-3-0307202051-57dc848959-8tmmp', 'IP address': '10.177.24.138'}, 'epoch': 38, 'iter': 0, 'avg': 10, 'exp_dir': PosixPath('pruned_transducer_stateless2/exp'), 'bpe_model': 'data/lang_bpe_500/bpe.model', 'decoding_method': 'greedy_search', 'beam_size': 4, 'beam': 4, 'max_contexts': 4, 'max_states': 8, 'context_size': 2, 'max_sym_per_frame': 1, 'full_libri': True, 'manifest_dir': PosixPath('data/fbank'), 'max_duration': 600, 'bucketing_sampler': True, 'num_buckets': 30, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'res_dir': PosixPath('pruned_transducer_stateless2/exp/greedy_search'), 'suffix': 'epoch-38-avg-10-context-2-max-sym-per-frame-1', 'blank_id': 0, 'unk_id': 2, 'vocab_size': 500}
4
+ 2022-04-29 14:31:08,185 INFO [decode.py:493] About to create model
5
+ 2022-04-29 14:31:08,588 INFO [decode.py:521] averaging ['pruned_transducer_stateless2/exp/epoch-29.pt', 'pruned_transducer_stateless2/exp/epoch-30.pt', 'pruned_transducer_stateless2/exp/epoch-31.pt', 'pruned_transducer_stateless2/exp/epoch-32.pt', 'pruned_transducer_stateless2/exp/epoch-33.pt', 'pruned_transducer_stateless2/exp/epoch-34.pt', 'pruned_transducer_stateless2/exp/epoch-35.pt', 'pruned_transducer_stateless2/exp/epoch-36.pt', 'pruned_transducer_stateless2/exp/epoch-37.pt', 'pruned_transducer_stateless2/exp/epoch-38.pt']
6
+ 2022-04-29 14:31:19,251 INFO [decode.py:535] Number of model parameters: 78648040
7
+ 2022-04-29 14:31:19,251 INFO [asr_datamodule.py:422] About to get test-clean cuts
8
+ 2022-04-29 14:31:19,353 INFO [asr_datamodule.py:427] About to get test-other cuts
9
+ 2022-04-29 14:31:20,322 INFO [decode.py:389] batch 0/?, cuts processed until now is 123
10
+ 2022-04-29 14:31:35,970 INFO [decode.py:406] The transcripts are stored in pruned_transducer_stateless2/exp/greedy_search/recogs-test-clean-greedy_search-epoch-38-avg-10-context-2-max-sym-per-frame-1.txt
11
+ 2022-04-29 14:31:36,036 INFO [utils.py:405] [test-clean-greedy_search] %WER 2.62% [1379 / 52576, 141 ins, 116 del, 1122 sub ]
12
+ 2022-04-29 14:31:36,203 INFO [decode.py:419] Wrote detailed error stats to pruned_transducer_stateless2/exp/greedy_search/errs-test-clean-greedy_search-epoch-38-avg-10-context-2-max-sym-per-frame-1.txt
13
+ 2022-04-29 14:31:36,204 INFO [decode.py:436]
14
+ For test-clean, WER of different settings are:
15
+ greedy_search 2.62 best for test-clean
16
+
17
+ 2022-04-29 14:31:36,980 INFO [decode.py:389] batch 0/?, cuts processed until now is 138
18
+ 2022-04-29 14:31:51,855 INFO [decode.py:406] The transcripts are stored in pruned_transducer_stateless2/exp/greedy_search/recogs-test-other-greedy_search-epoch-38-avg-10-context-2-max-sym-per-frame-1.txt
19
+ 2022-04-29 14:31:51,923 INFO [utils.py:405] [test-other-greedy_search] %WER 6.02% [3153 / 52343, 309 ins, 320 del, 2524 sub ]
20
+ 2022-04-29 14:31:52,091 INFO [decode.py:419] Wrote detailed error stats to pruned_transducer_stateless2/exp/greedy_search/errs-test-other-greedy_search-epoch-38-avg-10-context-2-max-sym-per-frame-1.txt
21
+ 2022-04-29 14:31:52,092 INFO [decode.py:436]
22
+ For test-other, WER of different settings are:
23
+ greedy_search 6.02 best for test-other
24
+
25
+ 2022-04-29 14:31:52,092 INFO [decode.py:563] Done!
decoding_results/greedy_search/recogs-test-clean-greedy_search-epoch-25-avg-8-context-2-max-sym-per-frame-1.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/greedy_search/recogs-test-clean-greedy_search-epoch-34-avg-10-context-2-max-sym-per-frame-1.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/greedy_search/recogs-test-clean-greedy_search-epoch-38-avg-10-context-2-max-sym-per-frame-1.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/greedy_search/recogs-test-other-greedy_search-epoch-25-avg-8-context-2-max-sym-per-frame-1.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/greedy_search/recogs-test-other-greedy_search-epoch-34-avg-10-context-2-max-sym-per-frame-1.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/greedy_search/recogs-test-other-greedy_search-epoch-38-avg-10-context-2-max-sym-per-frame-1.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/greedy_search/wer-summary-test-clean-greedy_search-epoch-25-avg-8-context-2-max-sym-per-frame-1.txt ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ settings WER
2
+ greedy_search 2.65
decoding_results/greedy_search/wer-summary-test-clean-greedy_search-epoch-34-avg-10-context-2-max-sym-per-frame-1.txt ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ settings WER
2
+ greedy_search 2.69
decoding_results/greedy_search/wer-summary-test-clean-greedy_search-epoch-38-avg-10-context-2-max-sym-per-frame-1.txt ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ settings WER
2
+ greedy_search 2.62
decoding_results/greedy_search/wer-summary-test-other-greedy_search-epoch-25-avg-8-context-2-max-sym-per-frame-1.txt ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ settings WER
2
+ greedy_search 6.3
decoding_results/greedy_search/wer-summary-test-other-greedy_search-epoch-34-avg-10-context-2-max-sym-per-frame-1.txt ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ settings WER
2
+ greedy_search 6.04
decoding_results/greedy_search/wer-summary-test-other-greedy_search-epoch-38-avg-10-context-2-max-sym-per-frame-1.txt ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ settings WER
2
+ greedy_search 6.02
decoding_results/modified_beam_search/errs-test-clean-beam_size_4-epoch-25-avg-8-modified_beam_search-beam-size-4.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/modified_beam_search/errs-test-other-beam_size_4-epoch-25-avg-8-modified_beam_search-beam-size-4.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/modified_beam_search/log-decode-epoch-25-avg-8-modified_beam_search-beam-size-4-2022-04-29-14-26-00 ADDED
@@ -0,0 +1,63 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2022-04-29 14:26:00,747 INFO [decode.py:475] Decoding started
2
+ 2022-04-29 14:26:00,747 INFO [decode.py:481] Device: cuda:0
3
+ 2022-04-29 14:26:00,749 INFO [decode.py:491] {'best_train_loss': inf, 'best_valid_loss': inf, 'best_train_epoch': -1, 'best_valid_epoch': -1, 'batch_idx_train': 0, 'log_interval': 50, 'reset_interval': 200, 'valid_interval': 3000, 'feature_dim': 80, 'subsampling_factor': 4, 'encoder_dim': 512, 'nhead': 8, 'dim_feedforward': 2048, 'num_encoder_layers': 12, 'decoder_dim': 512, 'joiner_dim': 512, 'model_warm_step': 3000, 'env_info': {'k2-version': '1.15.1', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': 'f8d2dba06c000ffee36aab5b66f24e7c9809f116', 'k2-git-date': 'Thu Apr 21 12:20:34 2022', 'lhotse-version': '1.1.0.dev+missing.version.file', 'torch-version': '1.10.0+cu102', 'torch-cuda-available': True, 'torch-cuda-version': '10.2', 'python-version': '3.8', 'icefall-git-branch': 'modified-conformer-with-multi-datasets', 'icefall-git-sha1': 'fb61e31-dirty', 'icefall-git-date': 'Fri Apr 29 14:15:19 2022', 'icefall-path': '/ceph-fj/fangjun/open-source-2/icefall-multi-4', 'k2-path': '/ceph-fj/fangjun/open-source-2/k2-multi-22/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-fj/fangjun/open-source-2/lhotse-multi-3/lhotse/__init__.py', 'hostname': 'de-74279-k2-train-3-0307202051-57dc848959-8tmmp', 'IP address': '10.177.24.138'}, 'epoch': 25, 'iter': 0, 'avg': 8, 'exp_dir': PosixPath('pruned_transducer_stateless2/exp'), 'bpe_model': 'data/lang_bpe_500/bpe.model', 'decoding_method': 'modified_beam_search', 'beam_size': 4, 'beam': 4, 'max_contexts': 4, 'max_states': 8, 'context_size': 2, 'max_sym_per_frame': 1, 'full_libri': True, 'manifest_dir': PosixPath('data/fbank'), 'max_duration': 600, 'bucketing_sampler': True, 'num_buckets': 30, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'res_dir': PosixPath('pruned_transducer_stateless2/exp/modified_beam_search'), 'suffix': 'epoch-25-avg-8-modified_beam_search-beam-size-4', 'blank_id': 0, 'unk_id': 2, 'vocab_size': 500}
4
+ 2022-04-29 14:26:00,749 INFO [decode.py:493] About to create model
5
+ 2022-04-29 14:26:01,164 INFO [decode.py:521] averaging ['pruned_transducer_stateless2/exp/epoch-18.pt', 'pruned_transducer_stateless2/exp/epoch-19.pt', 'pruned_transducer_stateless2/exp/epoch-20.pt', 'pruned_transducer_stateless2/exp/epoch-21.pt', 'pruned_transducer_stateless2/exp/epoch-22.pt', 'pruned_transducer_stateless2/exp/epoch-23.pt', 'pruned_transducer_stateless2/exp/epoch-24.pt', 'pruned_transducer_stateless2/exp/epoch-25.pt']
6
+ 2022-04-29 14:26:10,628 INFO [decode.py:535] Number of model parameters: 78648040
7
+ 2022-04-29 14:26:10,628 INFO [asr_datamodule.py:422] About to get test-clean cuts
8
+ 2022-04-29 14:26:10,732 INFO [asr_datamodule.py:427] About to get test-other cuts
9
+ 2022-04-29 14:26:14,668 INFO [decode.py:389] batch 0/?, cuts processed until now is 123
10
+ 2022-04-29 14:26:20,906 INFO [decode.py:389] batch 2/?, cuts processed until now is 389
11
+ 2022-04-29 14:26:27,642 INFO [decode.py:389] batch 4/?, cuts processed until now is 500
12
+ 2022-04-29 14:26:32,207 INFO [decode.py:389] batch 6/?, cuts processed until now is 635
13
+ 2022-04-29 14:26:39,163 INFO [decode.py:389] batch 8/?, cuts processed until now is 723
14
+ 2022-04-29 14:26:45,484 INFO [decode.py:389] batch 10/?, cuts processed until now is 945
15
+ 2022-04-29 14:26:53,861 INFO [decode.py:389] batch 12/?, cuts processed until now is 983
16
+ 2022-04-29 14:27:00,891 INFO [decode.py:389] batch 14/?, cuts processed until now is 1086
17
+ 2022-04-29 14:27:05,704 INFO [decode.py:389] batch 16/?, cuts processed until now is 1184
18
+ 2022-04-29 14:27:12,061 INFO [decode.py:389] batch 18/?, cuts processed until now is 1364
19
+ 2022-04-29 14:27:18,267 INFO [decode.py:389] batch 20/?, cuts processed until now is 1558
20
+ 2022-04-29 14:27:23,583 INFO [decode.py:389] batch 22/?, cuts processed until now is 1783
21
+ 2022-04-29 14:27:30,646 INFO [decode.py:389] batch 24/?, cuts processed until now is 1872
22
+ 2022-04-29 14:27:35,212 INFO [decode.py:389] batch 26/?, cuts processed until now is 1985
23
+ 2022-04-29 14:27:38,749 INFO [decode.py:389] batch 28/?, cuts processed until now is 2247
24
+ 2022-04-29 14:27:44,756 INFO [decode.py:389] batch 30/?, cuts processed until now is 2383
25
+ 2022-04-29 14:27:50,652 INFO [decode.py:389] batch 32/?, cuts processed until now is 2448
26
+ 2022-04-29 14:27:57,728 INFO [decode.py:389] batch 34/?, cuts processed until now is 2515
27
+ 2022-04-29 14:28:01,386 INFO [decode.py:389] batch 36/?, cuts processed until now is 2558
28
+ 2022-04-29 14:28:05,888 INFO [decode.py:389] batch 38/?, cuts processed until now is 2620
29
+ 2022-04-29 14:28:06,024 INFO [decode.py:406] The transcripts are stored in pruned_transducer_stateless2/exp/modified_beam_search/recogs-test-clean-beam_size_4-epoch-25-avg-8-modified_beam_search-beam-size-4.txt
30
+ 2022-04-29 14:28:06,089 INFO [utils.py:405] [test-clean-beam_size_4] %WER 2.58% [1356 / 52576, 145 ins, 115 del, 1096 sub ]
31
+ 2022-04-29 14:28:06,331 INFO [decode.py:419] Wrote detailed error stats to pruned_transducer_stateless2/exp/modified_beam_search/errs-test-clean-beam_size_4-epoch-25-avg-8-modified_beam_search-beam-size-4.txt
32
+ 2022-04-29 14:28:06,332 INFO [decode.py:436]
33
+ For test-clean, WER of different settings are:
34
+ beam_size_4 2.58 best for test-clean
35
+
36
+ 2022-04-29 14:28:09,769 INFO [decode.py:389] batch 0/?, cuts processed until now is 138
37
+ 2022-04-29 14:28:15,748 INFO [decode.py:389] batch 2/?, cuts processed until now is 425
38
+ 2022-04-29 14:28:22,164 INFO [decode.py:389] batch 4/?, cuts processed until now is 551
39
+ 2022-04-29 14:28:26,825 INFO [decode.py:389] batch 6/?, cuts processed until now is 719
40
+ 2022-04-29 14:28:33,270 INFO [decode.py:389] batch 8/?, cuts processed until now is 824
41
+ 2022-04-29 14:28:39,304 INFO [decode.py:389] batch 10/?, cuts processed until now is 1070
42
+ 2022-04-29 14:28:47,309 INFO [decode.py:389] batch 12/?, cuts processed until now is 1112
43
+ 2022-04-29 14:28:53,973 INFO [decode.py:389] batch 14/?, cuts processed until now is 1230
44
+ 2022-04-29 14:28:58,558 INFO [decode.py:389] batch 16/?, cuts processed until now is 1341
45
+ 2022-04-29 14:29:04,806 INFO [decode.py:389] batch 18/?, cuts processed until now is 1547
46
+ 2022-04-29 14:29:10,995 INFO [decode.py:389] batch 20/?, cuts processed until now is 1765
47
+ 2022-04-29 14:29:16,243 INFO [decode.py:389] batch 22/?, cuts processed until now is 2131
48
+ 2022-04-29 14:29:22,831 INFO [decode.py:389] batch 24/?, cuts processed until now is 2288
49
+ 2022-04-29 14:29:27,255 INFO [decode.py:389] batch 26/?, cuts processed until now is 2413
50
+ 2022-04-29 14:29:31,139 INFO [decode.py:389] batch 28/?, cuts processed until now is 2533
51
+ 2022-04-29 14:29:35,058 INFO [decode.py:389] batch 30/?, cuts processed until now is 2653
52
+ 2022-04-29 14:29:41,673 INFO [decode.py:389] batch 32/?, cuts processed until now is 2763
53
+ 2022-04-29 14:29:45,721 INFO [decode.py:389] batch 34/?, cuts processed until now is 2813
54
+ 2022-04-29 14:29:49,318 INFO [decode.py:389] batch 36/?, cuts processed until now is 2860
55
+ 2022-04-29 14:29:55,352 INFO [decode.py:389] batch 38/?, cuts processed until now is 2939
56
+ 2022-04-29 14:29:55,501 INFO [decode.py:406] The transcripts are stored in pruned_transducer_stateless2/exp/modified_beam_search/recogs-test-other-beam_size_4-epoch-25-avg-8-modified_beam_search-beam-size-4.txt
57
+ 2022-04-29 14:29:55,593 INFO [utils.py:405] [test-other-beam_size_4] %WER 6.19% [3242 / 52343, 350 ins, 272 del, 2620 sub ]
58
+ 2022-04-29 14:29:55,762 INFO [decode.py:419] Wrote detailed error stats to pruned_transducer_stateless2/exp/modified_beam_search/errs-test-other-beam_size_4-epoch-25-avg-8-modified_beam_search-beam-size-4.txt
59
+ 2022-04-29 14:29:55,762 INFO [decode.py:436]
60
+ For test-other, WER of different settings are:
61
+ beam_size_4 6.19 best for test-other
62
+
63
+ 2022-04-29 14:29:55,762 INFO [decode.py:563] Done!
decoding_results/modified_beam_search/recogs-test-clean-beam_size_4-epoch-25-avg-8-modified_beam_search-beam-size-4.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/modified_beam_search/recogs-test-other-beam_size_4-epoch-25-avg-8-modified_beam_search-beam-size-4.txt ADDED
The diff for this file is too large to render. See raw diff
 
decoding_results/modified_beam_search/wer-summary-test-clean-beam_size_4-epoch-25-avg-8-modified_beam_search-beam-size-4.txt ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ settings WER
2
+ beam_size_4 2.58
decoding_results/modified_beam_search/wer-summary-test-other-beam_size_4-epoch-25-avg-8-modified_beam_search-beam-size-4.txt ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ settings WER
2
+ beam_size_4 6.19