Hugging Face's logo

csukuangfj
/
icefall-asr-librispeech-transducer-stateless-bpe-500-2022-01-10

Model card Files Community
csukuangfj commited on
Commit
122e4f8
•
1 Parent(s): ec38f0c

Add decoding log.

Browse files
Files changed (10) hide show
  1. log/errs-test-clean-beam_4-epoch-36-avg-13-beam-4.txt +0 -0
  2. log/errs-test-clean-greedy_search-epoch-36-avg-13-context-2-max-sym-per-frame-3.txt +0 -0
  3. log/errs-test-other-beam_4-epoch-36-avg-13-beam-4.txt +0 -0
  4. log/errs-test-other-greedy_search-epoch-36-avg-13-context-2-max-sym-per-frame-3.txt +0 -0
  5. log/log-decode-epoch-36-avg-13-beam-4-2022-01-10-07-00-30 +233 -0
  6. log/log-decode-epoch-36-avg-13-context-2-max-sym-per-frame-3-2022-01-10-03-09-34 +29 -0
  7. log/recogs-test-clean-beam_4-epoch-36-avg-13-beam-4.txt +0 -0
  8. log/recogs-test-clean-greedy_search-epoch-36-avg-13-context-2-max-sym-per-frame-3.txt +0 -0
  9. log/recogs-test-other-beam_4-epoch-36-avg-13-beam-4.txt +0 -0
  10. log/recogs-test-other-greedy_search-epoch-36-avg-13-context-2-max-sym-per-frame-3.txt +0 -0
log/errs-test-clean-beam_4-epoch-36-avg-13-beam-4.txt ADDED
The diff for this file is too large to render. See raw diff
 
log/errs-test-clean-greedy_search-epoch-36-avg-13-context-2-max-sym-per-frame-3.txt ADDED
The diff for this file is too large to render. See raw diff
 
log/errs-test-other-beam_4-epoch-36-avg-13-beam-4.txt ADDED
The diff for this file is too large to render. See raw diff
 
log/errs-test-other-greedy_search-epoch-36-avg-13-context-2-max-sym-per-frame-3.txt ADDED
The diff for this file is too large to render. See raw diff
 
log/log-decode-epoch-36-avg-13-beam-4-2022-01-10-07-00-30 ADDED
@@ -0,0 +1,233 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2022-01-10 07:00:30,011 INFO [decode.py:403] Decoding started
2
+ 2022-01-10 07:00:30,011 INFO [decode.py:409] Device: cuda:0
3
+ 2022-01-10 07:00:30,080 INFO [decode.py:418] {'feature_dim': 80, 'encoder_out_dim': 512, 'subsampling_factor': 4, 'attention_dim': 512, 'nhead': 8, 'dim_feedforward': 2048, 'num_encoder_layers': 12, 'vgg_frontend': False, 'env_info': {'k2-version': '1.10', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': '31e1307c3131d03384ef83c33472309d22d2e79d', 'k2-git-date': 'Fri Nov 19 14:47:09 2021', 'lhotse-version': '1.0.0.dev+missing.version.file', 'torch-cuda-available': True, 'torch-cuda-version': '10.2', 'python-version': '3.8', 'icefall-git-branch': 'rnnt-ot', 'icefall-git-sha1': '2084dba-clean', 'icefall-git-date': 'Sat Jan 8 19:10:49 2022', 'icefall-path': '/ceph-fj/fangjun/open-source-2/icefall-rnnt-ot', 'k2-path': '/ceph-fj/fangjun/open-source-2/k2-rnnt/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-fj/fangjun/open-source-2/lhotse-rnnt/lhotse/__init__.py', 'hostname': 'de-74279-k2-train-4-0809194600-d77fc9b88-4vzzq', 'IP address': '10.48.16.137'}, 'epoch': 36, 'avg': 13, 'exp_dir': PosixPath('transducer_stateless/exp-full'), 'bpe_model': 'data/lang_bpe_500/bpe.model', 'decoding_method': 'beam_search', 'beam_size': 4, 'context_size': 2, 'max_sym_per_frame': 3, 'full_libri': True, 'manifest_dir': PosixPath('data/fbank'), 'max_duration': 100, 'bucketing_sampler': True, 'num_buckets': 30, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'res_dir': PosixPath('transducer_stateless/exp-full/beam_search'), 'suffix': 'epoch-36-avg-13-beam-4', 'blank_id': 0, 'vocab_size': 500}
4
+ 2022-01-10 07:00:30,081 INFO [decode.py:420] About to create model
5
+ 2022-01-10 07:00:30,577 INFO [decode.py:431] averaging ['transducer_stateless/exp-full/epoch-24.pt', 'transducer_stateless/exp-full/epoch-25.pt', 'transducer_stateless/exp-full/epoch-26.pt', 'transducer_stateless/exp-full/epoch-27.pt', 'transducer_stateless/exp-full/epoch-28.pt', 'transducer_stateless/exp-full/epoch-29.pt', 'transducer_stateless/exp-full/epoch-30.pt', 'transducer_stateless/exp-full/epoch-31.pt', 'transducer_stateless/exp-full/epoch-32.pt', 'transducer_stateless/exp-full/epoch-33.pt', 'transducer_stateless/exp-full/epoch-34.pt', 'transducer_stateless/exp-full/epoch-35.pt', 'transducer_stateless/exp-full/epoch-36.pt']
6
+ 2022-01-10 07:00:42,814 INFO [decode.py:440] Number of model parameters: 84007924
7
+ 2022-01-10 07:00:42,814 INFO [asr_datamodule.py:379] About to get test-clean cuts
8
+ 2022-01-10 07:00:42,984 INFO [asr_datamodule.py:384] About to get test-other cuts
9
+ 2022-01-10 07:00:47,875 INFO [decode.py:332] batch 0/?, cuts processed until now is 20
10
+ 2022-01-10 07:00:56,230 INFO [decode.py:332] batch 2/?, cuts processed until now is 64
11
+ 2022-01-10 07:01:04,900 INFO [decode.py:332] batch 4/?, cuts processed until now is 81
12
+ 2022-01-10 07:01:13,377 INFO [decode.py:332] batch 6/?, cuts processed until now is 121
13
+ 2022-01-10 07:01:22,146 INFO [decode.py:332] batch 8/?, cuts processed until now is 133
14
+ 2022-01-10 07:01:30,442 INFO [decode.py:332] batch 10/?, cuts processed until now is 168
15
+ 2022-01-10 07:01:39,056 INFO [decode.py:332] batch 12/?, cuts processed until now is 202
16
+ 2022-01-10 07:01:49,540 INFO [decode.py:332] batch 14/?, cuts processed until now is 217
17
+ 2022-01-10 07:01:58,336 INFO [decode.py:332] batch 16/?, cuts processed until now is 241
18
+ 2022-01-10 07:02:07,035 INFO [decode.py:332] batch 18/?, cuts processed until now is 267
19
+ 2022-01-10 07:02:17,099 INFO [decode.py:332] batch 20/?, cuts processed until now is 281
20
+ 2022-01-10 07:02:25,367 INFO [decode.py:332] batch 22/?, cuts processed until now is 325
21
+ 2022-01-10 07:02:34,361 INFO [decode.py:332] batch 24/?, cuts processed until now is 349
22
+ 2022-01-10 07:02:43,841 INFO [decode.py:332] batch 26/?, cuts processed until now is 366
23
+ 2022-01-10 07:02:52,590 INFO [decode.py:332] batch 28/?, cuts processed until now is 389
24
+ 2022-01-10 07:03:01,375 INFO [decode.py:332] batch 30/?, cuts processed until now is 410
25
+ 2022-01-10 07:03:09,847 INFO [decode.py:332] batch 32/?, cuts processed until now is 442
26
+ 2022-01-10 07:03:18,925 INFO [decode.py:332] batch 34/?, cuts processed until now is 474
27
+ 2022-01-10 07:03:27,823 INFO [decode.py:332] batch 36/?, cuts processed until now is 498
28
+ 2022-01-10 07:03:37,086 INFO [decode.py:332] batch 38/?, cuts processed until now is 514
29
+ 2022-01-10 07:03:47,156 INFO [decode.py:332] batch 40/?, cuts processed until now is 524
30
+ 2022-01-10 07:03:56,312 INFO [decode.py:332] batch 42/?, cuts processed until now is 564
31
+ 2022-01-10 07:04:04,476 INFO [decode.py:332] batch 44/?, cuts processed until now is 621
32
+ 2022-01-10 07:04:13,774 INFO [decode.py:332] batch 46/?, cuts processed until now is 633
33
+ 2022-01-10 07:04:22,672 INFO [decode.py:332] batch 48/?, cuts processed until now is 648
34
+ 2022-01-10 07:04:32,004 INFO [decode.py:332] batch 50/?, cuts processed until now is 662
35
+ 2022-01-10 07:04:40,970 INFO [decode.py:332] batch 52/?, cuts processed until now is 680
36
+ 2022-01-10 07:04:49,420 INFO [decode.py:332] batch 54/?, cuts processed until now is 708
37
+ 2022-01-10 07:04:57,863 INFO [decode.py:332] batch 56/?, cuts processed until now is 736
38
+ 2022-01-10 07:05:06,762 INFO [decode.py:332] batch 58/?, cuts processed until now is 752
39
+ 2022-01-10 07:05:14,673 INFO [decode.py:332] batch 60/?, cuts processed until now is 819
40
+ 2022-01-10 07:05:23,234 INFO [decode.py:332] batch 62/?, cuts processed until now is 843
41
+ 2022-01-10 07:05:33,525 INFO [decode.py:332] batch 64/?, cuts processed until now is 850
42
+ 2022-01-10 07:05:42,072 INFO [decode.py:332] batch 66/?, cuts processed until now is 880
43
+ 2022-01-10 07:05:50,294 INFO [decode.py:332] batch 68/?, cuts processed until now is 932
44
+ 2022-01-10 07:06:00,225 INFO [decode.py:332] batch 70/?, cuts processed until now is 957
45
+ 2022-01-10 07:06:08,457 INFO [decode.py:332] batch 72/?, cuts processed until now is 996
46
+ 2022-01-10 07:06:16,514 INFO [decode.py:332] batch 74/?, cuts processed until now is 1064
47
+ 2022-01-10 07:06:25,998 INFO [decode.py:332] batch 76/?, cuts processed until now is 1077
48
+ 2022-01-10 07:06:34,949 INFO [decode.py:332] batch 78/?, cuts processed until now is 1114
49
+ 2022-01-10 07:06:43,559 INFO [decode.py:332] batch 80/?, cuts processed until now is 1141
50
+ 2022-01-10 07:06:51,829 INFO [decode.py:332] batch 82/?, cuts processed until now is 1172
51
+ 2022-01-10 07:07:01,355 INFO [decode.py:332] batch 84/?, cuts processed until now is 1180
52
+ 2022-01-10 07:07:09,939 INFO [decode.py:332] batch 86/?, cuts processed until now is 1199
53
+ 2022-01-10 07:07:18,257 INFO [decode.py:332] batch 88/?, cuts processed until now is 1228
54
+ 2022-01-10 07:07:27,270 INFO [decode.py:332] batch 90/?, cuts processed until now is 1245
55
+ 2022-01-10 07:07:35,692 INFO [decode.py:332] batch 92/?, cuts processed until now is 1267
56
+ 2022-01-10 07:07:43,617 INFO [decode.py:332] batch 94/?, cuts processed until now is 1333
57
+ 2022-01-10 07:07:52,347 INFO [decode.py:332] batch 96/?, cuts processed until now is 1363
58
+ 2022-01-10 07:07:57,145 INFO [decode.py:332] batch 98/?, cuts processed until now is 1378
59
+ 2022-01-10 07:08:05,796 INFO [decode.py:332] batch 100/?, cuts processed until now is 1406
60
+ 2022-01-10 07:08:14,624 INFO [decode.py:332] batch 102/?, cuts processed until now is 1420
61
+ 2022-01-10 07:08:23,027 INFO [decode.py:332] batch 104/?, cuts processed until now is 1445
62
+ 2022-01-10 07:08:31,934 INFO [decode.py:332] batch 106/?, cuts processed until now is 1468
63
+ 2022-01-10 07:08:40,757 INFO [decode.py:332] batch 108/?, cuts processed until now is 1494
64
+ 2022-01-10 07:08:48,835 INFO [decode.py:332] batch 110/?, cuts processed until now is 1547
65
+ 2022-01-10 07:08:57,659 INFO [decode.py:332] batch 112/?, cuts processed until now is 1582
66
+ 2022-01-10 07:09:05,988 INFO [decode.py:332] batch 114/?, cuts processed until now is 1615
67
+ 2022-01-10 07:09:15,011 INFO [decode.py:332] batch 116/?, cuts processed until now is 1636
68
+ 2022-01-10 07:09:23,829 INFO [decode.py:332] batch 118/?, cuts processed until now is 1655
69
+ 2022-01-10 07:09:32,230 INFO [decode.py:332] batch 120/?, cuts processed until now is 1696
70
+ 2022-01-10 07:09:40,438 INFO [decode.py:332] batch 122/?, cuts processed until now is 1722
71
+ 2022-01-10 07:09:49,628 INFO [decode.py:332] batch 124/?, cuts processed until now is 1734
72
+ 2022-01-10 07:09:58,556 INFO [decode.py:332] batch 126/?, cuts processed until now is 1755
73
+ 2022-01-10 07:10:07,053 INFO [decode.py:332] batch 128/?, cuts processed until now is 1781
74
+ 2022-01-10 07:10:14,917 INFO [decode.py:332] batch 130/?, cuts processed until now is 1844
75
+ 2022-01-10 07:10:22,914 INFO [decode.py:332] batch 132/?, cuts processed until now is 1886
76
+ 2022-01-10 07:10:31,320 INFO [decode.py:332] batch 134/?, cuts processed until now is 1903
77
+ 2022-01-10 07:10:39,457 INFO [decode.py:332] batch 136/?, cuts processed until now is 1932
78
+ 2022-01-10 07:10:48,747 INFO [decode.py:332] batch 138/?, cuts processed until now is 1951
79
+ 2022-01-10 07:10:57,361 INFO [decode.py:332] batch 140/?, cuts processed until now is 1959
80
+ 2022-01-10 07:11:05,422 INFO [decode.py:332] batch 142/?, cuts processed until now is 2007
81
+ 2022-01-10 07:11:14,109 INFO [decode.py:332] batch 144/?, cuts processed until now is 2035
82
+ 2022-01-10 07:11:22,026 INFO [decode.py:332] batch 146/?, cuts processed until now is 2083
83
+ 2022-01-10 07:11:29,027 INFO [decode.py:332] batch 148/?, cuts processed until now is 2130
84
+ 2022-01-10 07:11:38,825 INFO [decode.py:332] batch 150/?, cuts processed until now is 2139
85
+ 2022-01-10 07:11:47,207 INFO [decode.py:332] batch 152/?, cuts processed until now is 2171
86
+ 2022-01-10 07:11:56,758 INFO [decode.py:332] batch 154/?, cuts processed until now is 2192
87
+ 2022-01-10 07:12:06,693 INFO [decode.py:332] batch 156/?, cuts processed until now is 2208
88
+ 2022-01-10 07:12:15,652 INFO [decode.py:332] batch 158/?, cuts processed until now is 2230
89
+ 2022-01-10 07:12:24,205 INFO [decode.py:332] batch 160/?, cuts processed until now is 2258
90
+ 2022-01-10 07:12:33,783 INFO [decode.py:332] batch 162/?, cuts processed until now is 2274
91
+ 2022-01-10 07:12:42,615 INFO [decode.py:332] batch 164/?, cuts processed until now is 2296
92
+ 2022-01-10 07:12:50,970 INFO [decode.py:332] batch 166/?, cuts processed until now is 2327
93
+ 2022-01-10 07:12:59,387 INFO [decode.py:332] batch 168/?, cuts processed until now is 2351
94
+ 2022-01-10 07:13:08,411 INFO [decode.py:332] batch 170/?, cuts processed until now is 2364
95
+ 2022-01-10 07:13:17,934 INFO [decode.py:332] batch 172/?, cuts processed until now is 2374
96
+ 2022-01-10 07:13:26,614 INFO [decode.py:332] batch 174/?, cuts processed until now is 2399
97
+ 2022-01-10 07:13:35,615 INFO [decode.py:332] batch 176/?, cuts processed until now is 2418
98
+ 2022-01-10 07:13:41,210 INFO [decode.py:332] batch 178/?, cuts processed until now is 2427
99
+ 2022-01-10 07:13:49,728 INFO [decode.py:332] batch 180/?, cuts processed until now is 2440
100
+ 2022-01-10 07:13:58,742 INFO [decode.py:332] batch 182/?, cuts processed until now is 2456
101
+ 2022-01-10 07:14:07,431 INFO [decode.py:332] batch 184/?, cuts processed until now is 2466
102
+ 2022-01-10 07:14:16,107 INFO [decode.py:332] batch 186/?, cuts processed until now is 2479
103
+ 2022-01-10 07:14:21,425 INFO [decode.py:332] batch 188/?, cuts processed until now is 2492
104
+ 2022-01-10 07:14:27,803 INFO [decode.py:332] batch 190/?, cuts processed until now is 2502
105
+ 2022-01-10 07:14:37,250 INFO [decode.py:332] batch 192/?, cuts processed until now is 2520
106
+ 2022-01-10 07:14:42,560 INFO [decode.py:332] batch 194/?, cuts processed until now is 2527
107
+ 2022-01-10 07:14:52,815 INFO [decode.py:332] batch 196/?, cuts processed until now is 2539
108
+ 2022-01-10 07:15:02,690 INFO [decode.py:332] batch 198/?, cuts processed until now is 2551
109
+ 2022-01-10 07:15:12,623 INFO [decode.py:332] batch 200/?, cuts processed until now is 2563
110
+ 2022-01-10 07:15:21,592 INFO [decode.py:332] batch 202/?, cuts processed until now is 2575
111
+ 2022-01-10 07:15:30,458 INFO [decode.py:332] batch 204/?, cuts processed until now is 2587
112
+ 2022-01-10 07:15:39,422 INFO [decode.py:332] batch 206/?, cuts processed until now is 2599
113
+ 2022-01-10 07:15:48,336 INFO [decode.py:332] batch 208/?, cuts processed until now is 2611
114
+ 2022-01-10 07:15:54,711 INFO [decode.py:332] batch 210/?, cuts processed until now is 2620
115
+ 2022-01-10 07:15:54,975 INFO [decode.py:349] The transcripts are stored in transducer_stateless/exp-full/beam_search/recogs-test-clean-beam_4-epoch-36-avg-13-beam-4.txt
116
+ 2022-01-10 07:15:55,049 INFO [utils.py:404] [test-clean-beam_4] %WER 2.76% [1451 / 52576, 158 ins, 122 del, 1171 sub ]
117
+ 2022-01-10 07:15:55,267 INFO [decode.py:362] Wrote detailed error stats to transducer_stateless/exp-full/beam_search/errs-test-clean-beam_4-epoch-36-avg-13-beam-4.txt
118
+ 2022-01-10 07:15:55,274 INFO [decode.py:379]
119
+ For test-clean, WER of different settings are:
120
+ beam_4 2.76 best for test-clean
121
+
122
+ 2022-01-10 07:15:59,760 INFO [decode.py:332] batch 0/?, cuts processed until now is 23
123
+ 2022-01-10 07:16:07,953 INFO [decode.py:332] batch 2/?, cuts processed until now is 71
124
+ 2022-01-10 07:16:16,927 INFO [decode.py:332] batch 4/?, cuts processed until now is 92
125
+ 2022-01-10 07:16:24,813 INFO [decode.py:332] batch 6/?, cuts processed until now is 134
126
+ 2022-01-10 07:16:34,335 INFO [decode.py:332] batch 8/?, cuts processed until now is 150
127
+ 2022-01-10 07:16:42,436 INFO [decode.py:332] batch 10/?, cuts processed until now is 190
128
+ 2022-01-10 07:16:50,814 INFO [decode.py:332] batch 12/?, cuts processed until now is 225
129
+ 2022-01-10 07:16:59,240 INFO [decode.py:332] batch 14/?, cuts processed until now is 240
130
+ 2022-01-10 07:17:07,577 INFO [decode.py:332] batch 16/?, cuts processed until now is 266
131
+ 2022-01-10 07:17:15,768 INFO [decode.py:332] batch 18/?, cuts processed until now is 296
132
+ 2022-01-10 07:17:25,089 INFO [decode.py:332] batch 20/?, cuts processed until now is 312
133
+ 2022-01-10 07:17:33,308 INFO [decode.py:332] batch 22/?, cuts processed until now is 360
134
+ 2022-01-10 07:17:41,781 INFO [decode.py:332] batch 24/?, cuts processed until now is 387
135
+ 2022-01-10 07:17:51,439 INFO [decode.py:332] batch 26/?, cuts processed until now is 406
136
+ 2022-01-10 07:18:00,036 INFO [decode.py:332] batch 28/?, cuts processed until now is 433
137
+ 2022-01-10 07:18:08,433 INFO [decode.py:332] batch 30/?, cuts processed until now is 457
138
+ 2022-01-10 07:18:16,653 INFO [decode.py:332] batch 32/?, cuts processed until now is 494
139
+ 2022-01-10 07:18:24,509 INFO [decode.py:332] batch 34/?, cuts processed until now is 540
140
+ 2022-01-10 07:18:32,980 INFO [decode.py:332] batch 36/?, cuts processed until now is 568
141
+ 2022-01-10 07:18:41,623 INFO [decode.py:332] batch 38/?, cuts processed until now is 587
142
+ 2022-01-10 07:18:51,485 INFO [decode.py:332] batch 40/?, cuts processed until now is 598
143
+ 2022-01-10 07:19:00,266 INFO [decode.py:332] batch 42/?, cuts processed until now is 640
144
+ 2022-01-10 07:19:08,018 INFO [decode.py:332] batch 44/?, cuts processed until now is 700
145
+ 2022-01-10 07:19:17,987 INFO [decode.py:332] batch 46/?, cuts processed until now is 715
146
+ 2022-01-10 07:19:27,049 INFO [decode.py:332] batch 48/?, cuts processed until now is 733
147
+ 2022-01-10 07:19:35,331 INFO [decode.py:332] batch 50/?, cuts processed until now is 749
148
+ 2022-01-10 07:19:44,538 INFO [decode.py:332] batch 52/?, cuts processed until now is 769
149
+ 2022-01-10 07:19:53,088 INFO [decode.py:332] batch 54/?, cuts processed until now is 801
150
+ 2022-01-10 07:20:01,610 INFO [decode.py:332] batch 56/?, cuts processed until now is 833
151
+ 2022-01-10 07:20:10,452 INFO [decode.py:332] batch 58/?, cuts processed until now is 853
152
+ 2022-01-10 07:20:18,055 INFO [decode.py:332] batch 60/?, cuts processed until now is 922
153
+ 2022-01-10 07:20:26,469 INFO [decode.py:332] batch 62/?, cuts processed until now is 950
154
+ 2022-01-10 07:20:35,703 INFO [decode.py:332] batch 64/?, cuts processed until now is 958
155
+ 2022-01-10 07:20:43,867 INFO [decode.py:332] batch 66/?, cuts processed until now is 992
156
+ 2022-01-10 07:20:51,934 INFO [decode.py:332] batch 68/?, cuts processed until now is 1046
157
+ 2022-01-10 07:21:00,177 INFO [decode.py:332] batch 70/?, cuts processed until now is 1074
158
+ 2022-01-10 07:21:08,304 INFO [decode.py:332] batch 72/?, cuts processed until now is 1119
159
+ 2022-01-10 07:21:15,956 INFO [decode.py:332] batch 74/?, cuts processed until now is 1188
160
+ 2022-01-10 07:21:24,495 INFO [decode.py:332] batch 76/?, cuts processed until now is 1203
161
+ 2022-01-10 07:21:33,534 INFO [decode.py:332] batch 78/?, cuts processed until now is 1243
162
+ 2022-01-10 07:21:41,863 INFO [decode.py:332] batch 80/?, cuts processed until now is 1274
163
+ 2022-01-10 07:21:49,819 INFO [decode.py:332] batch 82/?, cuts processed until now is 1310
164
+ 2022-01-10 07:21:59,513 INFO [decode.py:332] batch 84/?, cuts processed until now is 1320
165
+ 2022-01-10 07:22:07,908 INFO [decode.py:332] batch 86/?, cuts processed until now is 1343
166
+ 2022-01-10 07:22:16,111 INFO [decode.py:332] batch 88/?, cuts processed until now is 1377
167
+ 2022-01-10 07:22:24,233 INFO [decode.py:332] batch 90/?, cuts processed until now is 1422
168
+ 2022-01-10 07:22:32,767 INFO [decode.py:332] batch 92/?, cuts processed until now is 1448
169
+ 2022-01-10 07:22:40,610 INFO [decode.py:332] batch 94/?, cuts processed until now is 1514
170
+ 2022-01-10 07:22:49,294 INFO [decode.py:332] batch 96/?, cuts processed until now is 1547
171
+ 2022-01-10 07:22:55,790 INFO [decode.py:332] batch 98/?, cuts processed until now is 1594
172
+ 2022-01-10 07:23:04,178 INFO [decode.py:332] batch 100/?, cuts processed until now is 1614
173
+ 2022-01-10 07:23:13,263 INFO [decode.py:332] batch 102/?, cuts processed until now is 1631
174
+ 2022-01-10 07:23:21,820 INFO [decode.py:332] batch 104/?, cuts processed until now is 1660
175
+ 2022-01-10 07:23:30,202 INFO [decode.py:332] batch 106/?, cuts processed until now is 1686
176
+ 2022-01-10 07:23:38,643 INFO [decode.py:332] batch 108/?, cuts processed until now is 1716
177
+ 2022-01-10 07:23:46,522 INFO [decode.py:332] batch 110/?, cuts processed until now is 1774
178
+ 2022-01-10 07:23:54,651 INFO [decode.py:332] batch 112/?, cuts processed until now is 1812
179
+ 2022-01-10 07:24:02,878 INFO [decode.py:332] batch 114/?, cuts processed until now is 1849
180
+ 2022-01-10 07:24:11,116 INFO [decode.py:332] batch 116/?, cuts processed until now is 1872
181
+ 2022-01-10 07:24:19,953 INFO [decode.py:332] batch 118/?, cuts processed until now is 1894
182
+ 2022-01-10 07:24:28,220 INFO [decode.py:332] batch 120/?, cuts processed until now is 1938
183
+ 2022-01-10 07:24:36,673 INFO [decode.py:332] batch 122/?, cuts processed until now is 1968
184
+ 2022-01-10 07:24:45,479 INFO [decode.py:332] batch 124/?, cuts processed until now is 1982
185
+ 2022-01-10 07:24:54,081 INFO [decode.py:332] batch 126/?, cuts processed until now is 2007
186
+ 2022-01-10 07:25:02,359 INFO [decode.py:332] batch 128/?, cuts processed until now is 2037
187
+ 2022-01-10 07:25:10,135 INFO [decode.py:332] batch 130/?, cuts processed until now is 2105
188
+ 2022-01-10 07:25:18,093 INFO [decode.py:332] batch 132/?, cuts processed until now is 2152
189
+ 2022-01-10 07:25:26,563 INFO [decode.py:332] batch 134/?, cuts processed until now is 2172
190
+ 2022-01-10 07:25:34,775 INFO [decode.py:332] batch 136/?, cuts processed until now is 2206
191
+ 2022-01-10 07:25:43,646 INFO [decode.py:332] batch 138/?, cuts processed until now is 2228
192
+ 2022-01-10 07:25:52,680 INFO [decode.py:332] batch 140/?, cuts processed until now is 2238
193
+ 2022-01-10 07:26:00,469 INFO [decode.py:332] batch 142/?, cuts processed until now is 2290
194
+ 2022-01-10 07:26:08,722 INFO [decode.py:332] batch 144/?, cuts processed until now is 2321
195
+ 2022-01-10 07:26:14,412 INFO [decode.py:332] batch 146/?, cuts processed until now is 2353
196
+ 2022-01-10 07:26:22,120 INFO [decode.py:332] batch 148/?, cuts processed until now is 2410
197
+ 2022-01-10 07:26:30,511 INFO [decode.py:332] batch 150/?, cuts processed until now is 2420
198
+ 2022-01-10 07:26:38,646 INFO [decode.py:332] batch 152/?, cuts processed until now is 2456
199
+ 2022-01-10 07:26:46,714 INFO [decode.py:332] batch 154/?, cuts processed until now is 2479
200
+ 2022-01-10 07:26:55,162 INFO [decode.py:332] batch 156/?, cuts processed until now is 2496
201
+ 2022-01-10 07:27:00,363 INFO [decode.py:332] batch 158/?, cuts processed until now is 2513
202
+ 2022-01-10 07:27:09,428 INFO [decode.py:332] batch 160/?, cuts processed until now is 2531
203
+ 2022-01-10 07:27:17,634 INFO [decode.py:332] batch 162/?, cuts processed until now is 2555
204
+ 2022-01-10 07:27:26,150 INFO [decode.py:332] batch 164/?, cuts processed until now is 2587
205
+ 2022-01-10 07:27:34,029 INFO [decode.py:332] batch 166/?, cuts processed until now is 2621
206
+ 2022-01-10 07:27:42,590 INFO [decode.py:332] batch 168/?, cuts processed until now is 2650
207
+ 2022-01-10 07:27:48,419 INFO [decode.py:332] batch 170/?, cuts processed until now is 2661
208
+ 2022-01-10 07:27:57,861 INFO [decode.py:332] batch 172/?, cuts processed until now is 2673
209
+ 2022-01-10 07:28:06,418 INFO [decode.py:332] batch 174/?, cuts processed until now is 2698
210
+ 2022-01-10 07:28:15,287 INFO [decode.py:332] batch 176/?, cuts processed until now is 2721
211
+ 2022-01-10 07:28:24,402 INFO [decode.py:332] batch 178/?, cuts processed until now is 2737
212
+ 2022-01-10 07:28:30,500 INFO [decode.py:332] batch 180/?, cuts processed until now is 2758
213
+ 2022-01-10 07:28:39,876 INFO [decode.py:332] batch 182/?, cuts processed until now is 2770
214
+ 2022-01-10 07:28:48,456 INFO [decode.py:332] batch 184/?, cuts processed until now is 2786
215
+ 2022-01-10 07:28:56,599 INFO [decode.py:332] batch 186/?, cuts processed until now is 2805
216
+ 2022-01-10 07:29:05,125 INFO [decode.py:332] batch 188/?, cuts processed until now is 2817
217
+ 2022-01-10 07:29:09,854 INFO [decode.py:332] batch 190/?, cuts processed until now is 2825
218
+ 2022-01-10 07:29:17,382 INFO [decode.py:332] batch 192/?, cuts processed until now is 2843
219
+ 2022-01-10 07:29:27,181 INFO [decode.py:332] batch 194/?, cuts processed until now is 2857
220
+ 2022-01-10 07:29:36,422 INFO [decode.py:332] batch 196/?, cuts processed until now is 2871
221
+ 2022-01-10 07:29:45,548 INFO [decode.py:332] batch 198/?, cuts processed until now is 2885
222
+ 2022-01-10 07:29:54,626 INFO [decode.py:332] batch 200/?, cuts processed until now is 2899
223
+ 2022-01-10 07:30:03,442 INFO [decode.py:332] batch 202/?, cuts processed until now is 2913
224
+ 2022-01-10 07:30:11,902 INFO [decode.py:332] batch 204/?, cuts processed until now is 2927
225
+ 2022-01-10 07:30:19,211 INFO [decode.py:332] batch 206/?, cuts processed until now is 2939
226
+ 2022-01-10 07:30:19,413 INFO [decode.py:349] The transcripts are stored in transducer_stateless/exp-full/beam_search/recogs-test-other-beam_4-epoch-36-avg-13-beam-4.txt
227
+ 2022-01-10 07:30:19,490 INFO [utils.py:404] [test-other-beam_4] %WER 6.97% [3649 / 52343, 373 ins, 327 del, 2949 sub ]
228
+ 2022-01-10 07:30:19,714 INFO [decode.py:362] Wrote detailed error stats to transducer_stateless/exp-full/beam_search/errs-test-other-beam_4-epoch-36-avg-13-beam-4.txt
229
+ 2022-01-10 07:30:19,724 INFO [decode.py:379]
230
+ For test-other, WER of different settings are:
231
+ beam_4 6.97 best for test-other
232
+
233
+ 2022-01-10 07:30:19,724 INFO [decode.py:467] Done!
log/log-decode-epoch-36-avg-13-context-2-max-sym-per-frame-3-2022-01-10-03-09-34 ADDED
@@ -0,0 +1,29 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2022-01-10 03:09:34,120 INFO [decode.py:403] Decoding started
2
+ 2022-01-10 03:09:34,120 INFO [decode.py:409] Device: cuda:0
3
+ 2022-01-10 03:09:34,188 INFO [decode.py:418] {'feature_dim': 80, 'encoder_out_dim': 512, 'subsampling_factor': 4, 'attention_dim': 512, 'nhead': 8, 'dim_feedforward': 2048, 'num_encoder_layers': 12, 'vgg_frontend': False, 'env_info': {'k2-version': '1.10', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': '31e1307c3131d03384ef83c33472309d22d2e79d', 'k2-git-date': 'Fri Nov 19 14:47:09 2021', 'lhotse-version': '1.0.0.dev+missing.version.file', 'torch-cuda-available': True, 'torch-cuda-version': '10.2', 'python-version': '3.8', 'icefall-git-branch': 'rnnt-ot', 'icefall-git-sha1': '2084dba-clean', 'icefall-git-date': 'Sat Jan 8 19:10:49 2022', 'icefall-path': '/ceph-fj/fangjun/open-source-2/icefall-rnnt-ot', 'k2-path': '/ceph-fj/fangjun/open-source-2/k2-rnnt/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-fj/fangjun/open-source-2/lhotse-rnnt/lhotse/__init__.py', 'hostname': 'de-74279-k2-train-4-0809194600-d77fc9b88-4vzzq', 'IP address': '10.48.16.137'}, 'epoch': 36, 'avg': 13, 'exp_dir': PosixPath('transducer_stateless/exp-full'), 'bpe_model': './data/lang_bpe_500/bpe.model', 'decoding_method': 'greedy_search', 'beam_size': 4, 'context_size': 2, 'max_sym_per_frame': 3, 'full_libri': True, 'manifest_dir': PosixPath('data/fbank'), 'max_duration': 100, 'bucketing_sampler': True, 'num_buckets': 30, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'res_dir': PosixPath('transducer_stateless/exp-full/greedy_search'), 'suffix': 'epoch-36-avg-13-context-2-max-sym-per-frame-3', 'blank_id': 0, 'vocab_size': 500}
4
+ 2022-01-10 03:09:34,188 INFO [decode.py:420] About to create model
5
+ 2022-01-10 03:09:34,690 INFO [decode.py:431] averaging ['transducer_stateless/exp-full/epoch-24.pt', 'transducer_stateless/exp-full/epoch-25.pt', 'transducer_stateless/exp-full/epoch-26.pt', 'transducer_stateless/exp-full/epoch-27.pt', 'transducer_stateless/exp-full/epoch-28.pt', 'transducer_stateless/exp-full/epoch-29.pt', 'transducer_stateless/exp-full/epoch-30.pt', 'transducer_stateless/exp-full/epoch-31.pt', 'transducer_stateless/exp-full/epoch-32.pt', 'transducer_stateless/exp-full/epoch-33.pt', 'transducer_stateless/exp-full/epoch-34.pt', 'transducer_stateless/exp-full/epoch-35.pt', 'transducer_stateless/exp-full/epoch-36.pt']
6
+ 2022-01-10 03:09:47,020 INFO [decode.py:440] Number of model parameters: 84007924
7
+ 2022-01-10 03:09:47,020 INFO [asr_datamodule.py:379] About to get test-clean cuts
8
+ 2022-01-10 03:09:47,199 INFO [asr_datamodule.py:384] About to get test-other cuts
9
+ 2022-01-10 03:09:48,390 INFO [decode.py:332] batch 0/?, cuts processed until now is 20
10
+ 2022-01-10 03:10:48,082 INFO [decode.py:332] batch 100/?, cuts processed until now is 1406
11
+ 2022-01-10 03:11:46,434 INFO [decode.py:332] batch 200/?, cuts processed until now is 2563
12
+ 2022-01-10 03:11:52,082 INFO [decode.py:349] The transcripts are stored in transducer_stateless/exp-full/greedy_search/recogs-test-clean-greedy_search-epoch-36-avg-13-context-2-max-sym-per-frame-3.txt
13
+ 2022-01-10 03:11:52,156 INFO [utils.py:404] [test-clean-greedy_search] %WER 2.77% [1456 / 52576, 152 ins, 129 del, 1175 sub ]
14
+ 2022-01-10 03:11:52,374 INFO [decode.py:362] Wrote detailed error stats to transducer_stateless/exp-full/greedy_search/errs-test-clean-greedy_search-epoch-36-avg-13-context-2-max-sym-per-frame-3.txt
15
+ 2022-01-10 03:11:52,381 INFO [decode.py:379]
16
+ For test-clean, WER of different settings are:
17
+ greedy_search 2.77 best for test-clean
18
+
19
+ 2022-01-10 03:11:53,494 INFO [decode.py:332] batch 0/?, cuts processed until now is 23
20
+ 2022-01-10 03:12:53,241 INFO [decode.py:332] batch 100/?, cuts processed until now is 1614
21
+ 2022-01-10 03:13:50,778 INFO [decode.py:332] batch 200/?, cuts processed until now is 2899
22
+ 2022-01-10 03:13:54,259 INFO [decode.py:349] The transcripts are stored in transducer_stateless/exp-full/greedy_search/recogs-test-other-greedy_search-epoch-36-avg-13-context-2-max-sym-per-frame-3.txt
23
+ 2022-01-10 03:13:54,336 INFO [utils.py:404] [test-other-greedy_search] %WER 7.07% [3703 / 52343, 366 ins, 345 del, 2992 sub ]
24
+ 2022-01-10 03:13:54,559 INFO [decode.py:362] Wrote detailed error stats to transducer_stateless/exp-full/greedy_search/errs-test-other-greedy_search-epoch-36-avg-13-context-2-max-sym-per-frame-3.txt
25
+ 2022-01-10 03:13:54,566 INFO [decode.py:379]
26
+ For test-other, WER of different settings are:
27
+ greedy_search 7.07 best for test-other
28
+
29
+ 2022-01-10 03:13:54,567 INFO [decode.py:467] Done!
log/recogs-test-clean-beam_4-epoch-36-avg-13-beam-4.txt ADDED
The diff for this file is too large to render. See raw diff
 
log/recogs-test-clean-greedy_search-epoch-36-avg-13-context-2-max-sym-per-frame-3.txt ADDED
The diff for this file is too large to render. See raw diff
 
log/recogs-test-other-beam_4-epoch-36-avg-13-beam-4.txt ADDED
The diff for this file is too large to render. See raw diff
 
log/recogs-test-other-greedy_search-epoch-36-avg-13-context-2-max-sym-per-frame-3.txt ADDED
The diff for this file is too large to render. See raw diff