luomingshuang's picture
add M and S training models
6b2eb67
raw
history blame
No virus
56.1 kB
2022-05-29 20:31:17,870 INFO [decode.py:470] Decoding started
2022-05-29 20:31:17,870 INFO [decode.py:476] Device: cuda:0
2022-05-29 20:31:19,203 INFO [lexicon.py:176] Loading pre-compiled data/lang_char/Linv.pt
2022-05-29 20:31:19,293 INFO [decode.py:482] {'best_train_loss': inf, 'best_valid_loss': inf, 'best_train_epoch': -1, 'best_valid_epoch': -1, 'batch_idx_train': 10, 'log_interval': 1, 'reset_interval': 200, 'feature_dim': 80, 'subsampling_factor': 4, 'encoder_dim': 512, 'nhead': 8, 'dim_feedforward': 2048, 'num_encoder_layers': 12, 'decoder_dim': 512, 'joiner_dim': 512, 'env_info': {'k2-version': '1.15.1', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': 'f8d2dba06c000ffee36aab5b66f24e7c9809f116', 'k2-git-date': 'Thu Apr 21 12:20:34 2022', 'lhotse-version': '1.2.0.dev+git.de75634.dirty', 'torch-version': '1.11.0', 'torch-cuda-available': True, 'torch-cuda-version': '10.2', 'python-version': '3.8', 'icefall-git-branch': 'wenetspeech-pruned-transducer-stateless2', 'icefall-git-sha1': '4b567e4-dirty', 'icefall-git-date': 'Wed Apr 27 13:43:54 2022', 'icefall-path': '/ceph-meixu/luomingshuang/icefall', 'k2-path': '/ceph-ms/luomingshuang/k2_latest/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-meixu/luomingshuang/anaconda3/envs/k2-python/lib/python3.8/site-packages/lhotse-1.2.0.dev0+git.de75634.dirty-py3.8.egg/lhotse/__init__.py', 'hostname': 'de-74279-k2-train-7-0309102938-68688b4cbd-xhtcg', 'IP address': '10.48.32.137'}, 'epoch': 29, 'batch': None, 'avg': 24, 'avg_last_n': 0, 'exp_dir': PosixPath('pruned_transducer_stateless2/exp-char-S-4-gpus'), 'lang_dir': 'data/lang_char', 'decoding_method': 'modified_beam_search', 'beam_size': 4, 'beam': 4, 'max_contexts': 4, 'max_states': 8, 'context_size': 2, 'max_sym_per_frame': 1, 'manifest_dir': PosixPath('data/fbank'), 'max_duration': 200.0, 'bucketing_sampler': True, 'num_buckets': 300, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'lazy_load': True, 'training_subset': 'L', 'res_dir': PosixPath('pruned_transducer_stateless2/exp-char-S-4-gpus/modified_beam_search'), 'suffix': 'epoch-29-avg-24-beam-4', 'blank_id': 0, 'vocab_size': 5537}
2022-05-29 20:31:19,293 INFO [decode.py:484] About to create model
2022-05-29 20:31:19,915 INFO [decode.py:505] averaging ['pruned_transducer_stateless2/exp-char-S-4-gpus/epoch-6.pt', 'pruned_transducer_stateless2/exp-char-S-4-gpus/epoch-7.pt', 'pruned_transducer_stateless2/exp-char-S-4-gpus/epoch-8.pt', 'pruned_transducer_stateless2/exp-char-S-4-gpus/epoch-9.pt', 'pruned_transducer_stateless2/exp-char-S-4-gpus/epoch-10.pt', 'pruned_transducer_stateless2/exp-char-S-4-gpus/epoch-11.pt', 'pruned_transducer_stateless2/exp-char-S-4-gpus/epoch-12.pt', 'pruned_transducer_stateless2/exp-char-S-4-gpus/epoch-13.pt', 'pruned_transducer_stateless2/exp-char-S-4-gpus/epoch-14.pt', 'pruned_transducer_stateless2/exp-char-S-4-gpus/epoch-15.pt', 'pruned_transducer_stateless2/exp-char-S-4-gpus/epoch-16.pt', 'pruned_transducer_stateless2/exp-char-S-4-gpus/epoch-17.pt', 'pruned_transducer_stateless2/exp-char-S-4-gpus/epoch-18.pt', 'pruned_transducer_stateless2/exp-char-S-4-gpus/epoch-19.pt', 'pruned_transducer_stateless2/exp-char-S-4-gpus/epoch-20.pt', 'pruned_transducer_stateless2/exp-char-S-4-gpus/epoch-21.pt', 'pruned_transducer_stateless2/exp-char-S-4-gpus/epoch-22.pt', 'pruned_transducer_stateless2/exp-char-S-4-gpus/epoch-23.pt', 'pruned_transducer_stateless2/exp-char-S-4-gpus/epoch-24.pt', 'pruned_transducer_stateless2/exp-char-S-4-gpus/epoch-25.pt', 'pruned_transducer_stateless2/exp-char-S-4-gpus/epoch-26.pt', 'pruned_transducer_stateless2/exp-char-S-4-gpus/epoch-27.pt', 'pruned_transducer_stateless2/exp-char-S-4-gpus/epoch-28.pt', 'pruned_transducer_stateless2/exp-char-S-4-gpus/epoch-29.pt']
2022-05-29 20:32:10,559 INFO [decode.py:523] Number of model parameters: 88978927
2022-05-29 20:32:10,678 INFO [asr_datamodule.py:353] About to create dev dataset
2022-05-29 20:32:14,526 INFO [asr_datamodule.py:374] About to create dev dataloader
2022-05-29 20:32:28,443 INFO [decode.py:390] batch 0/?, cuts processed until now is 27
2022-05-29 20:32:32,190 INFO [decode.py:390] batch 2/?, cuts processed until now is 81
2022-05-29 20:32:35,863 INFO [decode.py:390] batch 4/?, cuts processed until now is 188
2022-05-29 20:32:39,435 INFO [decode.py:390] batch 6/?, cuts processed until now is 302
2022-05-29 20:32:43,159 INFO [decode.py:390] batch 8/?, cuts processed until now is 358
2022-05-29 20:32:46,952 INFO [decode.py:390] batch 10/?, cuts processed until now is 406
2022-05-29 20:32:50,703 INFO [decode.py:390] batch 12/?, cuts processed until now is 458
2022-05-29 20:32:54,375 INFO [decode.py:390] batch 14/?, cuts processed until now is 518
2022-05-29 20:32:58,092 INFO [decode.py:390] batch 16/?, cuts processed until now is 576
2022-05-29 20:33:01,834 INFO [decode.py:390] batch 18/?, cuts processed until now is 630
2022-05-29 20:33:05,621 INFO [decode.py:390] batch 20/?, cuts processed until now is 681
2022-05-29 20:33:09,338 INFO [decode.py:390] batch 22/?, cuts processed until now is 740
2022-05-29 20:33:13,055 INFO [decode.py:390] batch 24/?, cuts processed until now is 801
2022-05-29 20:33:16,725 INFO [decode.py:390] batch 26/?, cuts processed until now is 869
2022-05-29 20:33:20,373 INFO [decode.py:390] batch 28/?, cuts processed until now is 947
2022-05-29 20:33:24,040 INFO [decode.py:390] batch 30/?, cuts processed until now is 1025
2022-05-29 20:33:27,613 INFO [decode.py:390] batch 32/?, cuts processed until now is 1126
2022-05-29 20:33:31,341 INFO [decode.py:390] batch 34/?, cuts processed until now is 1203
2022-05-29 20:33:35,045 INFO [decode.py:390] batch 36/?, cuts processed until now is 1257
2022-05-29 20:33:38,788 INFO [decode.py:390] batch 38/?, cuts processed until now is 1313
2022-05-29 20:33:42,577 INFO [decode.py:390] batch 40/?, cuts processed until now is 1357
2022-05-29 20:33:46,279 INFO [decode.py:390] batch 42/?, cuts processed until now is 1423
2022-05-29 20:33:49,912 INFO [decode.py:390] batch 44/?, cuts processed until now is 1501
2022-05-29 20:33:53,486 INFO [decode.py:390] batch 46/?, cuts processed until now is 1591
2022-05-29 20:33:57,071 INFO [decode.py:390] batch 48/?, cuts processed until now is 1702
2022-05-29 20:34:00,700 INFO [decode.py:390] batch 50/?, cuts processed until now is 1788
2022-05-29 20:34:04,430 INFO [decode.py:390] batch 52/?, cuts processed until now is 1842
2022-05-29 20:34:08,226 INFO [decode.py:390] batch 54/?, cuts processed until now is 1890
2022-05-29 20:34:11,950 INFO [decode.py:390] batch 56/?, cuts processed until now is 1969
2022-05-29 20:34:15,593 INFO [decode.py:390] batch 58/?, cuts processed until now is 2056
2022-05-29 20:34:19,291 INFO [decode.py:390] batch 60/?, cuts processed until now is 2112
2022-05-29 20:34:23,002 INFO [decode.py:390] batch 62/?, cuts processed until now is 2168
2022-05-29 20:34:26,837 INFO [decode.py:390] batch 64/?, cuts processed until now is 2219
2022-05-29 20:34:30,586 INFO [decode.py:390] batch 66/?, cuts processed until now is 2278
2022-05-29 20:34:34,303 INFO [decode.py:390] batch 68/?, cuts processed until now is 2339
2022-05-29 20:34:38,117 INFO [decode.py:390] batch 70/?, cuts processed until now is 2387
2022-05-29 20:34:41,888 INFO [decode.py:390] batch 72/?, cuts processed until now is 2437
2022-05-29 20:34:45,711 INFO [decode.py:390] batch 74/?, cuts processed until now is 2485
2022-05-29 20:34:49,504 INFO [decode.py:390] batch 76/?, cuts processed until now is 2541
2022-05-29 20:34:53,203 INFO [decode.py:390] batch 78/?, cuts processed until now is 2653
2022-05-29 20:34:56,918 INFO [decode.py:390] batch 80/?, cuts processed until now is 2760
2022-05-29 20:35:00,693 INFO [decode.py:390] batch 82/?, cuts processed until now is 2864
2022-05-29 20:35:04,269 INFO [decode.py:390] batch 84/?, cuts processed until now is 3002
2022-05-29 20:35:07,986 INFO [decode.py:390] batch 86/?, cuts processed until now is 3085
2022-05-29 20:35:11,690 INFO [decode.py:390] batch 88/?, cuts processed until now is 3193
2022-05-29 20:35:15,527 INFO [decode.py:390] batch 90/?, cuts processed until now is 3296
2022-05-29 20:35:19,397 INFO [decode.py:390] batch 92/?, cuts processed until now is 3342
2022-05-29 20:35:23,231 INFO [decode.py:390] batch 94/?, cuts processed until now is 3397
2022-05-29 20:35:26,938 INFO [decode.py:390] batch 96/?, cuts processed until now is 3465
2022-05-29 20:35:30,659 INFO [decode.py:390] batch 98/?, cuts processed until now is 3533
2022-05-29 20:35:34,346 INFO [decode.py:390] batch 100/?, cuts processed until now is 3620
2022-05-29 20:35:38,018 INFO [decode.py:390] batch 102/?, cuts processed until now is 3715
2022-05-29 20:35:41,815 INFO [decode.py:390] batch 104/?, cuts processed until now is 3774
2022-05-29 20:35:45,601 INFO [decode.py:390] batch 106/?, cuts processed until now is 3833
2022-05-29 20:35:49,263 INFO [decode.py:390] batch 108/?, cuts processed until now is 3909
2022-05-29 20:35:52,866 INFO [decode.py:390] batch 110/?, cuts processed until now is 3992
2022-05-29 20:35:56,608 INFO [decode.py:390] batch 112/?, cuts processed until now is 4060
2022-05-29 20:36:00,459 INFO [decode.py:390] batch 114/?, cuts processed until now is 4108
2022-05-29 20:36:04,170 INFO [decode.py:390] batch 116/?, cuts processed until now is 4191
2022-05-29 20:36:07,780 INFO [decode.py:390] batch 118/?, cuts processed until now is 4304
2022-05-29 20:36:11,397 INFO [decode.py:390] batch 120/?, cuts processed until now is 4390
2022-05-29 20:36:15,151 INFO [decode.py:390] batch 122/?, cuts processed until now is 4442
2022-05-29 20:36:18,981 INFO [decode.py:390] batch 124/?, cuts processed until now is 4490
2022-05-29 20:36:22,747 INFO [decode.py:390] batch 126/?, cuts processed until now is 4572
2022-05-29 20:36:26,373 INFO [decode.py:390] batch 128/?, cuts processed until now is 4661
2022-05-29 20:36:30,107 INFO [decode.py:390] batch 130/?, cuts processed until now is 4717
2022-05-29 20:36:33,889 INFO [decode.py:390] batch 132/?, cuts processed until now is 4773
2022-05-29 20:36:37,601 INFO [decode.py:390] batch 134/?, cuts processed until now is 4864
2022-05-29 20:36:41,282 INFO [decode.py:390] batch 136/?, cuts processed until now is 4943
2022-05-29 20:36:45,016 INFO [decode.py:390] batch 138/?, cuts processed until now is 4995
2022-05-29 20:36:48,782 INFO [decode.py:390] batch 140/?, cuts processed until now is 5047
2022-05-29 20:36:52,513 INFO [decode.py:390] batch 142/?, cuts processed until now is 5108
2022-05-29 20:36:56,283 INFO [decode.py:390] batch 144/?, cuts processed until now is 5167
2022-05-29 20:37:00,181 INFO [decode.py:390] batch 146/?, cuts processed until now is 5211
2022-05-29 20:37:04,055 INFO [decode.py:390] batch 148/?, cuts processed until now is 5255
2022-05-29 20:37:07,884 INFO [decode.py:390] batch 150/?, cuts processed until now is 5309
2022-05-29 20:37:11,626 INFO [decode.py:390] batch 152/?, cuts processed until now is 5367
2022-05-29 20:37:15,373 INFO [decode.py:390] batch 154/?, cuts processed until now is 5447
2022-05-29 20:37:19,121 INFO [decode.py:390] batch 156/?, cuts processed until now is 5525
2022-05-29 20:37:22,981 INFO [decode.py:390] batch 158/?, cuts processed until now is 5573
2022-05-29 20:37:26,702 INFO [decode.py:390] batch 160/?, cuts processed until now is 5629
2022-05-29 20:37:30,543 INFO [decode.py:390] batch 162/?, cuts processed until now is 5680
2022-05-29 20:37:34,335 INFO [decode.py:390] batch 164/?, cuts processed until now is 5739
2022-05-29 20:37:38,034 INFO [decode.py:390] batch 166/?, cuts processed until now is 5809
2022-05-29 20:37:41,652 INFO [decode.py:390] batch 168/?, cuts processed until now is 5887
2022-05-29 20:37:45,270 INFO [decode.py:390] batch 170/?, cuts processed until now is 5970
2022-05-29 20:37:48,899 INFO [decode.py:390] batch 172/?, cuts processed until now is 6053
2022-05-29 20:37:52,526 INFO [decode.py:390] batch 174/?, cuts processed until now is 6176
2022-05-29 20:37:56,253 INFO [decode.py:390] batch 176/?, cuts processed until now is 6275
2022-05-29 20:38:00,057 INFO [decode.py:390] batch 178/?, cuts processed until now is 6329
2022-05-29 20:38:03,801 INFO [decode.py:390] batch 180/?, cuts processed until now is 6387
2022-05-29 20:38:07,488 INFO [decode.py:390] batch 182/?, cuts processed until now is 6468
2022-05-29 20:38:11,102 INFO [decode.py:390] batch 184/?, cuts processed until now is 6581
2022-05-29 20:38:14,728 INFO [decode.py:390] batch 186/?, cuts processed until now is 6683
2022-05-29 20:38:18,353 INFO [decode.py:390] batch 188/?, cuts processed until now is 6774
2022-05-29 20:38:21,909 INFO [decode.py:390] batch 190/?, cuts processed until now is 6902
2022-05-29 20:38:25,527 INFO [decode.py:390] batch 192/?, cuts processed until now is 7039
2022-05-29 20:38:29,238 INFO [decode.py:390] batch 194/?, cuts processed until now is 7118
2022-05-29 20:38:33,064 INFO [decode.py:390] batch 196/?, cuts processed until now is 7168
2022-05-29 20:38:36,846 INFO [decode.py:390] batch 198/?, cuts processed until now is 7218
2022-05-29 20:38:40,598 INFO [decode.py:390] batch 200/?, cuts processed until now is 7274
2022-05-29 20:38:44,386 INFO [decode.py:390] batch 202/?, cuts processed until now is 7330
2022-05-29 20:38:48,156 INFO [decode.py:390] batch 204/?, cuts processed until now is 7391
2022-05-29 20:38:51,798 INFO [decode.py:390] batch 206/?, cuts processed until now is 7467
2022-05-29 20:38:55,575 INFO [decode.py:390] batch 208/?, cuts processed until now is 7526
2022-05-29 20:38:59,434 INFO [decode.py:390] batch 210/?, cuts processed until now is 7574
2022-05-29 20:39:03,306 INFO [decode.py:390] batch 212/?, cuts processed until now is 7622
2022-05-29 20:39:07,125 INFO [decode.py:390] batch 214/?, cuts processed until now is 7676
2022-05-29 20:39:10,872 INFO [decode.py:390] batch 216/?, cuts processed until now is 7734
2022-05-29 20:39:14,691 INFO [decode.py:390] batch 218/?, cuts processed until now is 7784
2022-05-29 20:39:18,391 INFO [decode.py:390] batch 220/?, cuts processed until now is 7838
2022-05-29 20:39:22,103 INFO [decode.py:390] batch 222/?, cuts processed until now is 7925
2022-05-29 20:39:25,736 INFO [decode.py:390] batch 224/?, cuts processed until now is 8012
2022-05-29 20:39:29,555 INFO [decode.py:390] batch 226/?, cuts processed until now is 8063
2022-05-29 20:39:33,342 INFO [decode.py:390] batch 228/?, cuts processed until now is 8141
2022-05-29 20:39:37,050 INFO [decode.py:390] batch 230/?, cuts processed until now is 8222
2022-05-29 20:39:40,930 INFO [decode.py:390] batch 232/?, cuts processed until now is 8268
2022-05-29 20:39:44,692 INFO [decode.py:390] batch 234/?, cuts processed until now is 8318
2022-05-29 20:39:48,334 INFO [decode.py:390] batch 236/?, cuts processed until now is 8385
2022-05-29 20:39:52,028 INFO [decode.py:390] batch 238/?, cuts processed until now is 8461
2022-05-29 20:39:55,629 INFO [decode.py:390] batch 240/?, cuts processed until now is 8579
2022-05-29 20:39:59,340 INFO [decode.py:390] batch 242/?, cuts processed until now is 8691
2022-05-29 20:40:02,964 INFO [decode.py:390] batch 244/?, cuts processed until now is 8780
2022-05-29 20:40:06,571 INFO [decode.py:390] batch 246/?, cuts processed until now is 8875
2022-05-29 20:40:10,328 INFO [decode.py:390] batch 248/?, cuts processed until now is 8938
2022-05-29 20:40:14,020 INFO [decode.py:390] batch 250/?, cuts processed until now is 9010
2022-05-29 20:40:17,711 INFO [decode.py:390] batch 252/?, cuts processed until now is 9077
2022-05-29 20:40:21,500 INFO [decode.py:390] batch 254/?, cuts processed until now is 9131
2022-05-29 20:40:25,253 INFO [decode.py:390] batch 256/?, cuts processed until now is 9238
2022-05-29 20:40:28,819 INFO [decode.py:390] batch 258/?, cuts processed until now is 9372
2022-05-29 20:40:32,437 INFO [decode.py:390] batch 260/?, cuts processed until now is 9461
2022-05-29 20:40:36,098 INFO [decode.py:390] batch 262/?, cuts processed until now is 9537
2022-05-29 20:40:39,751 INFO [decode.py:390] batch 264/?, cuts processed until now is 9651
2022-05-29 20:40:43,464 INFO [decode.py:390] batch 266/?, cuts processed until now is 9751
2022-05-29 20:40:47,348 INFO [decode.py:390] batch 268/?, cuts processed until now is 9795
2022-05-29 20:40:51,121 INFO [decode.py:390] batch 270/?, cuts processed until now is 9861
2022-05-29 20:40:54,720 INFO [decode.py:390] batch 272/?, cuts processed until now is 9997
2022-05-29 20:40:58,331 INFO [decode.py:390] batch 274/?, cuts processed until now is 10122
2022-05-29 20:41:01,961 INFO [decode.py:390] batch 276/?, cuts processed until now is 10201
2022-05-29 20:41:05,604 INFO [decode.py:390] batch 278/?, cuts processed until now is 10279
2022-05-29 20:41:09,283 INFO [decode.py:390] batch 280/?, cuts processed until now is 10346
2022-05-29 20:41:12,977 INFO [decode.py:390] batch 282/?, cuts processed until now is 10416
2022-05-29 20:41:16,714 INFO [decode.py:390] batch 284/?, cuts processed until now is 10486
2022-05-29 20:41:20,424 INFO [decode.py:390] batch 286/?, cuts processed until now is 10559
2022-05-29 20:41:23,970 INFO [decode.py:390] batch 288/?, cuts processed until now is 10684
2022-05-29 20:41:27,508 INFO [decode.py:390] batch 290/?, cuts processed until now is 10848
2022-05-29 20:41:31,041 INFO [decode.py:390] batch 292/?, cuts processed until now is 10957
2022-05-29 20:41:34,690 INFO [decode.py:390] batch 294/?, cuts processed until now is 11028
2022-05-29 20:41:38,353 INFO [decode.py:390] batch 296/?, cuts processed until now is 11111
2022-05-29 20:41:42,143 INFO [decode.py:390] batch 298/?, cuts processed until now is 11177
2022-05-29 20:41:45,914 INFO [decode.py:390] batch 300/?, cuts processed until now is 11229
2022-05-29 20:41:49,469 INFO [decode.py:390] batch 302/?, cuts processed until now is 11354
2022-05-29 20:41:53,164 INFO [decode.py:390] batch 304/?, cuts processed until now is 11460
2022-05-29 20:41:56,994 INFO [decode.py:390] batch 306/?, cuts processed until now is 11508
2022-05-29 20:42:00,604 INFO [decode.py:390] batch 308/?, cuts processed until now is 11611
2022-05-29 20:42:04,218 INFO [decode.py:390] batch 310/?, cuts processed until now is 11716
2022-05-29 20:42:07,982 INFO [decode.py:390] batch 312/?, cuts processed until now is 11818
2022-05-29 20:42:11,640 INFO [decode.py:390] batch 314/?, cuts processed until now is 11885
2022-05-29 20:42:15,222 INFO [decode.py:390] batch 316/?, cuts processed until now is 11997
2022-05-29 20:42:18,943 INFO [decode.py:390] batch 318/?, cuts processed until now is 12053
2022-05-29 20:42:22,523 INFO [decode.py:390] batch 320/?, cuts processed until now is 12178
2022-05-29 20:42:26,283 INFO [decode.py:390] batch 322/?, cuts processed until now is 12243
2022-05-29 20:42:29,924 INFO [decode.py:390] batch 324/?, cuts processed until now is 12348
2022-05-29 20:42:33,646 INFO [decode.py:390] batch 326/?, cuts processed until now is 12418
2022-05-29 20:42:37,293 INFO [decode.py:390] batch 328/?, cuts processed until now is 12527
2022-05-29 20:42:40,979 INFO [decode.py:390] batch 330/?, cuts processed until now is 12597
2022-05-29 20:42:44,761 INFO [decode.py:390] batch 332/?, cuts processed until now is 12656
2022-05-29 20:42:48,453 INFO [decode.py:390] batch 334/?, cuts processed until now is 12724
2022-05-29 20:42:52,232 INFO [decode.py:390] batch 336/?, cuts processed until now is 12776
2022-05-29 20:42:55,839 INFO [decode.py:390] batch 338/?, cuts processed until now is 12850
2022-05-29 20:42:59,571 INFO [decode.py:390] batch 340/?, cuts processed until now is 12956
2022-05-29 20:43:03,379 INFO [decode.py:390] batch 342/?, cuts processed until now is 13008
2022-05-29 20:43:06,981 INFO [decode.py:390] batch 344/?, cuts processed until now is 13114
2022-05-29 20:43:10,687 INFO [decode.py:390] batch 346/?, cuts processed until now is 13168
2022-05-29 20:43:12,955 INFO [decode.py:390] batch 348/?, cuts processed until now is 13251
2022-05-29 20:43:16,433 INFO [decode.py:390] batch 350/?, cuts processed until now is 13318
2022-05-29 20:43:20,076 INFO [decode.py:390] batch 352/?, cuts processed until now is 13380
2022-05-29 20:43:22,878 INFO [decode.py:390] batch 354/?, cuts processed until now is 13415
2022-05-29 20:43:26,166 INFO [decode.py:390] batch 356/?, cuts processed until now is 13503
2022-05-29 20:43:29,033 INFO [decode.py:390] batch 358/?, cuts processed until now is 13549
2022-05-29 20:43:31,161 INFO [decode.py:390] batch 360/?, cuts processed until now is 13580
2022-05-29 20:43:33,398 INFO [decode.py:390] batch 362/?, cuts processed until now is 13612
2022-05-29 20:43:34,657 INFO [decode.py:390] batch 364/?, cuts processed until now is 13639
2022-05-29 20:43:35,886 INFO [decode.py:390] batch 366/?, cuts processed until now is 13665
2022-05-29 20:43:38,986 INFO [decode.py:390] batch 368/?, cuts processed until now is 13716
2022-05-29 20:43:41,087 INFO [decode.py:390] batch 370/?, cuts processed until now is 13740
2022-05-29 20:43:43,390 INFO [decode.py:390] batch 372/?, cuts processed until now is 13772
2022-05-29 20:43:46,114 INFO [decode.py:390] batch 374/?, cuts processed until now is 13825
2022-05-29 20:43:46,498 INFO [decode.py:407] The transcripts are stored in pruned_transducer_stateless2/exp-char-S-4-gpus/modified_beam_search/recogs-DEV-beam_size_4-epoch-29-avg-24-beam-4.txt
2022-05-29 20:43:46,903 INFO [utils.py:406] [DEV-beam_size_4] %WER 18.74% [61941 / 330498, 1518 ins, 17814 del, 42609 sub ]
2022-05-29 20:43:47,974 INFO [decode.py:420] Wrote detailed error stats to pruned_transducer_stateless2/exp-char-S-4-gpus/modified_beam_search/errs-DEV-beam_size_4-epoch-29-avg-24-beam-4.txt
2022-05-29 20:43:47,982 INFO [decode.py:437]
For DEV, WER of different settings are:
beam_size_4 18.74 best for DEV
2022-05-29 20:43:55,524 INFO [decode.py:390] batch 0/?, cuts processed until now is 31
2022-05-29 20:43:59,836 INFO [decode.py:390] batch 2/?, cuts processed until now is 94
2022-05-29 20:44:04,148 INFO [decode.py:390] batch 4/?, cuts processed until now is 306
2022-05-29 20:44:08,346 INFO [decode.py:390] batch 6/?, cuts processed until now is 549
2022-05-29 20:44:12,678 INFO [decode.py:390] batch 8/?, cuts processed until now is 621
2022-05-29 20:44:17,072 INFO [decode.py:390] batch 10/?, cuts processed until now is 675
2022-05-29 20:44:21,090 INFO [decode.py:390] batch 12/?, cuts processed until now is 734
2022-05-29 20:44:24,769 INFO [decode.py:390] batch 14/?, cuts processed until now is 812
2022-05-29 20:44:28,391 INFO [decode.py:390] batch 16/?, cuts processed until now is 887
2022-05-29 20:44:32,094 INFO [decode.py:390] batch 18/?, cuts processed until now is 952
2022-05-29 20:44:36,015 INFO [decode.py:390] batch 20/?, cuts processed until now is 1009
2022-05-29 20:44:40,542 INFO [decode.py:390] batch 22/?, cuts processed until now is 1081
2022-05-29 20:44:44,214 INFO [decode.py:390] batch 24/?, cuts processed until now is 1167
2022-05-29 20:44:47,961 INFO [decode.py:390] batch 26/?, cuts processed until now is 1271
2022-05-29 20:44:51,491 INFO [decode.py:390] batch 28/?, cuts processed until now is 1395
2022-05-29 20:44:55,022 INFO [decode.py:390] batch 30/?, cuts processed until now is 1520
2022-05-29 20:44:58,565 INFO [decode.py:390] batch 32/?, cuts processed until now is 1703
2022-05-29 20:45:02,740 INFO [decode.py:390] batch 34/?, cuts processed until now is 1826
2022-05-29 20:45:06,661 INFO [decode.py:390] batch 36/?, cuts processed until now is 1887
2022-05-29 20:45:10,362 INFO [decode.py:390] batch 38/?, cuts processed until now is 1960
2022-05-29 20:45:14,583 INFO [decode.py:390] batch 40/?, cuts processed until now is 2002
2022-05-29 20:45:18,633 INFO [decode.py:390] batch 42/?, cuts processed until now is 2095
2022-05-29 20:45:22,244 INFO [decode.py:390] batch 44/?, cuts processed until now is 2220
2022-05-29 20:45:25,747 INFO [decode.py:390] batch 46/?, cuts processed until now is 2371
2022-05-29 20:45:29,249 INFO [decode.py:390] batch 48/?, cuts processed until now is 2579
2022-05-29 20:45:32,878 INFO [decode.py:390] batch 50/?, cuts processed until now is 2724
2022-05-29 20:45:36,590 INFO [decode.py:390] batch 52/?, cuts processed until now is 2789
2022-05-29 20:45:40,330 INFO [decode.py:390] batch 54/?, cuts processed until now is 2843
2022-05-29 20:45:44,006 INFO [decode.py:390] batch 56/?, cuts processed until now is 2974
2022-05-29 20:45:47,529 INFO [decode.py:390] batch 58/?, cuts processed until now is 3119
2022-05-29 20:45:51,190 INFO [decode.py:390] batch 60/?, cuts processed until now is 3188
2022-05-29 20:45:54,786 INFO [decode.py:390] batch 62/?, cuts processed until now is 3256
2022-05-29 20:45:58,734 INFO [decode.py:390] batch 64/?, cuts processed until now is 3310
2022-05-29 20:46:02,632 INFO [decode.py:390] batch 66/?, cuts processed until now is 3389
2022-05-29 20:46:06,302 INFO [decode.py:390] batch 68/?, cuts processed until now is 3475
2022-05-29 20:46:10,035 INFO [decode.py:390] batch 70/?, cuts processed until now is 3529
2022-05-29 20:46:13,763 INFO [decode.py:390] batch 72/?, cuts processed until now is 3586
2022-05-29 20:46:17,501 INFO [decode.py:390] batch 74/?, cuts processed until now is 3640
2022-05-29 20:46:21,161 INFO [decode.py:390] batch 76/?, cuts processed until now is 3712
2022-05-29 20:46:24,723 INFO [decode.py:390] batch 78/?, cuts processed until now is 3947
2022-05-29 20:46:28,384 INFO [decode.py:390] batch 80/?, cuts processed until now is 4168
2022-05-29 20:46:32,063 INFO [decode.py:390] batch 82/?, cuts processed until now is 4395
2022-05-29 20:46:35,568 INFO [decode.py:390] batch 84/?, cuts processed until now is 4679
2022-05-29 20:46:39,144 INFO [decode.py:390] batch 86/?, cuts processed until now is 4818
2022-05-29 20:46:42,739 INFO [decode.py:390] batch 88/?, cuts processed until now is 5042
2022-05-29 20:46:47,073 INFO [decode.py:390] batch 90/?, cuts processed until now is 5244
2022-05-29 20:46:50,994 INFO [decode.py:390] batch 92/?, cuts processed until now is 5293
2022-05-29 20:46:54,678 INFO [decode.py:390] batch 94/?, cuts processed until now is 5358
2022-05-29 20:46:58,248 INFO [decode.py:390] batch 96/?, cuts processed until now is 5455
2022-05-29 20:47:01,907 INFO [decode.py:390] batch 98/?, cuts processed until now is 5553
2022-05-29 20:47:05,418 INFO [decode.py:390] batch 100/?, cuts processed until now is 5697
2022-05-29 20:47:08,913 INFO [decode.py:390] batch 102/?, cuts processed until now is 5863
2022-05-29 20:47:12,953 INFO [decode.py:390] batch 104/?, cuts processed until now is 5942
2022-05-29 20:47:17,175 INFO [decode.py:390] batch 106/?, cuts processed until now is 6020
2022-05-29 20:47:20,733 INFO [decode.py:390] batch 108/?, cuts processed until now is 6140
2022-05-29 20:47:24,352 INFO [decode.py:390] batch 110/?, cuts processed until now is 6280
2022-05-29 20:47:28,014 INFO [decode.py:390] batch 112/?, cuts processed until now is 6384
2022-05-29 20:47:31,819 INFO [decode.py:390] batch 114/?, cuts processed until now is 6438
2022-05-29 20:47:35,468 INFO [decode.py:390] batch 116/?, cuts processed until now is 6572
2022-05-29 20:47:39,019 INFO [decode.py:390] batch 118/?, cuts processed until now is 6787
2022-05-29 20:47:42,561 INFO [decode.py:390] batch 120/?, cuts processed until now is 6929
2022-05-29 20:47:46,290 INFO [decode.py:390] batch 122/?, cuts processed until now is 6991
2022-05-29 20:47:50,075 INFO [decode.py:390] batch 124/?, cuts processed until now is 7046
2022-05-29 20:47:53,710 INFO [decode.py:390] batch 126/?, cuts processed until now is 7181
2022-05-29 20:47:57,292 INFO [decode.py:390] batch 128/?, cuts processed until now is 7335
2022-05-29 20:48:00,982 INFO [decode.py:390] batch 130/?, cuts processed until now is 7408
2022-05-29 20:48:04,683 INFO [decode.py:390] batch 132/?, cuts processed until now is 7481
2022-05-29 20:48:08,195 INFO [decode.py:390] batch 134/?, cuts processed until now is 7634
2022-05-29 20:48:11,862 INFO [decode.py:390] batch 136/?, cuts processed until now is 7767
2022-05-29 20:48:15,608 INFO [decode.py:390] batch 138/?, cuts processed until now is 7830
2022-05-29 20:48:19,289 INFO [decode.py:390] batch 140/?, cuts processed until now is 7893
2022-05-29 20:48:22,988 INFO [decode.py:390] batch 142/?, cuts processed until now is 7978
2022-05-29 20:48:26,883 INFO [decode.py:390] batch 144/?, cuts processed until now is 8056
2022-05-29 20:48:30,895 INFO [decode.py:390] batch 146/?, cuts processed until now is 8097
2022-05-29 20:48:35,200 INFO [decode.py:390] batch 148/?, cuts processed until now is 8139
2022-05-29 20:48:39,085 INFO [decode.py:390] batch 150/?, cuts processed until now is 8206
2022-05-29 20:48:42,702 INFO [decode.py:390] batch 152/?, cuts processed until now is 8280
2022-05-29 20:48:46,346 INFO [decode.py:390] batch 154/?, cuts processed until now is 8412
2022-05-29 20:48:50,117 INFO [decode.py:390] batch 156/?, cuts processed until now is 8538
2022-05-29 20:48:54,290 INFO [decode.py:390] batch 158/?, cuts processed until now is 8588
2022-05-29 20:48:57,980 INFO [decode.py:390] batch 160/?, cuts processed until now is 8657
2022-05-29 20:49:02,141 INFO [decode.py:390] batch 162/?, cuts processed until now is 8713
2022-05-29 20:49:06,247 INFO [decode.py:390] batch 164/?, cuts processed until now is 8788
2022-05-29 20:49:09,813 INFO [decode.py:390] batch 166/?, cuts processed until now is 8895
2022-05-29 20:49:13,355 INFO [decode.py:390] batch 168/?, cuts processed until now is 9019
2022-05-29 20:49:16,961 INFO [decode.py:390] batch 170/?, cuts processed until now is 9157
2022-05-29 20:49:20,507 INFO [decode.py:390] batch 172/?, cuts processed until now is 9295
2022-05-29 20:49:24,046 INFO [decode.py:390] batch 174/?, cuts processed until now is 9556
2022-05-29 20:49:27,976 INFO [decode.py:390] batch 176/?, cuts processed until now is 9775
2022-05-29 20:49:31,949 INFO [decode.py:390] batch 178/?, cuts processed until now is 9838
2022-05-29 20:49:35,550 INFO [decode.py:390] batch 180/?, cuts processed until now is 9912
2022-05-29 20:49:39,273 INFO [decode.py:390] batch 182/?, cuts processed until now is 10046
2022-05-29 20:49:42,770 INFO [decode.py:390] batch 184/?, cuts processed until now is 10255
2022-05-29 20:49:46,313 INFO [decode.py:390] batch 186/?, cuts processed until now is 10441
2022-05-29 20:49:49,818 INFO [decode.py:390] batch 188/?, cuts processed until now is 10598
2022-05-29 20:49:53,363 INFO [decode.py:390] batch 190/?, cuts processed until now is 10859
2022-05-29 20:49:56,869 INFO [decode.py:390] batch 192/?, cuts processed until now is 11138
2022-05-29 20:50:00,564 INFO [decode.py:390] batch 194/?, cuts processed until now is 11271
2022-05-29 20:50:04,322 INFO [decode.py:390] batch 196/?, cuts processed until now is 11329
2022-05-29 20:50:08,069 INFO [decode.py:390] batch 198/?, cuts processed until now is 11386
2022-05-29 20:50:11,738 INFO [decode.py:390] batch 200/?, cuts processed until now is 11459
2022-05-29 20:50:15,436 INFO [decode.py:390] batch 202/?, cuts processed until now is 11532
2022-05-29 20:50:19,082 INFO [decode.py:390] batch 204/?, cuts processed until now is 11619
2022-05-29 20:50:22,723 INFO [decode.py:390] batch 206/?, cuts processed until now is 11739
2022-05-29 20:50:26,723 INFO [decode.py:390] batch 208/?, cuts processed until now is 11816
2022-05-29 20:50:30,735 INFO [decode.py:390] batch 210/?, cuts processed until now is 11866
2022-05-29 20:50:34,709 INFO [decode.py:390] batch 212/?, cuts processed until now is 11915
2022-05-29 20:50:38,627 INFO [decode.py:390] batch 214/?, cuts processed until now is 11981
2022-05-29 20:50:42,231 INFO [decode.py:390] batch 216/?, cuts processed until now is 12056
2022-05-29 20:50:45,897 INFO [decode.py:390] batch 218/?, cuts processed until now is 12112
2022-05-29 20:50:49,543 INFO [decode.py:390] batch 220/?, cuts processed until now is 12176
2022-05-29 20:50:53,063 INFO [decode.py:390] batch 222/?, cuts processed until now is 12317
2022-05-29 20:50:56,673 INFO [decode.py:390] batch 224/?, cuts processed until now is 12459
2022-05-29 20:51:00,845 INFO [decode.py:390] batch 226/?, cuts processed until now is 12513
2022-05-29 20:51:04,703 INFO [decode.py:390] batch 228/?, cuts processed until now is 12638
2022-05-29 20:51:08,369 INFO [decode.py:390] batch 230/?, cuts processed until now is 12771
2022-05-29 20:51:12,401 INFO [decode.py:390] batch 232/?, cuts processed until now is 12818
2022-05-29 20:51:16,374 INFO [decode.py:390] batch 234/?, cuts processed until now is 12872
2022-05-29 20:51:19,981 INFO [decode.py:390] batch 236/?, cuts processed until now is 12969
2022-05-29 20:51:23,590 INFO [decode.py:390] batch 238/?, cuts processed until now is 13089
2022-05-29 20:51:27,148 INFO [decode.py:390] batch 240/?, cuts processed until now is 13322
2022-05-29 20:51:30,636 INFO [decode.py:390] batch 242/?, cuts processed until now is 13552
2022-05-29 20:51:34,229 INFO [decode.py:390] batch 244/?, cuts processed until now is 13704
2022-05-29 20:51:37,869 INFO [decode.py:390] batch 246/?, cuts processed until now is 13869
2022-05-29 20:51:41,503 INFO [decode.py:390] batch 248/?, cuts processed until now is 13967
2022-05-29 20:51:45,074 INFO [decode.py:390] batch 250/?, cuts processed until now is 14082
2022-05-29 20:51:48,638 INFO [decode.py:390] batch 252/?, cuts processed until now is 14198
2022-05-29 20:51:52,348 INFO [decode.py:390] batch 254/?, cuts processed until now is 14268
2022-05-29 20:51:55,966 INFO [decode.py:390] batch 256/?, cuts processed until now is 14468
2022-05-29 20:51:59,471 INFO [decode.py:390] batch 258/?, cuts processed until now is 14758
2022-05-29 20:52:03,024 INFO [decode.py:390] batch 260/?, cuts processed until now is 14943
2022-05-29 20:52:06,650 INFO [decode.py:390] batch 262/?, cuts processed until now is 15063
2022-05-29 20:52:10,127 INFO [decode.py:390] batch 264/?, cuts processed until now is 15285
2022-05-29 20:52:14,102 INFO [decode.py:390] batch 266/?, cuts processed until now is 15487
2022-05-29 20:52:18,128 INFO [decode.py:390] batch 268/?, cuts processed until now is 15535
2022-05-29 20:52:22,511 INFO [decode.py:390] batch 270/?, cuts processed until now is 15630
2022-05-29 20:52:26,120 INFO [decode.py:390] batch 272/?, cuts processed until now is 15923
2022-05-29 20:52:29,560 INFO [decode.py:390] batch 274/?, cuts processed until now is 16173
2022-05-29 20:52:33,172 INFO [decode.py:390] batch 276/?, cuts processed until now is 16327
2022-05-29 20:52:36,724 INFO [decode.py:390] batch 278/?, cuts processed until now is 16451
2022-05-29 20:52:40,318 INFO [decode.py:390] batch 280/?, cuts processed until now is 16557
2022-05-29 20:52:44,050 INFO [decode.py:390] batch 282/?, cuts processed until now is 16663
2022-05-29 20:52:47,675 INFO [decode.py:390] batch 284/?, cuts processed until now is 16773
2022-05-29 20:52:51,258 INFO [decode.py:390] batch 286/?, cuts processed until now is 16882
2022-05-29 20:52:54,831 INFO [decode.py:390] batch 288/?, cuts processed until now is 17137
2022-05-29 20:52:58,353 INFO [decode.py:390] batch 290/?, cuts processed until now is 17488
2022-05-29 20:53:01,940 INFO [decode.py:390] batch 292/?, cuts processed until now is 17705
2022-05-29 20:53:05,506 INFO [decode.py:390] batch 294/?, cuts processed until now is 17811
2022-05-29 20:53:09,121 INFO [decode.py:390] batch 296/?, cuts processed until now is 17949
2022-05-29 20:53:12,804 INFO [decode.py:390] batch 298/?, cuts processed until now is 18053
2022-05-29 20:53:16,471 INFO [decode.py:390] batch 300/?, cuts processed until now is 18125
2022-05-29 20:53:20,099 INFO [decode.py:390] batch 302/?, cuts processed until now is 18347
2022-05-29 20:53:23,635 INFO [decode.py:390] batch 304/?, cuts processed until now is 18700
2022-05-29 20:53:27,698 INFO [decode.py:390] batch 306/?, cuts processed until now is 18910
2022-05-29 20:53:31,864 INFO [decode.py:390] batch 308/?, cuts processed until now is 18954
2022-05-29 20:53:35,482 INFO [decode.py:390] batch 310/?, cuts processed until now is 19061
2022-05-29 20:53:39,096 INFO [decode.py:390] batch 312/?, cuts processed until now is 19176
2022-05-29 20:53:42,689 INFO [decode.py:390] batch 314/?, cuts processed until now is 19291
2022-05-29 20:53:46,313 INFO [decode.py:390] batch 316/?, cuts processed until now is 19414
2022-05-29 20:53:49,858 INFO [decode.py:390] batch 318/?, cuts processed until now is 19536
2022-05-29 20:53:53,459 INFO [decode.py:390] batch 320/?, cuts processed until now is 19650
2022-05-29 20:53:57,147 INFO [decode.py:390] batch 322/?, cuts processed until now is 19719
2022-05-29 20:54:00,853 INFO [decode.py:390] batch 324/?, cuts processed until now is 19779
2022-05-29 20:54:04,590 INFO [decode.py:390] batch 326/?, cuts processed until now is 19867
2022-05-29 20:54:08,084 INFO [decode.py:390] batch 328/?, cuts processed until now is 20093
2022-05-29 20:54:12,016 INFO [decode.py:390] batch 330/?, cuts processed until now is 20298
2022-05-29 20:54:16,297 INFO [decode.py:390] batch 332/?, cuts processed until now is 20341
2022-05-29 20:54:19,999 INFO [decode.py:390] batch 334/?, cuts processed until now is 20556
2022-05-29 20:54:23,557 INFO [decode.py:390] batch 336/?, cuts processed until now is 20807
2022-05-29 20:54:27,204 INFO [decode.py:390] batch 338/?, cuts processed until now is 20912
2022-05-29 20:54:30,873 INFO [decode.py:390] batch 340/?, cuts processed until now is 20977
2022-05-29 20:54:34,479 INFO [decode.py:390] batch 342/?, cuts processed until now is 21054
2022-05-29 20:54:38,201 INFO [decode.py:390] batch 344/?, cuts processed until now is 21114
2022-05-29 20:54:42,223 INFO [decode.py:390] batch 346/?, cuts processed until now is 21159
2022-05-29 20:54:46,053 INFO [decode.py:390] batch 348/?, cuts processed until now is 21227
2022-05-29 20:54:49,720 INFO [decode.py:390] batch 350/?, cuts processed until now is 21312
2022-05-29 20:54:53,447 INFO [decode.py:390] batch 352/?, cuts processed until now is 21375
2022-05-29 20:54:57,030 INFO [decode.py:390] batch 354/?, cuts processed until now is 21632
2022-05-29 20:55:01,199 INFO [decode.py:390] batch 356/?, cuts processed until now is 21704
2022-05-29 20:55:04,730 INFO [decode.py:390] batch 358/?, cuts processed until now is 21933
2022-05-29 20:55:08,944 INFO [decode.py:390] batch 360/?, cuts processed until now is 21987
2022-05-29 20:55:12,676 INFO [decode.py:390] batch 362/?, cuts processed until now is 22041
2022-05-29 20:55:16,399 INFO [decode.py:390] batch 364/?, cuts processed until now is 22139
2022-05-29 20:55:19,904 INFO [decode.py:390] batch 366/?, cuts processed until now is 22368
2022-05-29 20:55:23,574 INFO [decode.py:390] batch 368/?, cuts processed until now is 22428
2022-05-29 20:55:27,485 INFO [decode.py:390] batch 370/?, cuts processed until now is 22477
2022-05-29 20:55:31,554 INFO [decode.py:390] batch 372/?, cuts processed until now is 22525
2022-05-29 20:55:35,124 INFO [decode.py:390] batch 374/?, cuts processed until now is 22776
2022-05-29 20:55:39,033 INFO [decode.py:390] batch 376/?, cuts processed until now is 22987
2022-05-29 20:55:42,736 INFO [decode.py:390] batch 378/?, cuts processed until now is 23050
2022-05-29 20:55:46,780 INFO [decode.py:390] batch 380/?, cuts processed until now is 23102
2022-05-29 20:55:50,800 INFO [decode.py:390] batch 382/?, cuts processed until now is 23150
2022-05-29 20:55:55,078 INFO [decode.py:390] batch 384/?, cuts processed until now is 23191
2022-05-29 20:55:58,840 INFO [decode.py:390] batch 386/?, cuts processed until now is 23245
2022-05-29 20:56:02,519 INFO [decode.py:390] batch 388/?, cuts processed until now is 23310
2022-05-29 20:56:06,488 INFO [decode.py:390] batch 390/?, cuts processed until now is 23366
2022-05-29 20:56:10,759 INFO [decode.py:390] batch 392/?, cuts processed until now is 23410
2022-05-29 20:56:14,464 INFO [decode.py:390] batch 394/?, cuts processed until now is 23473
2022-05-29 20:56:18,056 INFO [decode.py:390] batch 396/?, cuts processed until now is 23590
2022-05-29 20:56:22,242 INFO [decode.py:390] batch 398/?, cuts processed until now is 23634
2022-05-29 20:56:26,166 INFO [decode.py:390] batch 400/?, cuts processed until now is 23683
2022-05-29 20:56:29,817 INFO [decode.py:390] batch 402/?, cuts processed until now is 23911
2022-05-29 20:56:33,781 INFO [decode.py:390] batch 404/?, cuts processed until now is 23963
2022-05-29 20:56:37,478 INFO [decode.py:390] batch 406/?, cuts processed until now is 24026
2022-05-29 20:56:41,190 INFO [decode.py:390] batch 408/?, cuts processed until now is 24090
2022-05-29 20:56:44,806 INFO [decode.py:390] batch 410/?, cuts processed until now is 24152
2022-05-29 20:56:47,628 INFO [decode.py:390] batch 412/?, cuts processed until now is 24195
2022-05-29 20:56:48,709 INFO [decode.py:390] batch 414/?, cuts processed until now is 24229
2022-05-29 20:56:50,223 INFO [decode.py:390] batch 416/?, cuts processed until now is 24307
2022-05-29 20:56:53,720 INFO [decode.py:390] batch 418/?, cuts processed until now is 24384
2022-05-29 20:56:55,294 INFO [decode.py:390] batch 420/?, cuts processed until now is 24410
2022-05-29 20:56:57,161 INFO [decode.py:390] batch 422/?, cuts processed until now is 24452
2022-05-29 20:57:00,089 INFO [decode.py:390] batch 424/?, cuts processed until now is 24498
2022-05-29 20:57:01,518 INFO [decode.py:390] batch 426/?, cuts processed until now is 24520
2022-05-29 20:57:04,205 INFO [decode.py:390] batch 428/?, cuts processed until now is 24763
2022-05-29 20:57:04,812 INFO [decode.py:407] The transcripts are stored in pruned_transducer_stateless2/exp-char-S-4-gpus/modified_beam_search/recogs-TEST_NET-beam_size_4-epoch-29-avg-24-beam-4.txt
2022-05-29 20:57:05,368 INFO [utils.py:406] [TEST_NET-beam_size_4] %WER 24.01% [99819 / 415747, 2519 ins, 20124 del, 77176 sub ]
2022-05-29 20:57:06,837 INFO [decode.py:420] Wrote detailed error stats to pruned_transducer_stateless2/exp-char-S-4-gpus/modified_beam_search/errs-TEST_NET-beam_size_4-epoch-29-avg-24-beam-4.txt
2022-05-29 20:57:06,845 INFO [decode.py:437]
For TEST_NET, WER of different settings are:
beam_size_4 24.01 best for TEST_NET
2022-05-29 20:57:11,914 INFO [decode.py:390] batch 0/?, cuts processed until now is 20
2022-05-29 20:57:15,907 INFO [decode.py:390] batch 2/?, cuts processed until now is 60
2022-05-29 20:57:19,619 INFO [decode.py:390] batch 4/?, cuts processed until now is 150
2022-05-29 20:57:23,334 INFO [decode.py:390] batch 6/?, cuts processed until now is 248
2022-05-29 20:57:27,226 INFO [decode.py:390] batch 8/?, cuts processed until now is 289
2022-05-29 20:57:31,256 INFO [decode.py:390] batch 10/?, cuts processed until now is 321
2022-05-29 20:57:35,137 INFO [decode.py:390] batch 12/?, cuts processed until now is 357
2022-05-29 20:57:39,068 INFO [decode.py:390] batch 14/?, cuts processed until now is 403
2022-05-29 20:57:42,900 INFO [decode.py:390] batch 16/?, cuts processed until now is 445
2022-05-29 20:57:46,767 INFO [decode.py:390] batch 18/?, cuts processed until now is 484
2022-05-29 20:57:50,783 INFO [decode.py:390] batch 20/?, cuts processed until now is 520
2022-05-29 20:57:55,059 INFO [decode.py:390] batch 22/?, cuts processed until now is 563
2022-05-29 20:57:58,909 INFO [decode.py:390] batch 24/?, cuts processed until now is 608
2022-05-29 20:58:02,772 INFO [decode.py:390] batch 26/?, cuts processed until now is 660
2022-05-29 20:58:06,451 INFO [decode.py:390] batch 28/?, cuts processed until now is 722
2022-05-29 20:58:10,178 INFO [decode.py:390] batch 30/?, cuts processed until now is 784
2022-05-29 20:58:13,758 INFO [decode.py:390] batch 32/?, cuts processed until now is 866
2022-05-29 20:58:17,606 INFO [decode.py:390] batch 34/?, cuts processed until now is 925
2022-05-29 20:58:21,642 INFO [decode.py:390] batch 36/?, cuts processed until now is 964
2022-05-29 20:58:25,545 INFO [decode.py:390] batch 38/?, cuts processed until now is 1004
2022-05-29 20:58:29,673 INFO [decode.py:390] batch 40/?, cuts processed until now is 1032
2022-05-29 20:58:33,897 INFO [decode.py:390] batch 42/?, cuts processed until now is 1080
2022-05-29 20:58:37,639 INFO [decode.py:390] batch 44/?, cuts processed until now is 1142
2022-05-29 20:58:41,316 INFO [decode.py:390] batch 46/?, cuts processed until now is 1213
2022-05-29 20:58:44,891 INFO [decode.py:390] batch 48/?, cuts processed until now is 1307
2022-05-29 20:58:48,556 INFO [decode.py:390] batch 50/?, cuts processed until now is 1375
2022-05-29 20:58:52,475 INFO [decode.py:390] batch 52/?, cuts processed until now is 1414
2022-05-29 20:58:56,507 INFO [decode.py:390] batch 54/?, cuts processed until now is 1446
2022-05-29 20:59:00,359 INFO [decode.py:390] batch 56/?, cuts processed until now is 1508
2022-05-29 20:59:04,036 INFO [decode.py:390] batch 58/?, cuts processed until now is 1576
2022-05-29 20:59:07,865 INFO [decode.py:390] batch 60/?, cuts processed until now is 1617
2022-05-29 20:59:11,736 INFO [decode.py:390] batch 62/?, cuts processed until now is 1659
2022-05-29 20:59:15,812 INFO [decode.py:390] batch 64/?, cuts processed until now is 1694
2022-05-29 20:59:19,880 INFO [decode.py:390] batch 66/?, cuts processed until now is 1737
2022-05-29 20:59:23,811 INFO [decode.py:390] batch 68/?, cuts processed until now is 1782
2022-05-29 20:59:27,922 INFO [decode.py:390] batch 70/?, cuts processed until now is 1814
2022-05-29 20:59:31,958 INFO [decode.py:390] batch 72/?, cuts processed until now is 1848
2022-05-29 20:59:36,055 INFO [decode.py:390] batch 74/?, cuts processed until now is 1880
2022-05-29 20:59:39,985 INFO [decode.py:390] batch 76/?, cuts processed until now is 1921
2022-05-29 20:59:43,674 INFO [decode.py:390] batch 78/?, cuts processed until now is 2026
2022-05-29 20:59:47,519 INFO [decode.py:390] batch 80/?, cuts processed until now is 2116
2022-05-29 20:59:51,472 INFO [decode.py:390] batch 82/?, cuts processed until now is 2209
2022-05-29 20:59:55,069 INFO [decode.py:390] batch 84/?, cuts processed until now is 2336
2022-05-29 20:59:58,772 INFO [decode.py:390] batch 86/?, cuts processed until now is 2401
2022-05-29 21:00:02,569 INFO [decode.py:390] batch 88/?, cuts processed until now is 2494
2022-05-29 21:00:06,526 INFO [decode.py:390] batch 90/?, cuts processed until now is 2581
2022-05-29 21:00:10,612 INFO [decode.py:390] batch 92/?, cuts processed until now is 2611
2022-05-29 21:00:14,415 INFO [decode.py:390] batch 94/?, cuts processed until now is 2650
2022-05-29 21:00:18,161 INFO [decode.py:390] batch 96/?, cuts processed until now is 2703
2022-05-29 21:00:22,285 INFO [decode.py:390] batch 98/?, cuts processed until now is 2756
2022-05-29 21:00:26,634 INFO [decode.py:390] batch 100/?, cuts processed until now is 2825
2022-05-29 21:00:30,912 INFO [decode.py:390] batch 102/?, cuts processed until now is 2903
2022-05-29 21:00:35,519 INFO [decode.py:390] batch 104/?, cuts processed until now is 2946
2022-05-29 21:00:40,270 INFO [decode.py:390] batch 106/?, cuts processed until now is 2989
2022-05-29 21:00:44,243 INFO [decode.py:390] batch 108/?, cuts processed until now is 3050
2022-05-29 21:00:47,836 INFO [decode.py:390] batch 110/?, cuts processed until now is 3116
2022-05-29 21:00:51,718 INFO [decode.py:390] batch 112/?, cuts processed until now is 3168
2022-05-29 21:00:55,736 INFO [decode.py:390] batch 114/?, cuts processed until now is 3200
2022-05-29 21:00:59,527 INFO [decode.py:390] batch 116/?, cuts processed until now is 3264
2022-05-29 21:01:03,224 INFO [decode.py:390] batch 118/?, cuts processed until now is 3358
2022-05-29 21:01:06,889 INFO [decode.py:390] batch 120/?, cuts processed until now is 3427
2022-05-29 21:01:10,862 INFO [decode.py:390] batch 122/?, cuts processed until now is 3465
2022-05-29 21:01:14,902 INFO [decode.py:390] batch 124/?, cuts processed until now is 3497
2022-05-29 21:01:18,680 INFO [decode.py:390] batch 126/?, cuts processed until now is 3561
2022-05-29 21:01:22,362 INFO [decode.py:390] batch 128/?, cuts processed until now is 3633
2022-05-29 21:01:26,275 INFO [decode.py:390] batch 130/?, cuts processed until now is 3674
2022-05-29 21:01:30,196 INFO [decode.py:390] batch 132/?, cuts processed until now is 3714
2022-05-29 21:01:33,852 INFO [decode.py:390] batch 134/?, cuts processed until now is 3788
2022-05-29 21:01:37,613 INFO [decode.py:390] batch 136/?, cuts processed until now is 3850
2022-05-29 21:01:41,540 INFO [decode.py:390] batch 138/?, cuts processed until now is 3887
2022-05-29 21:01:45,449 INFO [decode.py:390] batch 140/?, cuts processed until now is 3924
2022-05-29 21:01:49,320 INFO [decode.py:390] batch 142/?, cuts processed until now is 3969
2022-05-29 21:01:53,430 INFO [decode.py:390] batch 144/?, cuts processed until now is 4012
2022-05-29 21:01:57,629 INFO [decode.py:390] batch 146/?, cuts processed until now is 4040
2022-05-29 21:02:01,538 INFO [decode.py:390] batch 148/?, cuts processed until now is 4081
2022-05-29 21:02:05,692 INFO [decode.py:390] batch 150/?, cuts processed until now is 4111
2022-05-29 21:02:09,359 INFO [decode.py:390] batch 152/?, cuts processed until now is 4183
2022-05-29 21:02:13,265 INFO [decode.py:390] batch 154/?, cuts processed until now is 4219
2022-05-29 21:02:17,005 INFO [decode.py:390] batch 156/?, cuts processed until now is 4290
2022-05-29 21:02:20,910 INFO [decode.py:390] batch 158/?, cuts processed until now is 4333
2022-05-29 21:02:24,755 INFO [decode.py:390] batch 160/?, cuts processed until now is 4379
2022-05-29 21:02:28,405 INFO [decode.py:390] batch 162/?, cuts processed until now is 4437
2022-05-29 21:02:32,313 INFO [decode.py:390] batch 164/?, cuts processed until now is 4480
2022-05-29 21:02:35,977 INFO [decode.py:390] batch 166/?, cuts processed until now is 4547
2022-05-29 21:02:39,640 INFO [decode.py:390] batch 168/?, cuts processed until now is 4658
2022-05-29 21:02:43,320 INFO [decode.py:390] batch 170/?, cuts processed until now is 4720
2022-05-29 21:02:47,197 INFO [decode.py:390] batch 172/?, cuts processed until now is 4767
2022-05-29 21:02:50,769 INFO [decode.py:390] batch 174/?, cuts processed until now is 4851
2022-05-29 21:02:54,290 INFO [decode.py:390] batch 176/?, cuts processed until now is 4975
2022-05-29 21:02:58,275 INFO [decode.py:390] batch 178/?, cuts processed until now is 5025
2022-05-29 21:03:01,976 INFO [decode.py:390] batch 180/?, cuts processed until now is 5088
2022-05-29 21:03:05,831 INFO [decode.py:390] batch 182/?, cuts processed until now is 5179
2022-05-29 21:03:09,420 INFO [decode.py:390] batch 184/?, cuts processed until now is 5272
2022-05-29 21:03:13,205 INFO [decode.py:390] batch 186/?, cuts processed until now is 5336
2022-05-29 21:03:17,034 INFO [decode.py:390] batch 188/?, cuts processed until now is 5390
2022-05-29 21:03:20,795 INFO [decode.py:390] batch 190/?, cuts processed until now is 5446
2022-05-29 21:03:24,459 INFO [decode.py:390] batch 192/?, cuts processed until now is 5542
2022-05-29 21:03:28,257 INFO [decode.py:390] batch 194/?, cuts processed until now is 5595
2022-05-29 21:03:32,413 INFO [decode.py:390] batch 196/?, cuts processed until now is 5629
2022-05-29 21:03:36,536 INFO [decode.py:390] batch 198/?, cuts processed until now is 5659
2022-05-29 21:03:40,565 INFO [decode.py:390] batch 200/?, cuts processed until now is 5695
2022-05-29 21:03:44,424 INFO [decode.py:390] batch 202/?, cuts processed until now is 5737
2022-05-29 21:03:48,396 INFO [decode.py:390] batch 204/?, cuts processed until now is 5780
2022-05-29 21:03:52,167 INFO [decode.py:390] batch 206/?, cuts processed until now is 5828
2022-05-29 21:03:55,964 INFO [decode.py:390] batch 208/?, cuts processed until now is 5876
2022-05-29 21:03:59,924 INFO [decode.py:390] batch 210/?, cuts processed until now is 5910
2022-05-29 21:04:04,012 INFO [decode.py:390] batch 212/?, cuts processed until now is 5946
2022-05-29 21:04:08,260 INFO [decode.py:390] batch 214/?, cuts processed until now is 5973
2022-05-29 21:04:12,133 INFO [decode.py:390] batch 216/?, cuts processed until now is 6019
2022-05-29 21:04:15,893 INFO [decode.py:390] batch 218/?, cuts processed until now is 6112
2022-05-29 21:04:19,523 INFO [decode.py:390] batch 220/?, cuts processed until now is 6178
2022-05-29 21:04:23,499 INFO [decode.py:390] batch 222/?, cuts processed until now is 6218
2022-05-29 21:04:27,153 INFO [decode.py:390] batch 224/?, cuts processed until now is 6328
2022-05-29 21:04:31,127 INFO [decode.py:390] batch 226/?, cuts processed until now is 6363
2022-05-29 21:04:34,973 INFO [decode.py:390] batch 228/?, cuts processed until now is 6405
2022-05-29 21:04:39,121 INFO [decode.py:390] batch 230/?, cuts processed until now is 6434
2022-05-29 21:04:42,778 INFO [decode.py:390] batch 232/?, cuts processed until now is 6495
2022-05-29 21:04:46,391 INFO [decode.py:390] batch 234/?, cuts processed until now is 6568
2022-05-29 21:04:50,021 INFO [decode.py:390] batch 236/?, cuts processed until now is 6641
2022-05-29 21:04:53,577 INFO [decode.py:390] batch 238/?, cuts processed until now is 6791
2022-05-29 21:04:57,769 INFO [decode.py:390] batch 240/?, cuts processed until now is 6820
2022-05-29 21:05:01,421 INFO [decode.py:390] batch 242/?, cuts processed until now is 6880
2022-05-29 21:05:05,046 INFO [decode.py:390] batch 244/?, cuts processed until now is 7024
2022-05-29 21:05:08,737 INFO [decode.py:390] batch 246/?, cuts processed until now is 7098
2022-05-29 21:05:12,491 INFO [decode.py:390] batch 248/?, cuts processed until now is 7146
2022-05-29 21:05:16,113 INFO [decode.py:390] batch 250/?, cuts processed until now is 7220
2022-05-29 21:05:20,070 INFO [decode.py:390] batch 252/?, cuts processed until now is 7260
2022-05-29 21:05:24,082 INFO [decode.py:390] batch 254/?, cuts processed until now is 7292
2022-05-29 21:05:27,650 INFO [decode.py:390] batch 256/?, cuts processed until now is 7448
2022-05-29 21:05:31,179 INFO [decode.py:390] batch 258/?, cuts processed until now is 7601
2022-05-29 21:05:34,829 INFO [decode.py:390] batch 260/?, cuts processed until now is 7748
2022-05-29 21:05:38,655 INFO [decode.py:390] batch 262/?, cuts processed until now is 7802
2022-05-29 21:05:42,205 INFO [decode.py:390] batch 264/?, cuts processed until now is 7913
2022-05-29 21:05:45,949 INFO [decode.py:390] batch 266/?, cuts processed until now is 8004
2022-05-29 21:05:49,805 INFO [decode.py:390] batch 268/?, cuts processed until now is 8095
2022-05-29 21:05:51,974 INFO [decode.py:390] batch 270/?, cuts processed until now is 8116
2022-05-29 21:05:55,513 INFO [decode.py:390] batch 272/?, cuts processed until now is 8157
2022-05-29 21:05:57,795 INFO [decode.py:390] batch 274/?, cuts processed until now is 8180
2022-05-29 21:06:00,220 INFO [decode.py:390] batch 276/?, cuts processed until now is 8202
2022-05-29 21:06:02,266 INFO [decode.py:390] batch 278/?, cuts processed until now is 8235
2022-05-29 21:06:03,938 INFO [decode.py:390] batch 280/?, cuts processed until now is 8260
2022-05-29 21:06:06,307 INFO [decode.py:390] batch 282/?, cuts processed until now is 8296
2022-05-29 21:06:07,467 INFO [decode.py:390] batch 284/?, cuts processed until now is 8318
2022-05-29 21:06:09,423 INFO [decode.py:390] batch 286/?, cuts processed until now is 8344
2022-05-29 21:06:10,275 INFO [decode.py:390] batch 288/?, cuts processed until now is 8346
2022-05-29 21:06:12,302 INFO [decode.py:390] batch 290/?, cuts processed until now is 8366
2022-05-29 21:06:13,531 INFO [decode.py:407] The transcripts are stored in pruned_transducer_stateless2/exp-char-S-4-gpus/modified_beam_search/recogs-TEST_MEETING-beam_size_4-epoch-29-avg-24-beam-4.txt
2022-05-29 21:06:13,816 INFO [utils.py:406] [TEST_MEETING-beam_size_4] %WER 34.05% [75038 / 220385, 1792 ins, 26811 del, 46435 sub ]
2022-05-29 21:06:14,603 INFO [decode.py:420] Wrote detailed error stats to pruned_transducer_stateless2/exp-char-S-4-gpus/modified_beam_search/errs-TEST_MEETING-beam_size_4-epoch-29-avg-24-beam-4.txt
2022-05-29 21:06:14,611 INFO [decode.py:437]
For TEST_MEETING, WER of different settings are:
beam_size_4 34.05 best for TEST_MEETING
2022-05-29 21:06:14,611 INFO [decode.py:617] Done!