log/modified_beam_search/log-decode-epoch-29-avg-13-beam-4-2022-03-21-16-57-34

2022-03-21 16:57:34,038 INFO [decode.py:427] Decoding started
2022-03-21 16:57:34,039 INFO [decode.py:433] Device: cuda:0
2022-03-21 16:57:34,041 INFO [decode.py:443] {'feature_dim': 80, 'subsampling_factor': 4, 'attention_dim': 512, 'nhead': 8, 'dim_feedforward': 2048, 'num_encoder_layers': 12, 'vgg_frontend': False, 'embedding_dim': 512, 'env_info': {'k2-version': '1.13', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': '5ee082ea55f50e8bd42203ba266945ea5a236ab8', 'k2-git-date': 'Sun Feb 27 09:00:48 2022', 'lhotse-version': '1.0.0.dev+git.d917411.clean', 'torch-cuda-available': True, 'torch-cuda-version': '10.1', 'python-version': '3.8', 'icefall-git-branch': 'tedlium3-pruned-transducer-stateless-recipe', 'icefall-git-sha1': 'ad28c8c-dirty', 'icefall-git-date': 'Fri Mar 18 11:39:06 2022', 'icefall-path': '/ceph-meixu/luomingshuang/icefall', 'k2-path': '/ceph-meixu/luomingshuang/k2/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-meixu/luomingshuang/anaconda3/envs/k2-python/lib/python3.8/site-packages/lhotse-1.0.0.dev0+git.d917411.clean-py3.8.egg/lhotse/__init__.py', 'hostname': 'de-74279-k2-train-2-0307200233-b554c565c-lf9qd', 'IP address': '10.177.74.201'}, 'epoch': 29, 'avg': 13, 'exp_dir': PosixPath('pruned_transducer_stateless/exp'), 'bpe_model': 'data/lang_bpe_500/bpe.model', 'decoding_method': 'modified_beam_search', 'beam_size': 4, 'context_size': 2, 'max_sym_per_frame': 3, 'manifest_dir': PosixPath('data/fbank'), 'max_duration': 200.0, 'bucketing_sampler': True, 'num_buckets': 30, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'res_dir': PosixPath('pruned_transducer_stateless/exp/modified_beam_search'), 'suffix': 'epoch-29-avg-13-beam-4', 'blank_id': 0, 'unk_id': 2, 'vocab_size': 500}
2022-03-21 16:57:34,042 INFO [decode.py:445] About to create model
2022-03-21 16:57:34,689 INFO [decode.py:456] averaging ['pruned_transducer_stateless/exp/epoch-17.pt', 'pruned_transducer_stateless/exp/epoch-18.pt', 'pruned_transducer_stateless/exp/epoch-19.pt', 'pruned_transducer_stateless/exp/epoch-20.pt', 'pruned_transducer_stateless/exp/epoch-21.pt', 'pruned_transducer_stateless/exp/epoch-22.pt', 'pruned_transducer_stateless/exp/epoch-23.pt', 'pruned_transducer_stateless/exp/epoch-24.pt', 'pruned_transducer_stateless/exp/epoch-25.pt', 'pruned_transducer_stateless/exp/epoch-26.pt', 'pruned_transducer_stateless/exp/epoch-27.pt', 'pruned_transducer_stateless/exp/epoch-28.pt', 'pruned_transducer_stateless/exp/epoch-29.pt']
2022-03-21 16:58:25,221 INFO [decode.py:465] Number of model parameters: 84514780
2022-03-21 16:58:25,222 INFO [asr_datamodule.py:357] About to get dev cuts
2022-03-21 16:58:25,253 INFO [asr_datamodule.py:362] About to get test cuts
2022-03-21 16:58:25,323 INFO [asr_datamodule.py:300] About to create dev dataset
2022-03-21 16:58:25,324 INFO [asr_datamodule.py:319] About to create dev dataloader
2022-03-21 16:58:31,243 INFO [decode.py:352] batch 0/?, cuts processed until now is 22
2022-03-21 16:58:42,078 INFO [decode.py:352] batch 2/?, cuts processed until now is 69
2022-03-21 16:58:52,943 INFO [decode.py:352] batch 4/?, cuts processed until now is 94
2022-03-21 16:59:00,982 INFO [decode.py:352] batch 6/?, cuts processed until now is 126
2022-03-21 16:59:11,292 INFO [decode.py:352] batch 8/?, cuts processed until now is 148
2022-03-21 16:59:22,146 INFO [decode.py:352] batch 10/?, cuts processed until now is 188
2022-03-21 16:59:32,590 INFO [decode.py:352] batch 12/?, cuts processed until now is 201
2022-03-21 16:59:42,641 INFO [decode.py:352] batch 14/?, cuts processed until now is 224
2022-03-21 16:59:49,883 INFO [decode.py:352] batch 16/?, cuts processed until now is 243
2022-03-21 17:00:00,443 INFO [decode.py:352] batch 18/?, cuts processed until now is 278
2022-03-21 17:00:11,335 INFO [decode.py:352] batch 20/?, cuts processed until now is 314
2022-03-21 17:00:21,748 INFO [decode.py:352] batch 22/?, cuts processed until now is 359
2022-03-21 17:00:30,249 INFO [decode.py:352] batch 24/?, cuts processed until now is 380
2022-03-21 17:00:38,706 INFO [decode.py:352] batch 26/?, cuts processed until now is 401
2022-03-21 17:00:45,626 INFO [decode.py:352] batch 28/?, cuts processed until now is 425
2022-03-21 17:00:54,943 INFO [decode.py:352] batch 30/?, cuts processed until now is 445
2022-03-21 17:01:01,447 INFO [decode.py:352] batch 32/?, cuts processed until now is 457
2022-03-21 17:01:05,423 INFO [decode.py:369] The transcripts are stored in pruned_transducer_stateless/exp/modified_beam_search/recogs-dev-beam_4-epoch-29-avg-13-beam-4.txt
2022-03-21 17:01:05,455 INFO [utils.py:406] [dev-beam_4] %WER 6.72% [1225 / 18226, 175 ins, 397 del, 653 sub ]
2022-03-21 17:01:05,535 INFO [decode.py:382] Wrote detailed error stats to pruned_transducer_stateless/exp/modified_beam_search/errs-dev-beam_4-epoch-29-avg-13-beam-4.txt
2022-03-21 17:01:05,535 INFO [decode.py:399] 
For dev, WER of different settings are:
beam_4	6.72	best for dev

2022-03-21 17:01:11,300 INFO [decode.py:352] batch 0/?, cuts processed until now is 29
2022-03-21 17:01:22,172 INFO [decode.py:352] batch 2/?, cuts processed until now is 107
2022-03-21 17:01:32,987 INFO [decode.py:352] batch 4/?, cuts processed until now is 140
2022-03-21 17:01:42,837 INFO [decode.py:352] batch 6/?, cuts processed until now is 216
2022-03-21 17:01:53,801 INFO [decode.py:352] batch 8/?, cuts processed until now is 246
2022-03-21 17:02:04,846 INFO [decode.py:352] batch 10/?, cuts processed until now is 304
2022-03-21 17:02:15,147 INFO [decode.py:352] batch 12/?, cuts processed until now is 320
2022-03-21 17:02:25,857 INFO [decode.py:352] batch 14/?, cuts processed until now is 351
2022-03-21 17:02:36,852 INFO [decode.py:352] batch 16/?, cuts processed until now is 393
2022-03-21 17:02:47,304 INFO [decode.py:352] batch 18/?, cuts processed until now is 434
2022-03-21 17:02:57,987 INFO [decode.py:352] batch 20/?, cuts processed until now is 465
2022-03-21 17:03:07,180 INFO [decode.py:352] batch 22/?, cuts processed until now is 583
2022-03-21 17:03:17,898 INFO [decode.py:352] batch 24/?, cuts processed until now is 624
2022-03-21 17:03:28,845 INFO [decode.py:352] batch 26/?, cuts processed until now is 658
2022-03-21 17:03:39,757 INFO [decode.py:352] batch 28/?, cuts processed until now is 699
2022-03-21 17:03:50,155 INFO [decode.py:352] batch 30/?, cuts processed until now is 738
2022-03-21 17:04:01,078 INFO [decode.py:352] batch 32/?, cuts processed until now is 794
2022-03-21 17:04:09,367 INFO [decode.py:352] batch 34/?, cuts processed until now is 836
2022-03-21 17:04:19,291 INFO [decode.py:352] batch 36/?, cuts processed until now is 881
2022-03-21 17:04:26,154 INFO [decode.py:352] batch 38/?, cuts processed until now is 907
2022-03-21 17:04:29,678 INFO [decode.py:352] batch 40/?, cuts processed until now is 943
2022-03-21 17:04:34,928 INFO [decode.py:352] batch 42/?, cuts processed until now is 979
2022-03-21 17:04:41,495 INFO [decode.py:352] batch 44/?, cuts processed until now is 1011
2022-03-21 17:04:46,178 INFO [decode.py:352] batch 46/?, cuts processed until now is 1068
2022-03-21 17:04:49,535 INFO [decode.py:352] batch 48/?, cuts processed until now is 1084
2022-03-21 17:04:55,171 INFO [decode.py:352] batch 50/?, cuts processed until now is 1113
2022-03-21 17:04:58,825 INFO [decode.py:352] batch 52/?, cuts processed until now is 1155
2022-03-21 17:04:58,950 INFO [decode.py:369] The transcripts are stored in pruned_transducer_stateless/exp/modified_beam_search/recogs-test-beam_4-epoch-29-avg-13-beam-4.txt
2022-03-21 17:04:58,989 INFO [utils.py:406] [test-beam_4] %WER 6.12% [1741 / 28430, 202 ins, 643 del, 896 sub ]
2022-03-21 17:04:59,118 INFO [decode.py:382] Wrote detailed error stats to pruned_transducer_stateless/exp/modified_beam_search/errs-test-beam_4-epoch-29-avg-13-beam-4.txt
2022-03-21 17:04:59,119 INFO [decode.py:399] 
For test, WER of different settings are:
beam_4	6.12	best for test

2022-03-21 17:04:59,119 INFO [decode.py:491] Done!