log/modified_beam_search/log-decode-epoch-29-avg-16-beam-4-2022-03-02-11-25-20

2022-03-02 11:25:20,873 INFO [decode.py:416] Decoding started
2022-03-02 11:25:20,873 INFO [decode.py:422] Device: cuda:0
2022-03-02 11:25:20,883 INFO [decode.py:432] {'feature_dim': 80, 'encoder_out_dim': 512, 'subsampling_factor': 4, 'attention_dim': 512, 'nhead': 8, 'dim_feedforward': 2048, 'num_encoder_layers': 12, 'vgg_frontend': False, 'env_info': {'k2-version': '1.11', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': 'd6323d5fe6ae70eb36432e2e26018928e669b7ac', 'k2-git-date': 'Mon Jan 17 10:33:23 2022', 'lhotse-version': '1.0.0.dev+git.2a116ff.dirty', 'torch-cuda-available': True, 'torch-cuda-version': '10.1', 'python-version': '3.8', 'icefall-git-branch': 'tedlium3-transducer-stateless', 'icefall-git-sha1': 'ac7c2d8-dirty', 'icefall-git-date': 'Wed Feb 23 08:33:20 2022', 'icefall-path': '/ceph-meixu/luomingshuang/icefall', 'k2-path': '/ceph-meixu/luomingshuang/k2/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-meixu/luomingshuang/anaconda3/envs/k2-python/lib/python3.8/site-packages/lhotse-1.0.0.dev0+git.2a116ff.dirty-py3.8.egg/lhotse/__init__.py', 'hostname': 'de-74279-k2-dev-6-1217190258-77fd9bbbc8-d7dpq', 'IP address': '10.48.40.206'}, 'epoch': 29, 'avg': 16, 'exp_dir': PosixPath('transducer_stateless/exp-4-gpu-new'), 'bpe_model': 'data/lang_bpe_500/bpe.model', 'decoding_method': 'modified_beam_search', 'beam_size': 4, 'context_size': 2, 'max_sym_per_frame': 3, 'manifest_dir': PosixPath('data/fbank'), 'max_duration': 200.0, 'bucketing_sampler': True, 'num_buckets': 30, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'res_dir': PosixPath('transducer_stateless/exp-4-gpu-new/modified_beam_search'), 'suffix': 'epoch-29-avg-16-beam-4', 'blank_id': 0, 'unk_id': 2, 'vocab_size': 500}
2022-03-02 11:25:20,884 INFO [decode.py:434] About to create model
2022-03-02 11:25:21,503 INFO [decode.py:445] averaging ['transducer_stateless/exp-4-gpu-new/epoch-14.pt', 'transducer_stateless/exp-4-gpu-new/epoch-15.pt', 'transducer_stateless/exp-4-gpu-new/epoch-16.pt', 'transducer_stateless/exp-4-gpu-new/epoch-17.pt', 'transducer_stateless/exp-4-gpu-new/epoch-18.pt', 'transducer_stateless/exp-4-gpu-new/epoch-19.pt', 'transducer_stateless/exp-4-gpu-new/epoch-20.pt', 'transducer_stateless/exp-4-gpu-new/epoch-21.pt', 'transducer_stateless/exp-4-gpu-new/epoch-22.pt', 'transducer_stateless/exp-4-gpu-new/epoch-23.pt', 'transducer_stateless/exp-4-gpu-new/epoch-24.pt', 'transducer_stateless/exp-4-gpu-new/epoch-25.pt', 'transducer_stateless/exp-4-gpu-new/epoch-26.pt', 'transducer_stateless/exp-4-gpu-new/epoch-27.pt', 'transducer_stateless/exp-4-gpu-new/epoch-28.pt', 'transducer_stateless/exp-4-gpu-new/epoch-29.pt']
2022-03-02 11:25:39,165 INFO [decode.py:454] Number of model parameters: 84007924
2022-03-02 11:25:39,165 INFO [asr_datamodule.py:350] About to get dev cuts
2022-03-02 11:25:39,198 INFO [asr_datamodule.py:355] About to get test cuts
2022-03-02 11:25:39,258 INFO [asr_datamodule.py:293] About to create dev dataset
2022-03-02 11:25:39,260 INFO [asr_datamodule.py:312] About to create dev dataloader
2022-03-02 11:25:43,016 INFO [decode.py:341] batch 0/?, cuts processed until now is 22
2022-03-02 11:25:49,245 INFO [decode.py:341] batch 2/?, cuts processed until now is 69
2022-03-02 11:25:56,523 INFO [decode.py:341] batch 4/?, cuts processed until now is 94
2022-03-02 11:26:01,455 INFO [decode.py:341] batch 6/?, cuts processed until now is 126
2022-03-02 11:26:07,958 INFO [decode.py:341] batch 8/?, cuts processed until now is 148
2022-03-02 11:26:14,249 INFO [decode.py:341] batch 10/?, cuts processed until now is 188
2022-03-02 11:26:20,949 INFO [decode.py:341] batch 12/?, cuts processed until now is 201
2022-03-02 11:26:27,922 INFO [decode.py:341] batch 14/?, cuts processed until now is 224
2022-03-02 11:26:32,768 INFO [decode.py:341] batch 16/?, cuts processed until now is 243
2022-03-02 11:26:39,312 INFO [decode.py:341] batch 18/?, cuts processed until now is 278
2022-03-02 11:26:45,808 INFO [decode.py:341] batch 20/?, cuts processed until now is 314
2022-03-02 11:26:51,964 INFO [decode.py:341] batch 22/?, cuts processed until now is 359
2022-03-02 11:26:57,142 INFO [decode.py:341] batch 24/?, cuts processed until now is 380
2022-03-02 11:27:02,297 INFO [decode.py:341] batch 26/?, cuts processed until now is 401
2022-03-02 11:27:06,347 INFO [decode.py:341] batch 28/?, cuts processed until now is 425
2022-03-02 11:27:11,996 INFO [decode.py:341] batch 30/?, cuts processed until now is 445
2022-03-02 11:27:15,993 INFO [decode.py:341] batch 32/?, cuts processed until now is 457
2022-03-02 11:27:18,521 INFO [decode.py:358] The transcripts are stored in transducer_stateless/exp-4-gpu-new/modified_beam_search/recogs-dev-beam_4-epoch-29-avg-16-beam-4.txt
2022-03-02 11:27:18,548 INFO [utils.py:404] [dev-beam_4] %WER 7.00% [1276 / 18226, 202 ins, 408 del, 666 sub ]
2022-03-02 11:27:18,621 INFO [decode.py:371] Wrote detailed error stats to transducer_stateless/exp-4-gpu-new/modified_beam_search/errs-dev-beam_4-epoch-29-avg-16-beam-4.txt
2022-03-02 11:27:18,629 INFO [decode.py:388] 
For dev, WER of different settings are:
beam_4	7.0	best for dev

2022-03-02 11:27:22,234 INFO [decode.py:341] batch 0/?, cuts processed until now is 29
2022-03-02 11:27:28,220 INFO [decode.py:341] batch 2/?, cuts processed until now is 107
2022-03-02 11:27:34,441 INFO [decode.py:341] batch 4/?, cuts processed until now is 140
2022-03-02 11:27:40,347 INFO [decode.py:341] batch 6/?, cuts processed until now is 216
2022-03-02 11:27:46,625 INFO [decode.py:341] batch 8/?, cuts processed until now is 246
2022-03-02 11:27:52,897 INFO [decode.py:341] batch 10/?, cuts processed until now is 304
2022-03-02 11:27:59,337 INFO [decode.py:341] batch 12/?, cuts processed until now is 320
2022-03-02 11:28:05,790 INFO [decode.py:341] batch 14/?, cuts processed until now is 351
2022-03-02 11:28:12,044 INFO [decode.py:341] batch 16/?, cuts processed until now is 393
2022-03-02 11:28:18,171 INFO [decode.py:341] batch 18/?, cuts processed until now is 434
2022-03-02 11:28:24,565 INFO [decode.py:341] batch 20/?, cuts processed until now is 465
2022-03-02 11:28:30,670 INFO [decode.py:341] batch 22/?, cuts processed until now is 583
2022-03-02 11:28:37,255 INFO [decode.py:341] batch 24/?, cuts processed until now is 624
2022-03-02 11:28:43,581 INFO [decode.py:341] batch 26/?, cuts processed until now is 658
2022-03-02 11:28:50,087 INFO [decode.py:341] batch 28/?, cuts processed until now is 699
2022-03-02 11:28:56,305 INFO [decode.py:341] batch 30/?, cuts processed until now is 738
2022-03-02 11:29:02,537 INFO [decode.py:341] batch 32/?, cuts processed until now is 794
2022-03-02 11:29:07,438 INFO [decode.py:341] batch 34/?, cuts processed until now is 836
2022-03-02 11:29:13,738 INFO [decode.py:341] batch 36/?, cuts processed until now is 881
2022-03-02 11:29:20,810 INFO [decode.py:341] batch 38/?, cuts processed until now is 907
2022-03-02 11:29:24,185 INFO [decode.py:341] batch 40/?, cuts processed until now is 943
2022-03-02 11:29:29,528 INFO [decode.py:341] batch 42/?, cuts processed until now is 979
2022-03-02 11:29:36,740 INFO [decode.py:341] batch 44/?, cuts processed until now is 1011
2022-03-02 11:29:42,860 INFO [decode.py:341] batch 46/?, cuts processed until now is 1068
2022-03-02 11:29:47,492 INFO [decode.py:341] batch 48/?, cuts processed until now is 1084
2022-03-02 11:29:52,941 INFO [decode.py:341] batch 50/?, cuts processed until now is 1113
2022-03-02 11:29:56,544 INFO [decode.py:341] batch 52/?, cuts processed until now is 1155
2022-03-02 11:29:56,824 INFO [decode.py:358] The transcripts are stored in transducer_stateless/exp-4-gpu-new/modified_beam_search/recogs-test-beam_4-epoch-29-avg-16-beam-4.txt
2022-03-02 11:29:56,871 INFO [utils.py:404] [test-beam_4] %WER 6.19% [1761 / 28430, 219 ins, 625 del, 917 sub ]
2022-03-02 11:29:56,974 INFO [decode.py:371] Wrote detailed error stats to transducer_stateless/exp-4-gpu-new/modified_beam_search/errs-test-beam_4-epoch-29-avg-16-beam-4.txt
2022-03-02 11:29:56,983 INFO [decode.py:388] 
For test, WER of different settings are:
beam_4	6.19	best for test

2022-03-02 11:29:56,983 INFO [decode.py:480] Done!