icefall_asr_tedlium3_pruned_transducer_stateless / log /beam_search /log-decode-epoch-29-avg-13-beam-4-2022-03-21-17-40-20
luomingshuang's picture
add tedlium3-pruned-transducer-stateless files
70628de
2022-03-21 17:40:20,878 INFO [decode.py:427] Decoding started
2022-03-21 17:40:20,878 INFO [decode.py:433] Device: cuda:0
2022-03-21 17:40:20,880 INFO [decode.py:443] {'feature_dim': 80, 'subsampling_factor': 4, 'attention_dim': 512, 'nhead': 8, 'dim_feedforward': 2048, 'num_encoder_layers': 12, 'vgg_frontend': False, 'embedding_dim': 512, 'env_info': {'k2-version': '1.13', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': '5ee082ea55f50e8bd42203ba266945ea5a236ab8', 'k2-git-date': 'Sun Feb 27 09:00:48 2022', 'lhotse-version': '1.0.0.dev+git.d917411.clean', 'torch-cuda-available': True, 'torch-cuda-version': '10.1', 'python-version': '3.8', 'icefall-git-branch': 'tedlium3-pruned-transducer-stateless-recipe', 'icefall-git-sha1': 'ad28c8c-dirty', 'icefall-git-date': 'Fri Mar 18 11:39:06 2022', 'icefall-path': '/ceph-meixu/luomingshuang/icefall', 'k2-path': '/ceph-meixu/luomingshuang/k2/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-meixu/luomingshuang/anaconda3/envs/k2-python/lib/python3.8/site-packages/lhotse-1.0.0.dev0+git.d917411.clean-py3.8.egg/lhotse/__init__.py', 'hostname': 'de-74279-k2-train-2-0307200233-b554c565c-lf9qd', 'IP address': '10.177.74.201'}, 'epoch': 29, 'avg': 13, 'exp_dir': PosixPath('pruned_transducer_stateless/exp'), 'bpe_model': 'data/lang_bpe_500/bpe.model', 'decoding_method': 'beam_search', 'beam_size': 4, 'context_size': 2, 'max_sym_per_frame': 3, 'manifest_dir': PosixPath('data/fbank'), 'max_duration': 200.0, 'bucketing_sampler': True, 'num_buckets': 30, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'res_dir': PosixPath('pruned_transducer_stateless/exp/beam_search'), 'suffix': 'epoch-29-avg-13-beam-4', 'blank_id': 0, 'unk_id': 2, 'vocab_size': 500}
2022-03-21 17:40:20,880 INFO [decode.py:445] About to create model
2022-03-21 17:40:21,494 INFO [decode.py:456] averaging ['pruned_transducer_stateless/exp/epoch-17.pt', 'pruned_transducer_stateless/exp/epoch-18.pt', 'pruned_transducer_stateless/exp/epoch-19.pt', 'pruned_transducer_stateless/exp/epoch-20.pt', 'pruned_transducer_stateless/exp/epoch-21.pt', 'pruned_transducer_stateless/exp/epoch-22.pt', 'pruned_transducer_stateless/exp/epoch-23.pt', 'pruned_transducer_stateless/exp/epoch-24.pt', 'pruned_transducer_stateless/exp/epoch-25.pt', 'pruned_transducer_stateless/exp/epoch-26.pt', 'pruned_transducer_stateless/exp/epoch-27.pt', 'pruned_transducer_stateless/exp/epoch-28.pt', 'pruned_transducer_stateless/exp/epoch-29.pt']
2022-03-21 17:41:03,798 INFO [decode.py:465] Number of model parameters: 84514780
2022-03-21 17:41:03,798 INFO [asr_datamodule.py:357] About to get dev cuts
2022-03-21 17:41:03,824 INFO [asr_datamodule.py:362] About to get test cuts
2022-03-21 17:41:03,877 INFO [asr_datamodule.py:300] About to create dev dataset
2022-03-21 17:41:03,878 INFO [asr_datamodule.py:319] About to create dev dataloader
2022-03-21 17:41:18,426 INFO [decode.py:352] batch 0/?, cuts processed until now is 22
2022-03-21 17:41:47,198 INFO [decode.py:352] batch 2/?, cuts processed until now is 69
2022-03-21 17:42:17,014 INFO [decode.py:352] batch 4/?, cuts processed until now is 94
2022-03-21 17:42:38,356 INFO [decode.py:352] batch 6/?, cuts processed until now is 126
2022-03-21 17:43:07,763 INFO [decode.py:352] batch 8/?, cuts processed until now is 148
2022-03-21 17:43:34,568 INFO [decode.py:352] batch 10/?, cuts processed until now is 188
2022-03-21 17:44:08,157 INFO [decode.py:352] batch 12/?, cuts processed until now is 201
2022-03-21 17:44:38,968 INFO [decode.py:352] batch 14/?, cuts processed until now is 224
2022-03-21 17:44:59,567 INFO [decode.py:352] batch 16/?, cuts processed until now is 243
2022-03-21 17:45:28,356 INFO [decode.py:352] batch 18/?, cuts processed until now is 278
2022-03-21 17:45:57,868 INFO [decode.py:352] batch 20/?, cuts processed until now is 314
2022-03-21 17:46:24,161 INFO [decode.py:352] batch 22/?, cuts processed until now is 359
2022-03-21 17:46:48,186 INFO [decode.py:352] batch 24/?, cuts processed until now is 380
2022-03-21 17:47:12,656 INFO [decode.py:352] batch 26/?, cuts processed until now is 401
2022-03-21 17:47:32,501 INFO [decode.py:352] batch 28/?, cuts processed until now is 425
2022-03-21 17:47:59,243 INFO [decode.py:352] batch 30/?, cuts processed until now is 445
2022-03-21 17:48:18,201 INFO [decode.py:352] batch 32/?, cuts processed until now is 457
2022-03-21 17:48:27,738 INFO [decode.py:369] The transcripts are stored in pruned_transducer_stateless/exp/beam_search/recogs-dev-beam_4-epoch-29-avg-13-beam-4.txt
2022-03-21 17:48:27,768 INFO [utils.py:406] [dev-beam_4] %WER 6.70% [1221 / 18226, 187 ins, 378 del, 656 sub ]
2022-03-21 17:48:27,851 INFO [decode.py:382] Wrote detailed error stats to pruned_transducer_stateless/exp/beam_search/errs-dev-beam_4-epoch-29-avg-13-beam-4.txt
2022-03-21 17:48:27,852 INFO [decode.py:399]
For dev, WER of different settings are:
beam_4 6.7 best for dev
2022-03-21 17:48:42,194 INFO [decode.py:352] batch 0/?, cuts processed until now is 29
2022-03-21 17:49:09,860 INFO [decode.py:352] batch 2/?, cuts processed until now is 107
2022-03-21 17:49:37,820 INFO [decode.py:352] batch 4/?, cuts processed until now is 140
2022-03-21 17:50:03,444 INFO [decode.py:352] batch 6/?, cuts processed until now is 216
2022-03-21 17:50:32,865 INFO [decode.py:352] batch 8/?, cuts processed until now is 246
2022-03-21 17:50:59,370 INFO [decode.py:352] batch 10/?, cuts processed until now is 304
2022-03-21 17:51:30,258 INFO [decode.py:352] batch 12/?, cuts processed until now is 320
2022-03-21 17:51:59,659 INFO [decode.py:352] batch 14/?, cuts processed until now is 351
2022-03-21 17:52:27,258 INFO [decode.py:352] batch 16/?, cuts processed until now is 393
2022-03-21 17:52:54,338 INFO [decode.py:352] batch 18/?, cuts processed until now is 434
2022-03-21 17:53:23,627 INFO [decode.py:352] batch 20/?, cuts processed until now is 465
2022-03-21 17:53:46,037 INFO [decode.py:352] batch 22/?, cuts processed until now is 583
2022-03-21 17:54:13,663 INFO [decode.py:352] batch 24/?, cuts processed until now is 624
2022-03-21 17:54:41,276 INFO [decode.py:352] batch 26/?, cuts processed until now is 658
2022-03-21 17:55:09,769 INFO [decode.py:352] batch 28/?, cuts processed until now is 699
2022-03-21 17:55:37,868 INFO [decode.py:352] batch 30/?, cuts processed until now is 738
2022-03-21 17:56:05,526 INFO [decode.py:352] batch 32/?, cuts processed until now is 794
2022-03-21 17:56:26,775 INFO [decode.py:352] batch 34/?, cuts processed until now is 836
2022-03-21 17:56:54,645 INFO [decode.py:352] batch 36/?, cuts processed until now is 881
2022-03-21 17:57:23,873 INFO [decode.py:352] batch 38/?, cuts processed until now is 907
2022-03-21 17:57:38,814 INFO [decode.py:352] batch 40/?, cuts processed until now is 943
2022-03-21 17:58:01,999 INFO [decode.py:352] batch 42/?, cuts processed until now is 979
2022-03-21 17:58:30,187 INFO [decode.py:352] batch 44/?, cuts processed until now is 1011
2022-03-21 17:58:50,432 INFO [decode.py:352] batch 46/?, cuts processed until now is 1068
2022-03-21 17:59:06,546 INFO [decode.py:352] batch 48/?, cuts processed until now is 1084
2022-03-21 17:59:31,094 INFO [decode.py:352] batch 50/?, cuts processed until now is 1113
2022-03-21 17:59:47,050 INFO [decode.py:352] batch 52/?, cuts processed until now is 1155
2022-03-21 17:59:47,184 INFO [decode.py:369] The transcripts are stored in pruned_transducer_stateless/exp/beam_search/recogs-test-beam_4-epoch-29-avg-13-beam-4.txt
2022-03-21 17:59:47,231 INFO [utils.py:406] [test-beam_4] %WER 6.04% [1717 / 28430, 219 ins, 602 del, 896 sub ]
2022-03-21 17:59:47,357 INFO [decode.py:382] Wrote detailed error stats to pruned_transducer_stateless/exp/beam_search/errs-test-beam_4-epoch-29-avg-13-beam-4.txt
2022-03-21 17:59:47,358 INFO [decode.py:399]
For test, WER of different settings are:
beam_4 6.04 best for test
2022-03-21 17:59:47,358 INFO [decode.py:491] Done!