log/log-nbest/log-decode-2022-07-20-21-02-14

2022-07-20 21:02:14,473 INFO [decode.py:653] Decoding started
2022-07-20 21:02:14,473 INFO [decode.py:654] {'subsampling_factor': 4, 'feature_dim': 80, 'nhead': 8, 'dim_feedforward': 2048, 'encoder_dim': 512, 'num_encoder_layers': 12, 'search_beam': 20, 'output_beam': 8, 'min_active_states': 30, 'max_active_states': 10000, 'use_double_scores': True, 'env_info': {'k2-version': '1.15.1', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': '350e449fe5d7b4231f77eb0add764782eed9f5d2', 'k2-git-date': 'Thu May 26 22:56:24 2022', 'lhotse-version': '1.3.0.dev+git.232f3eb.dirty', 'torch-version': '1.10.0+cu102', 'torch-cuda-available': True, 'torch-cuda-version': '10.2', 'python-version': '3.8', 'icefall-git-branch': 'conformer_ctc2', 'icefall-git-sha1': 'd812f82-dirty', 'icefall-git-date': 'Wed Jul 20 19:47:36 2022', 'icefall-path': '/home/storage23/wangquandong/experiment/open_source/icefall', 'k2-path': '/home/storage23/wangquandong/tools/k2/k2/python/k2/__init__.py', 'lhotse-path': '/home/storage23/wangquandong/tools/lhotse/lhotse/__init__.py', 'hostname': 'tj1-asr-train-v100-30.kscn', 'IP address': '10.38.22.183'}, 'epoch': 30, 'iter': 0, 'avg': 8, 'method': 'nbest', 'use_averaged_model': True, 'num_decoder_layers': 6, 'num_paths': 100, 'nbest_scale': 0.5, 'exp_dir': PosixPath('pruned_transducer_stateless_smooth/quandongtest_8gpu_ctc_attnetion2-exp'), 'lang_dir': PosixPath('data/lang_bpe_500'), 'lm_dir': PosixPath('data/lm'), 'full_libri': True, 'manifest_dir': PosixPath('data/fbank'), 'max_duration': 20, 'bucketing_sampler': True, 'num_buckets': 30, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'drop_last': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'input_strategy': 'PrecomputedFeatures'}
2022-07-20 21:02:14,869 INFO [lexicon.py:176] Loading pre-compiled data/lang_bpe_500/Linv.pt
2022-07-20 21:02:14,927 INFO [decode.py:664] device: cuda:0
2022-07-20 21:02:22,144 INFO [decode.py:821] Calculating the averaged model over epoch range from 22 (excluded) to 30
2022-07-20 21:02:24,985 INFO [decode.py:837] Number of model parameters: 103071035
2022-07-20 21:02:24,986 INFO [asr_datamodule.py:444] About to get test-clean cuts
2022-07-20 21:02:24,988 INFO [asr_datamodule.py:451] About to get test-other cuts
2022-07-20 21:02:26,237 INFO [decode.py:588] batch 0/?, cuts processed until now is 1
2022-07-20 21:03:00,467 INFO [decode.py:588] batch 100/?, cuts processed until now is 212
2022-07-20 21:03:32,099 INFO [decode.py:588] batch 200/?, cuts processed until now is 459
2022-07-20 21:04:01,741 INFO [decode.py:588] batch 300/?, cuts processed until now is 717
2022-07-20 21:04:31,150 INFO [decode.py:588] batch 400/?, cuts processed until now is 949
2022-07-20 21:05:03,456 INFO [decode.py:588] batch 500/?, cuts processed until now is 1163
2022-07-20 21:05:33,288 INFO [decode.py:588] batch 600/?, cuts processed until now is 1411
2022-07-20 21:06:01,818 INFO [decode.py:588] batch 700/?, cuts processed until now is 1652
2022-07-20 21:06:33,143 INFO [decode.py:588] batch 800/?, cuts processed until now is 1867
2022-07-20 21:06:59,955 INFO [decode.py:588] batch 900/?, cuts processed until now is 2122
2022-07-20 21:07:30,299 INFO [decode.py:588] batch 1000/?, cuts processed until now is 2321
2022-07-20 21:08:02,342 INFO [decode.py:588] batch 1100/?, cuts processed until now is 2468
2022-07-20 21:08:32,616 INFO [decode.py:588] batch 1200/?, cuts processed until now is 2601
2022-07-20 21:08:37,175 INFO [decode.py:609] The transcripts are stored in pruned_transducer_stateless_smooth/quandongtest_8gpu_ctc_attnetion2-exp/recogs-test-clean-no_rescore-nbest-scale-0.5-100.txt
2022-07-20 21:08:37,260 INFO [utils.py:416] [test-clean-no_rescore-nbest-scale-0.5-100] %WER 2.94% [1547 / 52576, 149 ins, 218 del, 1180 sub ]
2022-07-20 21:08:37,488 INFO [decode.py:621] Wrote detailed error stats to pruned_transducer_stateless_smooth/quandongtest_8gpu_ctc_attnetion2-exp/errs-test-clean-no_rescore-nbest-scale-0.5-100.txt
2022-07-20 21:08:37,489 INFO [decode.py:637] 
For test-clean, WER of different settings are:
no_rescore-nbest-scale-0.5-100	2.94	best for test-clean

2022-07-20 21:08:38,299 INFO [decode.py:588] batch 0/?, cuts processed until now is 2
2022-07-20 21:09:09,190 INFO [decode.py:588] batch 100/?, cuts processed until now is 249
2022-07-20 21:09:38,759 INFO [decode.py:588] batch 200/?, cuts processed until now is 540
2022-07-20 21:10:06,577 INFO [decode.py:588] batch 300/?, cuts processed until now is 834
2022-07-20 21:10:34,377 INFO [decode.py:588] batch 400/?, cuts processed until now is 1104
2022-07-20 21:11:05,680 INFO [decode.py:588] batch 500/?, cuts processed until now is 1350
2022-07-20 21:11:36,410 INFO [decode.py:588] batch 600/?, cuts processed until now is 1640
2022-07-20 21:12:03,632 INFO [decode.py:588] batch 700/?, cuts processed until now is 1933
2022-07-20 21:12:32,513 INFO [decode.py:588] batch 800/?, cuts processed until now is 2175
2022-07-20 21:13:02,611 INFO [decode.py:588] batch 900/?, cuts processed until now is 2440
2022-07-20 21:13:33,536 INFO [decode.py:588] batch 1000/?, cuts processed until now is 2656
2022-07-20 21:14:04,886 INFO [decode.py:588] batch 1100/?, cuts processed until now is 2839
2022-07-20 21:14:34,022 INFO [decode.py:609] The transcripts are stored in pruned_transducer_stateless_smooth/quandongtest_8gpu_ctc_attnetion2-exp/recogs-test-other-no_rescore-nbest-scale-0.5-100.txt
2022-07-20 21:14:34,110 INFO [utils.py:416] [test-other-no_rescore-nbest-scale-0.5-100] %WER 6.39% [3346 / 52343, 259 ins, 590 del, 2497 sub ]
2022-07-20 21:14:34,427 INFO [decode.py:621] Wrote detailed error stats to pruned_transducer_stateless_smooth/quandongtest_8gpu_ctc_attnetion2-exp/errs-test-other-no_rescore-nbest-scale-0.5-100.txt
2022-07-20 21:14:34,428 INFO [decode.py:637] 
For test-other, WER of different settings are:
no_rescore-nbest-scale-0.5-100	6.39	best for test-other

2022-07-20 21:14:34,428 INFO [decode.py:868] Done!