log/log-attention-decoder/log-decode-2022-07-20-21-02-14

2022-07-20 21:02:14,406 INFO [decode.py:653] Decoding started
2022-07-20 21:02:14,406 INFO [decode.py:654] {'subsampling_factor': 4, 'feature_dim': 80, 'nhead': 8, 'dim_feedforward': 2048, 'encoder_dim': 512, 'num_encoder_layers': 12, 'search_beam': 20, 'output_beam': 8, 'min_active_states': 30, 'max_active_states': 10000, 'use_double_scores': True, 'env_info': {'k2-version': '1.15.1', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': '350e449fe5d7b4231f77eb0add764782eed9f5d2', 'k2-git-date': 'Thu May 26 22:56:24 2022', 'lhotse-version': '1.3.0.dev+git.232f3eb.dirty', 'torch-version': '1.10.0+cu102', 'torch-cuda-available': True, 'torch-cuda-version': '10.2', 'python-version': '3.8', 'icefall-git-branch': 'conformer_ctc2', 'icefall-git-sha1': 'd812f82-dirty', 'icefall-git-date': 'Wed Jul 20 19:47:36 2022', 'icefall-path': '/home/storage23/wangquandong/experiment/open_source/icefall', 'k2-path': '/home/storage23/wangquandong/tools/k2/k2/python/k2/__init__.py', 'lhotse-path': '/home/storage23/wangquandong/tools/lhotse/lhotse/__init__.py', 'hostname': 'tj1-asr-train-v100-30.kscn', 'IP address': '10.38.22.183'}, 'epoch': 30, 'iter': 0, 'avg': 8, 'method': 'attention-decoder', 'use_averaged_model': True, 'num_decoder_layers': 6, 'num_paths': 100, 'nbest_scale': 0.5, 'exp_dir': PosixPath('pruned_transducer_stateless_smooth/quandongtest_8gpu_ctc_attnetion2-exp'), 'lang_dir': PosixPath('data/lang_bpe_500'), 'lm_dir': PosixPath('data/lm'), 'full_libri': True, 'manifest_dir': PosixPath('data/fbank'), 'max_duration': 20, 'bucketing_sampler': True, 'num_buckets': 30, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'drop_last': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'input_strategy': 'PrecomputedFeatures'}
2022-07-20 21:02:14,821 INFO [lexicon.py:176] Loading pre-compiled data/lang_bpe_500/Linv.pt
2022-07-20 21:02:14,886 INFO [decode.py:664] device: cuda:0
2022-07-20 21:02:21,301 INFO [decode.py:730] Loading pre-compiled G_4_gram.pt
2022-07-20 21:02:26,829 INFO [decode.py:821] Calculating the averaged model over epoch range from 22 (excluded) to 30
2022-07-20 21:02:29,635 INFO [decode.py:837] Number of model parameters: 103071035
2022-07-20 21:02:29,635 INFO [asr_datamodule.py:444] About to get test-clean cuts
2022-07-20 21:02:29,639 INFO [asr_datamodule.py:451] About to get test-other cuts
2022-07-20 21:02:31,600 INFO [decode.py:588] batch 0/?, cuts processed until now is 1
2022-07-20 21:04:08,163 INFO [decode.py:588] batch 100/?, cuts processed until now is 212
2022-07-20 21:05:41,871 INFO [decode.py:588] batch 200/?, cuts processed until now is 459
2022-07-20 21:07:13,153 INFO [decode.py:588] batch 300/?, cuts processed until now is 717
2022-07-20 21:08:43,103 INFO [decode.py:588] batch 400/?, cuts processed until now is 949
2022-07-20 21:10:19,640 INFO [decode.py:588] batch 500/?, cuts processed until now is 1163
2022-07-20 21:11:51,100 INFO [decode.py:588] batch 600/?, cuts processed until now is 1411
2022-07-20 21:13:20,028 INFO [decode.py:588] batch 700/?, cuts processed until now is 1652
2022-07-20 21:14:53,913 INFO [decode.py:588] batch 800/?, cuts processed until now is 1867
2022-07-20 21:16:20,862 INFO [decode.py:588] batch 900/?, cuts processed until now is 2122
2022-07-20 21:17:51,185 INFO [decode.py:588] batch 1000/?, cuts processed until now is 2321
2022-07-20 21:19:26,869 INFO [decode.py:588] batch 1100/?, cuts processed until now is 2468
2022-07-20 21:20:57,079 INFO [decode.py:588] batch 1200/?, cuts processed until now is 2601
2022-07-20 21:24:52,558 INFO [decode.py:637] 
For test-clean, WER of different settings are:
ngram_lm_scale_0.6_attention_scale_0.5	2.59	best for test-clean
ngram_lm_scale_0.7_attention_scale_1.1	2.59
ngram_lm_scale_0.7_attention_scale_1.2	2.59
ngram_lm_scale_0.7_attention_scale_1.3	2.59
ngram_lm_scale_0.9_attention_scale_0.5	2.59
ngram_lm_scale_0.9_attention_scale_0.6	2.59
ngram_lm_scale_0.9_attention_scale_1.3	2.59
ngram_lm_scale_1.0_attention_scale_0.6	2.59
ngram_lm_scale_1.0_attention_scale_0.7	2.59
ngram_lm_scale_1.0_attention_scale_1.5	2.59
ngram_lm_scale_1.1_attention_scale_0.6	2.59
ngram_lm_scale_1.1_attention_scale_0.9	2.59
ngram_lm_scale_1.2_attention_scale_1.1	2.59
ngram_lm_scale_1.5_attention_scale_1.5	2.59
ngram_lm_scale_0.6_attention_scale_0.9	2.6
ngram_lm_scale_0.6_attention_scale_1.0	2.6
ngram_lm_scale_0.6_attention_scale_1.1	2.6
ngram_lm_scale_0.6_attention_scale_1.2	2.6
ngram_lm_scale_0.6_attention_scale_1.3	2.6
ngram_lm_scale_0.6_attention_scale_1.9	2.6
ngram_lm_scale_0.6_attention_scale_2.0	2.6
ngram_lm_scale_0.7_attention_scale_0.5	2.6
ngram_lm_scale_0.7_attention_scale_0.6	2.6
ngram_lm_scale_0.7_attention_scale_0.7	2.6
ngram_lm_scale_0.7_attention_scale_0.9	2.6
ngram_lm_scale_0.7_attention_scale_1.0	2.6
ngram_lm_scale_0.7_attention_scale_2.3	2.6
ngram_lm_scale_0.9_attention_scale_0.7	2.6
ngram_lm_scale_0.9_attention_scale_0.9	2.6
ngram_lm_scale_0.9_attention_scale_1.0	2.6
ngram_lm_scale_0.9_attention_scale_1.1	2.6
ngram_lm_scale_0.9_attention_scale_1.2	2.6
ngram_lm_scale_0.9_attention_scale_1.5	2.6
ngram_lm_scale_0.9_attention_scale_1.7	2.6
ngram_lm_scale_0.9_attention_scale_1.9	2.6
ngram_lm_scale_1.0_attention_scale_0.9	2.6
ngram_lm_scale_1.0_attention_scale_1.0	2.6
ngram_lm_scale_1.0_attention_scale_1.1	2.6
ngram_lm_scale_1.0_attention_scale_1.7	2.6
ngram_lm_scale_1.1_attention_scale_0.7	2.6
ngram_lm_scale_1.1_attention_scale_1.0	2.6
ngram_lm_scale_1.1_attention_scale_1.7	2.6
ngram_lm_scale_1.1_attention_scale_1.9	2.6
ngram_lm_scale_1.1_attention_scale_2.0	2.6
ngram_lm_scale_1.1_attention_scale_2.1	2.6
ngram_lm_scale_1.1_attention_scale_2.2	2.6
ngram_lm_scale_1.2_attention_scale_0.9	2.6
ngram_lm_scale_1.2_attention_scale_1.0	2.6
ngram_lm_scale_1.2_attention_scale_2.2	2.6
ngram_lm_scale_1.2_attention_scale_2.3	2.6
ngram_lm_scale_1.3_attention_scale_1.0	2.6
ngram_lm_scale_1.3_attention_scale_1.1	2.6
ngram_lm_scale_1.3_attention_scale_1.2	2.6
ngram_lm_scale_1.3_attention_scale_1.3	2.6
ngram_lm_scale_1.5_attention_scale_1.7	2.6
ngram_lm_scale_1.5_attention_scale_2.1	2.6
ngram_lm_scale_1.7_attention_scale_1.9	2.6
ngram_lm_scale_0.5_attention_scale_1.2	2.61
ngram_lm_scale_0.5_attention_scale_1.3	2.61
ngram_lm_scale_0.5_attention_scale_1.5	2.61
ngram_lm_scale_0.5_attention_scale_1.7	2.61
ngram_lm_scale_0.5_attention_scale_1.9	2.61
ngram_lm_scale_0.5_attention_scale_2.0	2.61
ngram_lm_scale_0.5_attention_scale_2.2	2.61
ngram_lm_scale_0.6_attention_scale_0.6	2.61
ngram_lm_scale_0.6_attention_scale_0.7	2.61
ngram_lm_scale_0.6_attention_scale_1.5	2.61
ngram_lm_scale_0.6_attention_scale_1.7	2.61
ngram_lm_scale_0.6_attention_scale_2.1	2.61
ngram_lm_scale_0.6_attention_scale_2.2	2.61
ngram_lm_scale_0.6_attention_scale_2.3	2.61
ngram_lm_scale_0.6_attention_scale_2.5	2.61
ngram_lm_scale_0.7_attention_scale_0.3	2.61
ngram_lm_scale_0.7_attention_scale_1.5	2.61
ngram_lm_scale_0.7_attention_scale_1.7	2.61
ngram_lm_scale_0.7_attention_scale_1.9	2.61
ngram_lm_scale_0.7_attention_scale_2.2	2.61
ngram_lm_scale_0.7_attention_scale_2.5	2.61
ngram_lm_scale_0.9_attention_scale_2.0	2.61
ngram_lm_scale_0.9_attention_scale_2.1	2.61
ngram_lm_scale_0.9_attention_scale_2.2	2.61
ngram_lm_scale_0.9_attention_scale_2.3	2.61
ngram_lm_scale_0.9_attention_scale_2.5	2.61
ngram_lm_scale_0.9_attention_scale_3.0	2.61
ngram_lm_scale_1.0_attention_scale_0.5	2.61
ngram_lm_scale_1.0_attention_scale_1.2	2.61
ngram_lm_scale_1.0_attention_scale_1.3	2.61
ngram_lm_scale_1.0_attention_scale_1.9	2.61
ngram_lm_scale_1.0_attention_scale_2.2	2.61
ngram_lm_scale_1.0_attention_scale_2.3	2.61
ngram_lm_scale_1.0_attention_scale_2.5	2.61
ngram_lm_scale_1.0_attention_scale_3.0	2.61
ngram_lm_scale_1.1_attention_scale_1.1	2.61
ngram_lm_scale_1.1_attention_scale_1.2	2.61
ngram_lm_scale_1.1_attention_scale_1.3	2.61
ngram_lm_scale_1.1_attention_scale_1.5	2.61
ngram_lm_scale_1.1_attention_scale_2.3	2.61
ngram_lm_scale_1.2_attention_scale_0.7	2.61
ngram_lm_scale_1.2_attention_scale_1.2	2.61
ngram_lm_scale_1.2_attention_scale_1.3	2.61
ngram_lm_scale_1.2_attention_scale_1.7	2.61
ngram_lm_scale_1.2_attention_scale_1.9	2.61
ngram_lm_scale_1.2_attention_scale_2.0	2.61
ngram_lm_scale_1.2_attention_scale_2.1	2.61
ngram_lm_scale_1.2_attention_scale_2.5	2.61
ngram_lm_scale_1.2_attention_scale_5.0	2.61
ngram_lm_scale_1.3_attention_scale_0.9	2.61
ngram_lm_scale_1.3_attention_scale_1.5	2.61
ngram_lm_scale_1.3_attention_scale_1.7	2.61
ngram_lm_scale_1.3_attention_scale_1.9	2.61
ngram_lm_scale_1.3_attention_scale_2.2	2.61
ngram_lm_scale_1.3_attention_scale_2.3	2.61
ngram_lm_scale_1.3_attention_scale_2.5	2.61
ngram_lm_scale_1.3_attention_scale_3.0	2.61
ngram_lm_scale_1.3_attention_scale_5.0	2.61
ngram_lm_scale_1.5_attention_scale_1.3	2.61
ngram_lm_scale_1.5_attention_scale_1.9	2.61
ngram_lm_scale_1.5_attention_scale_2.0	2.61
ngram_lm_scale_1.5_attention_scale_2.2	2.61
ngram_lm_scale_1.5_attention_scale_2.3	2.61
ngram_lm_scale_1.5_attention_scale_2.5	2.61
ngram_lm_scale_1.5_attention_scale_3.0	2.61
ngram_lm_scale_1.5_attention_scale_5.0	2.61
ngram_lm_scale_1.7_attention_scale_2.0	2.61
ngram_lm_scale_1.7_attention_scale_2.1	2.61
ngram_lm_scale_1.7_attention_scale_2.2	2.61
ngram_lm_scale_1.7_attention_scale_2.3	2.61
ngram_lm_scale_1.7_attention_scale_2.5	2.61
ngram_lm_scale_1.7_attention_scale_5.0	2.61
ngram_lm_scale_2.0_attention_scale_2.5	2.61
ngram_lm_scale_2.3_attention_scale_4.0	2.61
ngram_lm_scale_2.5_attention_scale_5.0	2.61
ngram_lm_scale_0.5_attention_scale_0.3	2.62
ngram_lm_scale_0.5_attention_scale_0.6	2.62
ngram_lm_scale_0.5_attention_scale_0.7	2.62
ngram_lm_scale_0.5_attention_scale_0.9	2.62
ngram_lm_scale_0.5_attention_scale_1.0	2.62
ngram_lm_scale_0.5_attention_scale_1.1	2.62
ngram_lm_scale_0.5_attention_scale_2.1	2.62
ngram_lm_scale_0.5_attention_scale_2.3	2.62
ngram_lm_scale_0.5_attention_scale_2.5	2.62
ngram_lm_scale_0.5_attention_scale_3.0	2.62
ngram_lm_scale_0.6_attention_scale_0.3	2.62
ngram_lm_scale_0.6_attention_scale_3.0	2.62
ngram_lm_scale_0.7_attention_scale_2.0	2.62
ngram_lm_scale_0.7_attention_scale_2.1	2.62
ngram_lm_scale_0.7_attention_scale_3.0	2.62
ngram_lm_scale_0.9_attention_scale_4.0	2.62
ngram_lm_scale_1.0_attention_scale_2.0	2.62
ngram_lm_scale_1.0_attention_scale_2.1	2.62
ngram_lm_scale_1.0_attention_scale_4.0	2.62
ngram_lm_scale_1.0_attention_scale_5.0	2.62
ngram_lm_scale_1.1_attention_scale_0.5	2.62
ngram_lm_scale_1.1_attention_scale_2.5	2.62
ngram_lm_scale_1.1_attention_scale_3.0	2.62
ngram_lm_scale_1.1_attention_scale_4.0	2.62
ngram_lm_scale_1.1_attention_scale_5.0	2.62
ngram_lm_scale_1.2_attention_scale_1.5	2.62
ngram_lm_scale_1.2_attention_scale_3.0	2.62
ngram_lm_scale_1.2_attention_scale_4.0	2.62
ngram_lm_scale_1.3_attention_scale_2.0	2.62
ngram_lm_scale_1.3_attention_scale_2.1	2.62
ngram_lm_scale_1.3_attention_scale_4.0	2.62
ngram_lm_scale_1.5_attention_scale_4.0	2.62
ngram_lm_scale_1.7_attention_scale_1.7	2.62
ngram_lm_scale_1.7_attention_scale_3.0	2.62
ngram_lm_scale_1.7_attention_scale_4.0	2.62
ngram_lm_scale_1.9_attention_scale_1.9	2.62
ngram_lm_scale_1.9_attention_scale_2.0	2.62
ngram_lm_scale_1.9_attention_scale_2.1	2.62
ngram_lm_scale_1.9_attention_scale_2.2	2.62
ngram_lm_scale_1.9_attention_scale_2.3	2.62
ngram_lm_scale_1.9_attention_scale_2.5	2.62
ngram_lm_scale_1.9_attention_scale_3.0	2.62
ngram_lm_scale_1.9_attention_scale_4.0	2.62
ngram_lm_scale_1.9_attention_scale_5.0	2.62
ngram_lm_scale_2.0_attention_scale_2.0	2.62
ngram_lm_scale_2.0_attention_scale_2.1	2.62
ngram_lm_scale_2.0_attention_scale_2.2	2.62
ngram_lm_scale_2.0_attention_scale_2.3	2.62
ngram_lm_scale_2.0_attention_scale_3.0	2.62
ngram_lm_scale_2.0_attention_scale_4.0	2.62
ngram_lm_scale_2.0_attention_scale_5.0	2.62
ngram_lm_scale_2.1_attention_scale_4.0	2.62
ngram_lm_scale_2.1_attention_scale_5.0	2.62
ngram_lm_scale_2.2_attention_scale_3.0	2.62
ngram_lm_scale_2.2_attention_scale_4.0	2.62
ngram_lm_scale_2.2_attention_scale_5.0	2.62
ngram_lm_scale_2.3_attention_scale_3.0	2.62
ngram_lm_scale_2.3_attention_scale_5.0	2.62
ngram_lm_scale_0.3_attention_scale_1.5	2.63
ngram_lm_scale_0.5_attention_scale_0.5	2.63
ngram_lm_scale_0.6_attention_scale_4.0	2.63
ngram_lm_scale_0.7_attention_scale_4.0	2.63
ngram_lm_scale_0.7_attention_scale_5.0	2.63
ngram_lm_scale_0.9_attention_scale_5.0	2.63
ngram_lm_scale_1.2_attention_scale_0.6	2.63
ngram_lm_scale_1.5_attention_scale_1.2	2.63
ngram_lm_scale_1.7_attention_scale_1.5	2.63
ngram_lm_scale_2.0_attention_scale_1.9	2.63
ngram_lm_scale_2.1_attention_scale_2.1	2.63
ngram_lm_scale_2.1_attention_scale_2.2	2.63
ngram_lm_scale_2.1_attention_scale_2.3	2.63
ngram_lm_scale_2.1_attention_scale_2.5	2.63
ngram_lm_scale_2.1_attention_scale_3.0	2.63
ngram_lm_scale_2.2_attention_scale_2.3	2.63
ngram_lm_scale_2.3_attention_scale_2.5	2.63
ngram_lm_scale_3.0_attention_scale_4.0	2.63
ngram_lm_scale_3.0_attention_scale_5.0	2.63
ngram_lm_scale_0.3_attention_scale_0.5	2.64
ngram_lm_scale_0.3_attention_scale_0.6	2.64
ngram_lm_scale_0.3_attention_scale_0.9	2.64
ngram_lm_scale_0.3_attention_scale_1.2	2.64
ngram_lm_scale_0.3_attention_scale_1.3	2.64
ngram_lm_scale_0.3_attention_scale_1.7	2.64
ngram_lm_scale_0.3_attention_scale_1.9	2.64
ngram_lm_scale_0.5_attention_scale_0.08	2.64
ngram_lm_scale_0.5_attention_scale_0.1	2.64
ngram_lm_scale_0.5_attention_scale_4.0	2.64
ngram_lm_scale_0.9_attention_scale_0.3	2.64
ngram_lm_scale_1.2_attention_scale_0.5	2.64
ngram_lm_scale_1.3_attention_scale_0.7	2.64
ngram_lm_scale_1.5_attention_scale_1.1	2.64
ngram_lm_scale_1.9_attention_scale_1.7	2.64
ngram_lm_scale_2.2_attention_scale_2.2	2.64
ngram_lm_scale_2.2_attention_scale_2.5	2.64
ngram_lm_scale_2.3_attention_scale_2.3	2.64
ngram_lm_scale_2.5_attention_scale_2.5	2.64
ngram_lm_scale_2.5_attention_scale_3.0	2.64
ngram_lm_scale_2.5_attention_scale_4.0	2.64
ngram_lm_scale_0.3_attention_scale_0.3	2.65
ngram_lm_scale_0.3_attention_scale_0.7	2.65
ngram_lm_scale_0.3_attention_scale_1.0	2.65
ngram_lm_scale_0.3_attention_scale_1.1	2.65
ngram_lm_scale_0.3_attention_scale_2.0	2.65
ngram_lm_scale_0.3_attention_scale_2.1	2.65
ngram_lm_scale_0.3_attention_scale_2.2	2.65
ngram_lm_scale_0.3_attention_scale_2.3	2.65
ngram_lm_scale_0.3_attention_scale_2.5	2.65
ngram_lm_scale_0.3_attention_scale_3.0	2.65
ngram_lm_scale_0.5_attention_scale_0.05	2.65
ngram_lm_scale_0.6_attention_scale_0.05	2.65
ngram_lm_scale_0.6_attention_scale_0.08	2.65
ngram_lm_scale_0.6_attention_scale_0.1	2.65
ngram_lm_scale_0.6_attention_scale_5.0	2.65
ngram_lm_scale_1.0_attention_scale_0.3	2.65
ngram_lm_scale_1.5_attention_scale_1.0	2.65
ngram_lm_scale_1.9_attention_scale_1.5	2.65
ngram_lm_scale_2.0_attention_scale_1.7	2.65
ngram_lm_scale_2.1_attention_scale_2.0	2.65
ngram_lm_scale_2.2_attention_scale_2.0	2.65
ngram_lm_scale_2.2_attention_scale_2.1	2.65
ngram_lm_scale_2.3_attention_scale_2.2	2.65
ngram_lm_scale_4.0_attention_scale_5.0	2.65
ngram_lm_scale_0.08_attention_scale_1.0	2.66
ngram_lm_scale_0.1_attention_scale_1.0	2.66
ngram_lm_scale_0.1_attention_scale_1.1	2.66
ngram_lm_scale_0.3_attention_scale_4.0	2.66
ngram_lm_scale_0.5_attention_scale_0.01	2.66
ngram_lm_scale_0.5_attention_scale_5.0	2.66
ngram_lm_scale_0.7_attention_scale_0.05	2.66
ngram_lm_scale_0.7_attention_scale_0.08	2.66
ngram_lm_scale_0.7_attention_scale_0.1	2.66
ngram_lm_scale_1.3_attention_scale_0.6	2.66
ngram_lm_scale_1.5_attention_scale_0.9	2.66
ngram_lm_scale_1.7_attention_scale_1.1	2.66
ngram_lm_scale_1.7_attention_scale_1.2	2.66
ngram_lm_scale_1.7_attention_scale_1.3	2.66
ngram_lm_scale_2.1_attention_scale_1.7	2.66
ngram_lm_scale_2.1_attention_scale_1.9	2.66
ngram_lm_scale_2.3_attention_scale_2.1	2.66
ngram_lm_scale_0.05_attention_scale_1.0	2.67
ngram_lm_scale_0.05_attention_scale_1.1	2.67
ngram_lm_scale_0.05_attention_scale_1.2	2.67
ngram_lm_scale_0.08_attention_scale_1.1	2.67
ngram_lm_scale_0.08_attention_scale_1.2	2.67
ngram_lm_scale_0.08_attention_scale_1.3	2.67
ngram_lm_scale_0.08_attention_scale_1.5	2.67
ngram_lm_scale_0.08_attention_scale_2.5	2.67
ngram_lm_scale_0.1_attention_scale_1.2	2.67
ngram_lm_scale_0.1_attention_scale_1.3	2.67
ngram_lm_scale_0.1_attention_scale_1.5	2.67
ngram_lm_scale_0.1_attention_scale_2.5	2.67
ngram_lm_scale_0.3_attention_scale_0.05	2.67
ngram_lm_scale_0.3_attention_scale_0.1	2.67
ngram_lm_scale_0.6_attention_scale_0.01	2.67
ngram_lm_scale_2.0_attention_scale_1.5	2.67
ngram_lm_scale_2.2_attention_scale_1.9	2.67
ngram_lm_scale_2.3_attention_scale_1.9	2.67
ngram_lm_scale_2.3_attention_scale_2.0	2.67
ngram_lm_scale_2.5_attention_scale_2.3	2.67
ngram_lm_scale_3.0_attention_scale_3.0	2.67
ngram_lm_scale_0.01_attention_scale_1.3	2.68
ngram_lm_scale_0.05_attention_scale_1.3	2.68
ngram_lm_scale_0.05_attention_scale_1.5	2.68
ngram_lm_scale_0.05_attention_scale_4.0	2.68
ngram_lm_scale_0.08_attention_scale_1.7	2.68
ngram_lm_scale_0.08_attention_scale_2.3	2.68
ngram_lm_scale_0.08_attention_scale_3.0	2.68
ngram_lm_scale_0.08_attention_scale_4.0	2.68
ngram_lm_scale_0.1_attention_scale_0.9	2.68
ngram_lm_scale_0.1_attention_scale_1.7	2.68
ngram_lm_scale_0.1_attention_scale_1.9	2.68
ngram_lm_scale_0.1_attention_scale_2.0	2.68
ngram_lm_scale_0.1_attention_scale_2.1	2.68
ngram_lm_scale_0.1_attention_scale_2.2	2.68
ngram_lm_scale_0.1_attention_scale_2.3	2.68
ngram_lm_scale_0.1_attention_scale_3.0	2.68
ngram_lm_scale_0.1_attention_scale_4.0	2.68
ngram_lm_scale_0.3_attention_scale_0.01	2.68
ngram_lm_scale_0.3_attention_scale_0.08	2.68
ngram_lm_scale_0.3_attention_scale_5.0	2.68
ngram_lm_scale_0.7_attention_scale_0.01	2.68
ngram_lm_scale_1.1_attention_scale_0.3	2.68
ngram_lm_scale_1.9_attention_scale_1.3	2.68
ngram_lm_scale_2.5_attention_scale_2.2	2.68
ngram_lm_scale_0.01_attention_scale_0.9	2.69
ngram_lm_scale_0.01_attention_scale_1.0	2.69
ngram_lm_scale_0.01_attention_scale_1.1	2.69
ngram_lm_scale_0.01_attention_scale_1.2	2.69
ngram_lm_scale_0.01_attention_scale_1.5	2.69
ngram_lm_scale_0.01_attention_scale_2.0	2.69
ngram_lm_scale_0.01_attention_scale_4.0	2.69
ngram_lm_scale_0.01_attention_scale_5.0	2.69
ngram_lm_scale_0.05_attention_scale_0.9	2.69
ngram_lm_scale_0.05_attention_scale_1.7	2.69
ngram_lm_scale_0.05_attention_scale_1.9	2.69
ngram_lm_scale_0.05_attention_scale_2.0	2.69
ngram_lm_scale_0.05_attention_scale_2.1	2.69
ngram_lm_scale_0.05_attention_scale_2.2	2.69
ngram_lm_scale_0.05_attention_scale_2.3	2.69
ngram_lm_scale_0.05_attention_scale_2.5	2.69
ngram_lm_scale_0.05_attention_scale_3.0	2.69
ngram_lm_scale_0.05_attention_scale_5.0	2.69
ngram_lm_scale_0.08_attention_scale_0.7	2.69
ngram_lm_scale_0.08_attention_scale_0.9	2.69
ngram_lm_scale_0.08_attention_scale_1.9	2.69
ngram_lm_scale_0.08_attention_scale_2.0	2.69
ngram_lm_scale_0.08_attention_scale_2.1	2.69
ngram_lm_scale_0.08_attention_scale_2.2	2.69
ngram_lm_scale_0.08_attention_scale_5.0	2.69
ngram_lm_scale_0.1_attention_scale_0.3	2.69
ngram_lm_scale_0.1_attention_scale_0.7	2.69
ngram_lm_scale_0.1_attention_scale_5.0	2.69
ngram_lm_scale_0.9_attention_scale_0.1	2.69
ngram_lm_scale_1.3_attention_scale_0.5	2.69
ngram_lm_scale_2.2_attention_scale_1.7	2.69
ngram_lm_scale_0.01_attention_scale_1.7	2.7
ngram_lm_scale_0.01_attention_scale_1.9	2.7
ngram_lm_scale_0.01_attention_scale_2.1	2.7
ngram_lm_scale_0.01_attention_scale_2.2	2.7
ngram_lm_scale_0.01_attention_scale_2.3	2.7
ngram_lm_scale_0.01_attention_scale_2.5	2.7
ngram_lm_scale_0.01_attention_scale_3.0	2.7
ngram_lm_scale_0.05_attention_scale_0.6	2.7
ngram_lm_scale_0.05_attention_scale_0.7	2.7
ngram_lm_scale_0.08_attention_scale_0.1	2.7
ngram_lm_scale_0.08_attention_scale_0.3	2.7
ngram_lm_scale_0.08_attention_scale_0.5	2.7
ngram_lm_scale_0.08_attention_scale_0.6	2.7
ngram_lm_scale_0.1_attention_scale_0.1	2.7
ngram_lm_scale_0.1_attention_scale_0.5	2.7
ngram_lm_scale_0.1_attention_scale_0.6	2.7
ngram_lm_scale_0.9_attention_scale_0.08	2.7
ngram_lm_scale_1.7_attention_scale_1.0	2.7
ngram_lm_scale_1.9_attention_scale_1.2	2.7
ngram_lm_scale_2.1_attention_scale_1.5	2.7
ngram_lm_scale_2.5_attention_scale_2.0	2.7
ngram_lm_scale_2.5_attention_scale_2.1	2.7
ngram_lm_scale_4.0_attention_scale_4.0	2.7
ngram_lm_scale_0.01_attention_scale_0.3	2.71
ngram_lm_scale_0.01_attention_scale_0.7	2.71
ngram_lm_scale_0.05_attention_scale_0.3	2.71
ngram_lm_scale_0.05_attention_scale_0.5	2.71
ngram_lm_scale_0.08_attention_scale_0.08	2.71
ngram_lm_scale_0.1_attention_scale_0.05	2.71
ngram_lm_scale_0.1_attention_scale_0.08	2.71
ngram_lm_scale_1.5_attention_scale_0.7	2.71
ngram_lm_scale_2.0_attention_scale_1.3	2.71
ngram_lm_scale_2.3_attention_scale_1.7	2.71
ngram_lm_scale_0.01_attention_scale_0.5	2.72
ngram_lm_scale_0.01_attention_scale_0.6	2.72
ngram_lm_scale_0.05_attention_scale_0.08	2.72
ngram_lm_scale_0.05_attention_scale_0.1	2.72
ngram_lm_scale_0.08_attention_scale_0.05	2.72
ngram_lm_scale_0.1_attention_scale_0.01	2.72
ngram_lm_scale_0.9_attention_scale_0.05	2.72
ngram_lm_scale_3.0_attention_scale_2.5	2.72
ngram_lm_scale_0.05_attention_scale_0.05	2.73
ngram_lm_scale_0.08_attention_scale_0.01	2.73
ngram_lm_scale_0.9_attention_scale_0.01	2.73
ngram_lm_scale_1.7_attention_scale_0.9	2.73
ngram_lm_scale_2.5_attention_scale_1.9	2.73
ngram_lm_scale_0.01_attention_scale_0.08	2.74
ngram_lm_scale_0.01_attention_scale_0.1	2.74
ngram_lm_scale_0.05_attention_scale_0.01	2.74
ngram_lm_scale_1.9_attention_scale_1.1	2.74
ngram_lm_scale_2.2_attention_scale_1.5	2.74
ngram_lm_scale_0.01_attention_scale_0.01	2.75
ngram_lm_scale_0.01_attention_scale_0.05	2.75
ngram_lm_scale_1.0_attention_scale_0.1	2.75
ngram_lm_scale_1.2_attention_scale_0.3	2.75
ngram_lm_scale_5.0_attention_scale_5.0	2.75
ngram_lm_scale_1.5_attention_scale_0.6	2.76
ngram_lm_scale_2.0_attention_scale_1.2	2.76
ngram_lm_scale_1.0_attention_scale_0.08	2.77
ngram_lm_scale_2.1_attention_scale_1.3	2.77
ngram_lm_scale_2.3_attention_scale_1.5	2.78
ngram_lm_scale_1.9_attention_scale_1.0	2.79
ngram_lm_scale_2.5_attention_scale_1.7	2.79
ngram_lm_scale_1.0_attention_scale_0.05	2.8
ngram_lm_scale_2.0_attention_scale_1.1	2.8
ngram_lm_scale_2.1_attention_scale_1.2	2.81
ngram_lm_scale_3.0_attention_scale_2.3	2.81
ngram_lm_scale_1.0_attention_scale_0.01	2.82
ngram_lm_scale_1.1_attention_scale_0.1	2.82
ngram_lm_scale_1.3_attention_scale_0.3	2.82
ngram_lm_scale_2.2_attention_scale_1.3	2.82
ngram_lm_scale_1.7_attention_scale_0.7	2.83
ngram_lm_scale_3.0_attention_scale_2.2	2.83
ngram_lm_scale_1.1_attention_scale_0.08	2.84
ngram_lm_scale_1.5_attention_scale_0.5	2.84
ngram_lm_scale_3.0_attention_scale_2.1	2.85
ngram_lm_scale_1.1_attention_scale_0.05	2.86
ngram_lm_scale_1.9_attention_scale_0.9	2.86
ngram_lm_scale_2.0_attention_scale_1.0	2.86
ngram_lm_scale_2.1_attention_scale_1.1	2.86
ngram_lm_scale_2.2_attention_scale_1.2	2.87
ngram_lm_scale_2.3_attention_scale_1.3	2.87
ngram_lm_scale_1.1_attention_scale_0.01	2.89
ngram_lm_scale_2.5_attention_scale_1.5	2.89
ngram_lm_scale_3.0_attention_scale_2.0	2.9
ngram_lm_scale_1.2_attention_scale_0.1	2.92
ngram_lm_scale_2.0_attention_scale_0.9	2.92
ngram_lm_scale_1.2_attention_scale_0.08	2.93
ngram_lm_scale_1.7_attention_scale_0.6	2.93
ngram_lm_scale_2.1_attention_scale_1.0	2.93
ngram_lm_scale_2.2_attention_scale_1.1	2.95
ngram_lm_scale_2.3_attention_scale_1.2	2.95
ngram_lm_scale_1.2_attention_scale_0.05	2.97
ngram_lm_scale_4.0_attention_scale_3.0	2.97
ngram_lm_scale_3.0_attention_scale_1.9	2.99
ngram_lm_scale_5.0_attention_scale_4.0	2.99
ngram_lm_scale_1.3_attention_scale_0.1	3.0
ngram_lm_scale_1.5_attention_scale_0.3	3.0
ngram_lm_scale_1.7_attention_scale_0.5	3.0
ngram_lm_scale_1.2_attention_scale_0.01	3.01
ngram_lm_scale_1.9_attention_scale_0.7	3.01
ngram_lm_scale_2.1_attention_scale_0.9	3.01
ngram_lm_scale_2.2_attention_scale_1.0	3.01
ngram_lm_scale_1.3_attention_scale_0.08	3.02
ngram_lm_scale_2.3_attention_scale_1.1	3.02
ngram_lm_scale_2.5_attention_scale_1.3	3.02
ngram_lm_scale_1.3_attention_scale_0.05	3.09
ngram_lm_scale_1.9_attention_scale_0.6	3.1
ngram_lm_scale_2.0_attention_scale_0.7	3.1
ngram_lm_scale_2.2_attention_scale_0.9	3.1
ngram_lm_scale_2.3_attention_scale_1.0	3.1
ngram_lm_scale_2.5_attention_scale_1.2	3.1
ngram_lm_scale_3.0_attention_scale_1.7	3.1
ngram_lm_scale_1.3_attention_scale_0.01	3.15
ngram_lm_scale_2.5_attention_scale_1.1	3.18
ngram_lm_scale_2.3_attention_scale_0.9	3.19
ngram_lm_scale_4.0_attention_scale_2.5	3.19
ngram_lm_scale_1.9_attention_scale_0.5	3.21
ngram_lm_scale_2.1_attention_scale_0.7	3.21
ngram_lm_scale_2.0_attention_scale_0.6	3.22
ngram_lm_scale_1.7_attention_scale_0.3	3.23
ngram_lm_scale_3.0_attention_scale_1.5	3.24
ngram_lm_scale_2.5_attention_scale_1.0	3.27
ngram_lm_scale_4.0_attention_scale_2.3	3.27
ngram_lm_scale_1.5_attention_scale_0.1	3.29
ngram_lm_scale_2.2_attention_scale_0.7	3.29
ngram_lm_scale_2.1_attention_scale_0.6	3.3
ngram_lm_scale_2.0_attention_scale_0.5	3.31
ngram_lm_scale_1.5_attention_scale_0.08	3.32
ngram_lm_scale_4.0_attention_scale_2.2	3.32
ngram_lm_scale_2.5_attention_scale_0.9	3.34
ngram_lm_scale_3.0_attention_scale_1.3	3.34
ngram_lm_scale_2.3_attention_scale_0.7	3.35
ngram_lm_scale_2.2_attention_scale_0.6	3.36
ngram_lm_scale_5.0_attention_scale_3.0	3.36
ngram_lm_scale_2.1_attention_scale_0.5	3.37
ngram_lm_scale_1.5_attention_scale_0.05	3.38
ngram_lm_scale_4.0_attention_scale_2.1	3.38
ngram_lm_scale_3.0_attention_scale_1.2	3.42
ngram_lm_scale_4.0_attention_scale_2.0	3.42
ngram_lm_scale_1.5_attention_scale_0.01	3.45
ngram_lm_scale_1.9_attention_scale_0.3	3.45
ngram_lm_scale_2.3_attention_scale_0.6	3.46
ngram_lm_scale_4.0_attention_scale_1.9	3.48
ngram_lm_scale_2.2_attention_scale_0.5	3.51
ngram_lm_scale_3.0_attention_scale_1.1	3.53
ngram_lm_scale_1.7_attention_scale_0.1	3.54
ngram_lm_scale_2.5_attention_scale_0.7	3.54
ngram_lm_scale_1.7_attention_scale_0.08	3.58
ngram_lm_scale_2.0_attention_scale_0.3	3.58
ngram_lm_scale_5.0_attention_scale_2.5	3.59
ngram_lm_scale_3.0_attention_scale_1.0	3.61
ngram_lm_scale_2.3_attention_scale_0.5	3.62
ngram_lm_scale_4.0_attention_scale_1.7	3.64
ngram_lm_scale_1.7_attention_scale_0.05	3.65
ngram_lm_scale_2.1_attention_scale_0.3	3.67
ngram_lm_scale_2.5_attention_scale_0.6	3.67
ngram_lm_scale_5.0_attention_scale_2.3	3.71
ngram_lm_scale_1.7_attention_scale_0.01	3.72
ngram_lm_scale_3.0_attention_scale_0.9	3.72
ngram_lm_scale_4.0_attention_scale_1.5	3.76
ngram_lm_scale_5.0_attention_scale_2.2	3.76
ngram_lm_scale_2.2_attention_scale_0.3	3.78
ngram_lm_scale_1.9_attention_scale_0.1	3.79
ngram_lm_scale_2.5_attention_scale_0.5	3.81
ngram_lm_scale_5.0_attention_scale_2.1	3.81
ngram_lm_scale_1.9_attention_scale_0.08	3.83
ngram_lm_scale_5.0_attention_scale_2.0	3.87
ngram_lm_scale_1.9_attention_scale_0.05	3.88
ngram_lm_scale_2.3_attention_scale_0.3	3.88
ngram_lm_scale_2.0_attention_scale_0.1	3.9
ngram_lm_scale_3.0_attention_scale_0.7	3.92
ngram_lm_scale_5.0_attention_scale_1.9	3.93
ngram_lm_scale_4.0_attention_scale_1.3	3.94
ngram_lm_scale_2.0_attention_scale_0.08	3.95
ngram_lm_scale_1.9_attention_scale_0.01	3.96
ngram_lm_scale_4.0_attention_scale_1.2	3.99
ngram_lm_scale_2.0_attention_scale_0.05	4.0
ngram_lm_scale_2.1_attention_scale_0.1	4.01
ngram_lm_scale_3.0_attention_scale_0.6	4.02
ngram_lm_scale_2.1_attention_scale_0.08	4.05
ngram_lm_scale_2.5_attention_scale_0.3	4.05
ngram_lm_scale_5.0_attention_scale_1.7	4.06
ngram_lm_scale_2.0_attention_scale_0.01	4.1
ngram_lm_scale_4.0_attention_scale_1.1	4.1
ngram_lm_scale_2.1_attention_scale_0.05	4.11
ngram_lm_scale_2.2_attention_scale_0.1	4.12
ngram_lm_scale_2.2_attention_scale_0.08	4.15
ngram_lm_scale_3.0_attention_scale_0.5	4.16
ngram_lm_scale_2.1_attention_scale_0.01	4.18
ngram_lm_scale_2.2_attention_scale_0.05	4.19
ngram_lm_scale_4.0_attention_scale_1.0	4.19
ngram_lm_scale_5.0_attention_scale_1.5	4.19
ngram_lm_scale_2.3_attention_scale_0.1	4.2
ngram_lm_scale_2.3_attention_scale_0.08	4.23
ngram_lm_scale_2.2_attention_scale_0.01	4.27
ngram_lm_scale_2.3_attention_scale_0.05	4.28
ngram_lm_scale_4.0_attention_scale_0.9	4.28
ngram_lm_scale_2.3_attention_scale_0.01	4.34
ngram_lm_scale_2.5_attention_scale_0.1	4.35
ngram_lm_scale_5.0_attention_scale_1.3	4.35
ngram_lm_scale_2.5_attention_scale_0.08	4.39
ngram_lm_scale_3.0_attention_scale_0.3	4.4
ngram_lm_scale_5.0_attention_scale_1.2	4.41
ngram_lm_scale_2.5_attention_scale_0.05	4.43
ngram_lm_scale_4.0_attention_scale_0.7	4.45
ngram_lm_scale_5.0_attention_scale_1.1	4.46
ngram_lm_scale_2.5_attention_scale_0.01	4.48
ngram_lm_scale_4.0_attention_scale_0.6	4.54
ngram_lm_scale_5.0_attention_scale_1.0	4.54
ngram_lm_scale_5.0_attention_scale_0.9	4.62
ngram_lm_scale_3.0_attention_scale_0.1	4.64
ngram_lm_scale_4.0_attention_scale_0.5	4.65
ngram_lm_scale_3.0_attention_scale_0.08	4.67
ngram_lm_scale_3.0_attention_scale_0.05	4.7
ngram_lm_scale_3.0_attention_scale_0.01	4.73
ngram_lm_scale_5.0_attention_scale_0.7	4.76
ngram_lm_scale_4.0_attention_scale_0.3	4.8
ngram_lm_scale_5.0_attention_scale_0.6	4.85
ngram_lm_scale_5.0_attention_scale_0.5	4.91
ngram_lm_scale_4.0_attention_scale_0.1	4.99
ngram_lm_scale_4.0_attention_scale_0.08	5.01
ngram_lm_scale_4.0_attention_scale_0.05	5.02
ngram_lm_scale_5.0_attention_scale_0.3	5.06
ngram_lm_scale_4.0_attention_scale_0.01	5.07
ngram_lm_scale_5.0_attention_scale_0.1	5.22
ngram_lm_scale_5.0_attention_scale_0.08	5.24
ngram_lm_scale_5.0_attention_scale_0.05	5.25
ngram_lm_scale_5.0_attention_scale_0.01	5.27

2022-07-20 21:24:54,113 INFO [decode.py:588] batch 0/?, cuts processed until now is 2
2022-07-20 21:26:25,190 INFO [decode.py:588] batch 100/?, cuts processed until now is 249
2022-07-20 21:27:58,029 INFO [decode.py:588] batch 200/?, cuts processed until now is 540
2022-07-20 21:29:23,092 INFO [decode.py:588] batch 300/?, cuts processed until now is 834
2022-07-20 21:30:51,288 INFO [decode.py:588] batch 400/?, cuts processed until now is 1104
2022-07-20 21:32:21,736 INFO [decode.py:588] batch 500/?, cuts processed until now is 1350
2022-07-20 21:33:54,991 INFO [decode.py:588] batch 600/?, cuts processed until now is 1640
2022-07-20 21:35:18,198 INFO [decode.py:588] batch 700/?, cuts processed until now is 1933
2022-07-20 21:36:49,206 INFO [decode.py:588] batch 800/?, cuts processed until now is 2175
2022-07-20 21:38:16,845 INFO [decode.py:588] batch 900/?, cuts processed until now is 2440
2022-07-20 21:38:31,538 INFO [decode.py:783] Caught exception:
CUDA out of memory. Tried to allocate 740.00 MiB (GPU 0; 31.75 GiB total capacity; 28.28 GiB already allocated; 447.50 MiB free; 29.92 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation.  See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF

2022-07-20 21:38:31,538 INFO [decode.py:789] num_arcs before pruning: 349313
2022-07-20 21:38:31,538 INFO [decode.py:792] This OOM is not an error. You can ignore it. If your model does not converge well, or --max-duration is too large, or the input sound file is difficult to decode, you will meet this exception.
2022-07-20 21:38:31,557 INFO [decode.py:803] num_arcs after pruning: 8796
2022-07-20 21:39:44,765 INFO [decode.py:588] batch 1000/?, cuts processed until now is 2656
2022-07-20 21:41:20,435 INFO [decode.py:588] batch 1100/?, cuts processed until now is 2839
2022-07-20 21:46:22,023 INFO [decode.py:637] 
For test-other, WER of different settings are:
ngram_lm_scale_1.1_attention_scale_0.9	5.54	best for test-other
ngram_lm_scale_1.5_attention_scale_1.5	5.54
ngram_lm_scale_1.5_attention_scale_1.7	5.54
ngram_lm_scale_1.7_attention_scale_2.0	5.54
ngram_lm_scale_1.7_attention_scale_2.1	5.54
ngram_lm_scale_1.2_attention_scale_1.1	5.55
ngram_lm_scale_1.3_attention_scale_0.9	5.55
ngram_lm_scale_1.3_attention_scale_1.1	5.55
ngram_lm_scale_1.3_attention_scale_1.2	5.55
ngram_lm_scale_1.7_attention_scale_1.9	5.55
ngram_lm_scale_1.0_attention_scale_0.7	5.56
ngram_lm_scale_1.2_attention_scale_0.6	5.56
ngram_lm_scale_1.2_attention_scale_1.0	5.56
ngram_lm_scale_1.2_attention_scale_1.2	5.56
ngram_lm_scale_1.3_attention_scale_1.0	5.56
ngram_lm_scale_1.5_attention_scale_1.3	5.56
ngram_lm_scale_1.5_attention_scale_1.9	5.56
ngram_lm_scale_1.5_attention_scale_2.0	5.56
ngram_lm_scale_1.7_attention_scale_2.2	5.56
ngram_lm_scale_1.9_attention_scale_2.2	5.56
ngram_lm_scale_1.9_attention_scale_2.3	5.56
ngram_lm_scale_1.9_attention_scale_2.5	5.56
ngram_lm_scale_2.0_attention_scale_2.5	5.56
ngram_lm_scale_2.0_attention_scale_3.0	5.56
ngram_lm_scale_2.2_attention_scale_3.0	5.56
ngram_lm_scale_2.5_attention_scale_4.0	5.56
ngram_lm_scale_3.0_attention_scale_5.0	5.56
ngram_lm_scale_0.9_attention_scale_0.6	5.57
ngram_lm_scale_1.0_attention_scale_0.9	5.57
ngram_lm_scale_1.1_attention_scale_1.0	5.57
ngram_lm_scale_1.1_attention_scale_1.1	5.57
ngram_lm_scale_1.2_attention_scale_0.7	5.57
ngram_lm_scale_1.2_attention_scale_0.9	5.57
ngram_lm_scale_1.2_attention_scale_1.3	5.57
ngram_lm_scale_1.2_attention_scale_1.5	5.57
ngram_lm_scale_1.3_attention_scale_0.7	5.57
ngram_lm_scale_1.3_attention_scale_1.3	5.57
ngram_lm_scale_1.5_attention_scale_2.1	5.57
ngram_lm_scale_1.5_attention_scale_2.2	5.57
ngram_lm_scale_1.5_attention_scale_2.3	5.57
ngram_lm_scale_1.5_attention_scale_2.5	5.57
ngram_lm_scale_1.7_attention_scale_1.7	5.57
ngram_lm_scale_1.7_attention_scale_2.3	5.57
ngram_lm_scale_1.7_attention_scale_2.5	5.57
ngram_lm_scale_1.7_attention_scale_3.0	5.57
ngram_lm_scale_1.9_attention_scale_2.0	5.57
ngram_lm_scale_1.9_attention_scale_2.1	5.57
ngram_lm_scale_1.9_attention_scale_3.0	5.57
ngram_lm_scale_2.0_attention_scale_2.3	5.57
ngram_lm_scale_2.0_attention_scale_4.0	5.57
ngram_lm_scale_2.1_attention_scale_3.0	5.57
ngram_lm_scale_2.1_attention_scale_4.0	5.57
ngram_lm_scale_2.3_attention_scale_3.0	5.57
ngram_lm_scale_0.9_attention_scale_0.7	5.58
ngram_lm_scale_1.0_attention_scale_1.0	5.58
ngram_lm_scale_1.0_attention_scale_1.1	5.58
ngram_lm_scale_1.1_attention_scale_0.5	5.58
ngram_lm_scale_1.1_attention_scale_0.6	5.58
ngram_lm_scale_1.1_attention_scale_1.2	5.58
ngram_lm_scale_1.1_attention_scale_1.5	5.58
ngram_lm_scale_1.3_attention_scale_1.5	5.58
ngram_lm_scale_1.3_attention_scale_1.7	5.58
ngram_lm_scale_1.3_attention_scale_1.9	5.58
ngram_lm_scale_1.3_attention_scale_2.0	5.58
ngram_lm_scale_1.3_attention_scale_2.1	5.58
ngram_lm_scale_1.3_attention_scale_2.2	5.58
ngram_lm_scale_2.0_attention_scale_2.2	5.58
ngram_lm_scale_2.2_attention_scale_4.0	5.58
ngram_lm_scale_2.3_attention_scale_4.0	5.58
ngram_lm_scale_0.9_attention_scale_0.9	5.59
ngram_lm_scale_1.0_attention_scale_1.2	5.59
ngram_lm_scale_1.1_attention_scale_0.7	5.59
ngram_lm_scale_1.1_attention_scale_1.3	5.59
ngram_lm_scale_1.2_attention_scale_1.7	5.59
ngram_lm_scale_1.2_attention_scale_1.9	5.59
ngram_lm_scale_1.2_attention_scale_2.1	5.59
ngram_lm_scale_1.3_attention_scale_2.3	5.59
ngram_lm_scale_1.5_attention_scale_1.0	5.59
ngram_lm_scale_1.5_attention_scale_1.1	5.59
ngram_lm_scale_1.5_attention_scale_1.2	5.59
ngram_lm_scale_1.7_attention_scale_1.5	5.59
ngram_lm_scale_1.9_attention_scale_1.9	5.59
ngram_lm_scale_1.9_attention_scale_4.0	5.59
ngram_lm_scale_2.0_attention_scale_2.1	5.59
ngram_lm_scale_2.1_attention_scale_2.3	5.59
ngram_lm_scale_2.1_attention_scale_2.5	5.59
ngram_lm_scale_2.5_attention_scale_5.0	5.59
ngram_lm_scale_0.9_attention_scale_1.0	5.6
ngram_lm_scale_1.0_attention_scale_0.6	5.6
ngram_lm_scale_1.0_attention_scale_1.3	5.6
ngram_lm_scale_1.1_attention_scale_1.7	5.6
ngram_lm_scale_1.1_attention_scale_1.9	5.6
ngram_lm_scale_1.2_attention_scale_2.0	5.6
ngram_lm_scale_1.7_attention_scale_1.3	5.6
ngram_lm_scale_2.0_attention_scale_2.0	5.6
ngram_lm_scale_2.1_attention_scale_2.2	5.6
ngram_lm_scale_2.2_attention_scale_5.0	5.6
ngram_lm_scale_2.3_attention_scale_2.5	5.6
ngram_lm_scale_2.3_attention_scale_5.0	5.6
ngram_lm_scale_3.0_attention_scale_4.0	5.6
ngram_lm_scale_0.9_attention_scale_0.5	5.61
ngram_lm_scale_1.0_attention_scale_0.5	5.61
ngram_lm_scale_1.0_attention_scale_1.5	5.61
ngram_lm_scale_1.1_attention_scale_2.0	5.61
ngram_lm_scale_1.2_attention_scale_0.5	5.61
ngram_lm_scale_1.2_attention_scale_2.2	5.61
ngram_lm_scale_1.3_attention_scale_2.5	5.61
ngram_lm_scale_1.5_attention_scale_0.9	5.61
ngram_lm_scale_1.5_attention_scale_3.0	5.61
ngram_lm_scale_1.7_attention_scale_4.0	5.61
ngram_lm_scale_1.9_attention_scale_1.7	5.61
ngram_lm_scale_2.0_attention_scale_1.7	5.61
ngram_lm_scale_2.0_attention_scale_1.9	5.61
ngram_lm_scale_2.0_attention_scale_5.0	5.61
ngram_lm_scale_2.1_attention_scale_5.0	5.61
ngram_lm_scale_2.2_attention_scale_2.5	5.61
ngram_lm_scale_2.5_attention_scale_3.0	5.61
ngram_lm_scale_0.9_attention_scale_1.1	5.62
ngram_lm_scale_1.0_attention_scale_1.7	5.62
ngram_lm_scale_1.1_attention_scale_2.1	5.62
ngram_lm_scale_1.2_attention_scale_2.3	5.62
ngram_lm_scale_1.7_attention_scale_1.2	5.62
ngram_lm_scale_1.9_attention_scale_1.5	5.62
ngram_lm_scale_2.1_attention_scale_1.9	5.62
ngram_lm_scale_2.1_attention_scale_2.0	5.62
ngram_lm_scale_2.1_attention_scale_2.1	5.62
ngram_lm_scale_2.2_attention_scale_2.2	5.62
ngram_lm_scale_2.2_attention_scale_2.3	5.62
ngram_lm_scale_0.7_attention_scale_0.7	5.63
ngram_lm_scale_0.9_attention_scale_0.3	5.63
ngram_lm_scale_0.9_attention_scale_1.2	5.63
ngram_lm_scale_0.9_attention_scale_1.3	5.63
ngram_lm_scale_1.0_attention_scale_0.3	5.63
ngram_lm_scale_1.0_attention_scale_1.9	5.63
ngram_lm_scale_1.1_attention_scale_2.2	5.63
ngram_lm_scale_1.3_attention_scale_0.6	5.63
ngram_lm_scale_1.9_attention_scale_5.0	5.63
ngram_lm_scale_2.2_attention_scale_2.0	5.63
ngram_lm_scale_2.2_attention_scale_2.1	5.63
ngram_lm_scale_2.3_attention_scale_2.1	5.63
ngram_lm_scale_2.3_attention_scale_2.3	5.63
ngram_lm_scale_0.7_attention_scale_0.3	5.64
ngram_lm_scale_0.7_attention_scale_0.5	5.64
ngram_lm_scale_0.7_attention_scale_0.6	5.64
ngram_lm_scale_0.7_attention_scale_0.9	5.64
ngram_lm_scale_0.7_attention_scale_1.0	5.64
ngram_lm_scale_0.9_attention_scale_1.5	5.64
ngram_lm_scale_1.0_attention_scale_2.0	5.64
ngram_lm_scale_1.1_attention_scale_2.3	5.64
ngram_lm_scale_1.2_attention_scale_2.5	5.64
ngram_lm_scale_1.5_attention_scale_5.0	5.64
ngram_lm_scale_2.2_attention_scale_1.9	5.64
ngram_lm_scale_2.3_attention_scale_2.2	5.64
ngram_lm_scale_0.7_attention_scale_1.1	5.65
ngram_lm_scale_0.9_attention_scale_1.7	5.65
ngram_lm_scale_0.9_attention_scale_1.9	5.65
ngram_lm_scale_1.0_attention_scale_2.1	5.65
ngram_lm_scale_1.0_attention_scale_2.2	5.65
ngram_lm_scale_1.0_attention_scale_2.3	5.65
ngram_lm_scale_1.1_attention_scale_2.5	5.65
ngram_lm_scale_1.3_attention_scale_3.0	5.65
ngram_lm_scale_1.7_attention_scale_1.1	5.65
ngram_lm_scale_1.7_attention_scale_5.0	5.65
ngram_lm_scale_2.5_attention_scale_2.5	5.65
ngram_lm_scale_0.6_attention_scale_0.5	5.66
ngram_lm_scale_0.6_attention_scale_0.6	5.66
ngram_lm_scale_0.6_attention_scale_0.9	5.66
ngram_lm_scale_0.7_attention_scale_1.2	5.66
ngram_lm_scale_0.9_attention_scale_2.3	5.66
ngram_lm_scale_1.0_attention_scale_2.5	5.66
ngram_lm_scale_1.2_attention_scale_3.0	5.66
ngram_lm_scale_1.5_attention_scale_4.0	5.66
ngram_lm_scale_2.3_attention_scale_2.0	5.66
ngram_lm_scale_0.5_attention_scale_0.6	5.67
ngram_lm_scale_0.5_attention_scale_0.7	5.67
ngram_lm_scale_0.5_attention_scale_0.9	5.67
ngram_lm_scale_0.6_attention_scale_0.7	5.67
ngram_lm_scale_0.6_attention_scale_1.0	5.67
ngram_lm_scale_0.6_attention_scale_1.1	5.67
ngram_lm_scale_0.7_attention_scale_1.3	5.67
ngram_lm_scale_0.9_attention_scale_2.0	5.67
ngram_lm_scale_0.9_attention_scale_2.1	5.67
ngram_lm_scale_0.9_attention_scale_2.2	5.67
ngram_lm_scale_0.9_attention_scale_2.5	5.67
ngram_lm_scale_1.1_attention_scale_3.0	5.67
ngram_lm_scale_1.3_attention_scale_4.0	5.67
ngram_lm_scale_2.0_attention_scale_1.5	5.67
ngram_lm_scale_2.1_attention_scale_1.7	5.67
ngram_lm_scale_2.5_attention_scale_2.3	5.67
ngram_lm_scale_4.0_attention_scale_5.0	5.67
ngram_lm_scale_0.5_attention_scale_1.0	5.68
ngram_lm_scale_0.6_attention_scale_0.3	5.68
ngram_lm_scale_1.0_attention_scale_3.0	5.68
ngram_lm_scale_1.2_attention_scale_4.0	5.68
ngram_lm_scale_2.3_attention_scale_1.9	5.68
ngram_lm_scale_2.5_attention_scale_2.2	5.68
ngram_lm_scale_3.0_attention_scale_3.0	5.68
ngram_lm_scale_0.5_attention_scale_0.5	5.69
ngram_lm_scale_0.5_attention_scale_1.1	5.69
ngram_lm_scale_0.6_attention_scale_1.2	5.69
ngram_lm_scale_1.1_attention_scale_0.3	5.69
ngram_lm_scale_1.3_attention_scale_0.5	5.69
ngram_lm_scale_1.7_attention_scale_1.0	5.69
ngram_lm_scale_1.9_attention_scale_1.3	5.69
ngram_lm_scale_0.5_attention_scale_1.2	5.7
ngram_lm_scale_0.6_attention_scale_1.3	5.7
ngram_lm_scale_0.6_attention_scale_1.5	5.7
ngram_lm_scale_0.7_attention_scale_1.5	5.7
ngram_lm_scale_0.7_attention_scale_1.7	5.7
ngram_lm_scale_0.7_attention_scale_1.9	5.7
ngram_lm_scale_0.7_attention_scale_2.0	5.7
ngram_lm_scale_0.9_attention_scale_3.0	5.7
ngram_lm_scale_2.1_attention_scale_1.5	5.7
ngram_lm_scale_2.2_attention_scale_1.7	5.7
ngram_lm_scale_0.5_attention_scale_1.3	5.71
ngram_lm_scale_0.6_attention_scale_1.7	5.71
ngram_lm_scale_0.7_attention_scale_2.1	5.71
ngram_lm_scale_0.7_attention_scale_2.2	5.71
ngram_lm_scale_1.1_attention_scale_4.0	5.71
ngram_lm_scale_1.3_attention_scale_5.0	5.71
ngram_lm_scale_2.5_attention_scale_2.1	5.71
ngram_lm_scale_0.5_attention_scale_0.3	5.72
ngram_lm_scale_0.6_attention_scale_1.9	5.72
ngram_lm_scale_1.0_attention_scale_4.0	5.72
ngram_lm_scale_1.5_attention_scale_0.7	5.72
ngram_lm_scale_1.9_attention_scale_1.2	5.72
ngram_lm_scale_2.3_attention_scale_1.7	5.72
ngram_lm_scale_2.5_attention_scale_2.0	5.72
ngram_lm_scale_0.5_attention_scale_1.5	5.73
ngram_lm_scale_0.6_attention_scale_0.1	5.73
ngram_lm_scale_0.7_attention_scale_2.3	5.73
ngram_lm_scale_0.9_attention_scale_4.0	5.73
ngram_lm_scale_1.2_attention_scale_5.0	5.73
ngram_lm_scale_2.0_attention_scale_1.3	5.73
ngram_lm_scale_0.5_attention_scale_1.7	5.74
ngram_lm_scale_0.5_attention_scale_1.9	5.74
ngram_lm_scale_0.5_attention_scale_2.0	5.74
ngram_lm_scale_0.5_attention_scale_2.2	5.74
ngram_lm_scale_0.5_attention_scale_2.3	5.74
ngram_lm_scale_0.6_attention_scale_0.08	5.74
ngram_lm_scale_0.6_attention_scale_2.0	5.74
ngram_lm_scale_0.6_attention_scale_2.1	5.74
ngram_lm_scale_0.6_attention_scale_2.2	5.74
ngram_lm_scale_0.6_attention_scale_2.5	5.74
ngram_lm_scale_0.7_attention_scale_0.1	5.74
ngram_lm_scale_0.7_attention_scale_2.5	5.74
ngram_lm_scale_0.7_attention_scale_3.0	5.74
ngram_lm_scale_1.1_attention_scale_5.0	5.74
ngram_lm_scale_1.7_attention_scale_0.9	5.74
ngram_lm_scale_4.0_attention_scale_4.0	5.74
ngram_lm_scale_0.3_attention_scale_1.1	5.75
ngram_lm_scale_0.3_attention_scale_1.2	5.75
ngram_lm_scale_0.5_attention_scale_2.1	5.75
ngram_lm_scale_0.5_attention_scale_2.5	5.75
ngram_lm_scale_0.6_attention_scale_0.05	5.75
ngram_lm_scale_0.6_attention_scale_2.3	5.75
ngram_lm_scale_0.6_attention_scale_3.0	5.75
ngram_lm_scale_0.7_attention_scale_0.05	5.75
ngram_lm_scale_0.7_attention_scale_0.08	5.75
ngram_lm_scale_0.9_attention_scale_5.0	5.75
ngram_lm_scale_1.0_attention_scale_5.0	5.75
ngram_lm_scale_2.2_attention_scale_1.5	5.75
ngram_lm_scale_2.5_attention_scale_1.9	5.75
ngram_lm_scale_0.3_attention_scale_0.9	5.76
ngram_lm_scale_0.3_attention_scale_1.0	5.76
ngram_lm_scale_0.3_attention_scale_1.3	5.76
ngram_lm_scale_0.5_attention_scale_0.1	5.76
ngram_lm_scale_0.7_attention_scale_4.0	5.76
ngram_lm_scale_2.0_attention_scale_1.2	5.76
ngram_lm_scale_0.5_attention_scale_0.08	5.77
ngram_lm_scale_0.5_attention_scale_3.0	5.77
ngram_lm_scale_0.6_attention_scale_4.0	5.77
ngram_lm_scale_0.7_attention_scale_5.0	5.77
ngram_lm_scale_1.9_attention_scale_1.1	5.77
ngram_lm_scale_3.0_attention_scale_2.5	5.77
ngram_lm_scale_0.3_attention_scale_0.6	5.78
ngram_lm_scale_0.3_attention_scale_0.7	5.78
ngram_lm_scale_0.3_attention_scale_1.5	5.78
ngram_lm_scale_0.5_attention_scale_0.01	5.78
ngram_lm_scale_0.5_attention_scale_0.05	5.78
ngram_lm_scale_0.6_attention_scale_0.01	5.78
ngram_lm_scale_0.9_attention_scale_0.1	5.78
ngram_lm_scale_2.1_attention_scale_1.3	5.78
ngram_lm_scale_0.3_attention_scale_0.5	5.79
ngram_lm_scale_0.3_attention_scale_1.7	5.79
ngram_lm_scale_0.7_attention_scale_0.01	5.79
ngram_lm_scale_0.3_attention_scale_2.0	5.8
ngram_lm_scale_0.3_attention_scale_2.1	5.8
ngram_lm_scale_0.3_attention_scale_2.2	5.8
ngram_lm_scale_0.5_attention_scale_4.0	5.8
ngram_lm_scale_0.6_attention_scale_5.0	5.8
ngram_lm_scale_0.9_attention_scale_0.08	5.8
ngram_lm_scale_1.2_attention_scale_0.3	5.8
ngram_lm_scale_0.3_attention_scale_1.9	5.81
ngram_lm_scale_0.3_attention_scale_2.3	5.81
ngram_lm_scale_0.5_attention_scale_5.0	5.81
ngram_lm_scale_1.5_attention_scale_0.6	5.81
ngram_lm_scale_0.3_attention_scale_2.5	5.82
ngram_lm_scale_2.3_attention_scale_1.5	5.82
ngram_lm_scale_0.3_attention_scale_3.0	5.83
ngram_lm_scale_0.3_attention_scale_4.0	5.83
ngram_lm_scale_0.3_attention_scale_5.0	5.83
ngram_lm_scale_1.0_attention_scale_0.1	5.83
ngram_lm_scale_2.0_attention_scale_1.1	5.83
ngram_lm_scale_2.1_attention_scale_1.2	5.83
ngram_lm_scale_5.0_attention_scale_5.0	5.83
ngram_lm_scale_0.08_attention_scale_1.3	5.84
ngram_lm_scale_0.08_attention_scale_1.7	5.84
ngram_lm_scale_0.1_attention_scale_1.3	5.84
ngram_lm_scale_0.9_attention_scale_0.05	5.84
ngram_lm_scale_1.9_attention_scale_1.0	5.84
ngram_lm_scale_3.0_attention_scale_2.3	5.84
ngram_lm_scale_0.08_attention_scale_1.2	5.85
ngram_lm_scale_0.08_attention_scale_1.5	5.85
ngram_lm_scale_0.08_attention_scale_1.9	5.85
ngram_lm_scale_0.1_attention_scale_1.0	5.85
ngram_lm_scale_0.1_attention_scale_1.1	5.85
ngram_lm_scale_0.1_attention_scale_1.2	5.85
ngram_lm_scale_0.1_attention_scale_1.5	5.85
ngram_lm_scale_0.1_attention_scale_1.7	5.85
ngram_lm_scale_0.1_attention_scale_1.9	5.85
ngram_lm_scale_0.1_attention_scale_2.0	5.85
ngram_lm_scale_0.1_attention_scale_2.1	5.85
ngram_lm_scale_0.1_attention_scale_2.2	5.85
ngram_lm_scale_0.3_attention_scale_0.3	5.85
ngram_lm_scale_2.5_attention_scale_1.7	5.85
ngram_lm_scale_0.05_attention_scale_1.3	5.86
ngram_lm_scale_0.08_attention_scale_1.0	5.86
ngram_lm_scale_0.08_attention_scale_2.0	5.86
ngram_lm_scale_0.08_attention_scale_2.1	5.86
ngram_lm_scale_0.08_attention_scale_2.2	5.86
ngram_lm_scale_0.1_attention_scale_0.9	5.86
ngram_lm_scale_0.1_attention_scale_2.3	5.86
ngram_lm_scale_0.1_attention_scale_2.5	5.86
ngram_lm_scale_1.0_attention_scale_0.08	5.86
ngram_lm_scale_2.2_attention_scale_1.3	5.86
ngram_lm_scale_0.05_attention_scale_1.5	5.87
ngram_lm_scale_0.05_attention_scale_1.7	5.87
ngram_lm_scale_0.05_attention_scale_1.9	5.87
ngram_lm_scale_0.05_attention_scale_2.0	5.87
ngram_lm_scale_0.05_attention_scale_2.5	5.87
ngram_lm_scale_0.08_attention_scale_0.9	5.87
ngram_lm_scale_0.08_attention_scale_1.1	5.87
ngram_lm_scale_0.08_attention_scale_2.3	5.87
ngram_lm_scale_0.08_attention_scale_2.5	5.87
ngram_lm_scale_0.1_attention_scale_3.0	5.87
ngram_lm_scale_0.9_attention_scale_0.01	5.87
ngram_lm_scale_0.01_attention_scale_1.5	5.88
ngram_lm_scale_0.01_attention_scale_1.7	5.88
ngram_lm_scale_0.01_attention_scale_2.5	5.88
ngram_lm_scale_0.01_attention_scale_3.0	5.88
ngram_lm_scale_0.05_attention_scale_1.0	5.88
ngram_lm_scale_0.05_attention_scale_1.1	5.88
ngram_lm_scale_0.05_attention_scale_1.2	5.88
ngram_lm_scale_0.05_attention_scale_2.1	5.88
ngram_lm_scale_0.05_attention_scale_2.2	5.88
ngram_lm_scale_0.05_attention_scale_2.3	5.88
ngram_lm_scale_0.08_attention_scale_3.0	5.88
ngram_lm_scale_0.3_attention_scale_0.1	5.88
ngram_lm_scale_3.0_attention_scale_2.2	5.88
ngram_lm_scale_0.01_attention_scale_1.9	5.89
ngram_lm_scale_0.01_attention_scale_2.0	5.89
ngram_lm_scale_0.01_attention_scale_2.1	5.89
ngram_lm_scale_0.05_attention_scale_0.9	5.89
ngram_lm_scale_0.05_attention_scale_3.0	5.89
ngram_lm_scale_0.08_attention_scale_4.0	5.89
ngram_lm_scale_0.1_attention_scale_0.7	5.89
ngram_lm_scale_0.1_attention_scale_4.0	5.89
ngram_lm_scale_0.1_attention_scale_5.0	5.89
ngram_lm_scale_0.3_attention_scale_0.08	5.89
ngram_lm_scale_0.01_attention_scale_1.3	5.9
ngram_lm_scale_0.01_attention_scale_2.2	5.9
ngram_lm_scale_0.01_attention_scale_2.3	5.9
ngram_lm_scale_0.05_attention_scale_4.0	5.9
ngram_lm_scale_0.05_attention_scale_5.0	5.9
ngram_lm_scale_0.08_attention_scale_0.7	5.9
ngram_lm_scale_0.08_attention_scale_5.0	5.9
ngram_lm_scale_0.01_attention_scale_1.1	5.91
ngram_lm_scale_0.01_attention_scale_1.2	5.91
ngram_lm_scale_0.01_attention_scale_4.0	5.91
ngram_lm_scale_0.01_attention_scale_5.0	5.91
ngram_lm_scale_0.1_attention_scale_0.6	5.91
ngram_lm_scale_0.3_attention_scale_0.05	5.91
ngram_lm_scale_1.3_attention_scale_0.3	5.91
ngram_lm_scale_1.5_attention_scale_0.5	5.91
ngram_lm_scale_1.7_attention_scale_0.7	5.91
ngram_lm_scale_1.9_attention_scale_0.9	5.91
ngram_lm_scale_2.0_attention_scale_1.0	5.91
ngram_lm_scale_2.1_attention_scale_1.1	5.91
ngram_lm_scale_0.01_attention_scale_0.9	5.92
ngram_lm_scale_0.01_attention_scale_1.0	5.92
ngram_lm_scale_0.05_attention_scale_0.6	5.92
ngram_lm_scale_0.05_attention_scale_0.7	5.92
ngram_lm_scale_0.08_attention_scale_0.6	5.92
ngram_lm_scale_0.1_attention_scale_0.5	5.92
ngram_lm_scale_1.0_attention_scale_0.05	5.92
ngram_lm_scale_0.01_attention_scale_0.7	5.94
ngram_lm_scale_0.05_attention_scale_0.5	5.94
ngram_lm_scale_0.08_attention_scale_0.5	5.94
ngram_lm_scale_2.2_attention_scale_1.2	5.94
ngram_lm_scale_2.3_attention_scale_1.3	5.95
ngram_lm_scale_3.0_attention_scale_2.1	5.95
ngram_lm_scale_0.01_attention_scale_0.6	5.96
ngram_lm_scale_0.3_attention_scale_0.01	5.96
ngram_lm_scale_1.1_attention_scale_0.1	5.97
ngram_lm_scale_1.0_attention_scale_0.01	5.98
ngram_lm_scale_2.5_attention_scale_1.5	5.98
ngram_lm_scale_0.01_attention_scale_0.5	5.99
ngram_lm_scale_0.08_attention_scale_0.3	5.99
ngram_lm_scale_0.1_attention_scale_0.3	5.99
ngram_lm_scale_3.0_attention_scale_2.0	6.0
ngram_lm_scale_1.1_attention_scale_0.08	6.01
ngram_lm_scale_1.7_attention_scale_0.6	6.01
ngram_lm_scale_0.05_attention_scale_0.3	6.02
ngram_lm_scale_2.1_attention_scale_1.0	6.02
ngram_lm_scale_2.0_attention_scale_0.9	6.03
ngram_lm_scale_2.2_attention_scale_1.1	6.03
ngram_lm_scale_2.3_attention_scale_1.2	6.03
ngram_lm_scale_0.01_attention_scale_0.3	6.04
ngram_lm_scale_4.0_attention_scale_3.0	6.05
ngram_lm_scale_3.0_attention_scale_1.9	6.07
ngram_lm_scale_0.08_attention_scale_0.08	6.08
ngram_lm_scale_0.08_attention_scale_0.1	6.08
ngram_lm_scale_0.1_attention_scale_0.08	6.08
ngram_lm_scale_0.1_attention_scale_0.1	6.08
ngram_lm_scale_1.1_attention_scale_0.05	6.08
ngram_lm_scale_5.0_attention_scale_4.0	6.08
ngram_lm_scale_0.1_attention_scale_0.05	6.09
ngram_lm_scale_0.05_attention_scale_0.1	6.11
ngram_lm_scale_0.08_attention_scale_0.05	6.11
ngram_lm_scale_0.05_attention_scale_0.08	6.12
ngram_lm_scale_0.1_attention_scale_0.01	6.12
ngram_lm_scale_2.1_attention_scale_0.9	6.12
ngram_lm_scale_2.2_attention_scale_1.0	6.12
ngram_lm_scale_2.5_attention_scale_1.3	6.12
ngram_lm_scale_0.05_attention_scale_0.05	6.13
ngram_lm_scale_0.08_attention_scale_0.01	6.13
ngram_lm_scale_1.2_attention_scale_0.1	6.13
ngram_lm_scale_2.3_attention_scale_1.1	6.13
ngram_lm_scale_0.01_attention_scale_0.1	6.14
ngram_lm_scale_1.2_attention_scale_0.08	6.15
ngram_lm_scale_1.9_attention_scale_0.7	6.15
ngram_lm_scale_1.1_attention_scale_0.01	6.16
ngram_lm_scale_0.01_attention_scale_0.08	6.17
ngram_lm_scale_1.7_attention_scale_0.5	6.17
ngram_lm_scale_0.05_attention_scale_0.01	6.18
ngram_lm_scale_1.5_attention_scale_0.3	6.2
ngram_lm_scale_0.01_attention_scale_0.05	6.21
ngram_lm_scale_1.2_attention_scale_0.05	6.21
ngram_lm_scale_2.2_attention_scale_0.9	6.24
ngram_lm_scale_0.01_attention_scale_0.01	6.25
ngram_lm_scale_1.3_attention_scale_0.1	6.25
ngram_lm_scale_2.3_attention_scale_1.0	6.25
ngram_lm_scale_3.0_attention_scale_1.7	6.25
ngram_lm_scale_2.0_attention_scale_0.7	6.26
ngram_lm_scale_1.9_attention_scale_0.6	6.27
ngram_lm_scale_2.5_attention_scale_1.2	6.27
ngram_lm_scale_1.2_attention_scale_0.01	6.28
ngram_lm_scale_1.3_attention_scale_0.08	6.29
ngram_lm_scale_2.5_attention_scale_1.1	6.35
ngram_lm_scale_2.3_attention_scale_0.9	6.36
ngram_lm_scale_4.0_attention_scale_2.5	6.36
ngram_lm_scale_1.3_attention_scale_0.05	6.38
ngram_lm_scale_2.0_attention_scale_0.6	6.39
ngram_lm_scale_2.1_attention_scale_0.7	6.39
ngram_lm_scale_3.0_attention_scale_1.5	6.4
ngram_lm_scale_1.9_attention_scale_0.5	6.42
ngram_lm_scale_2.5_attention_scale_1.0	6.44
ngram_lm_scale_1.3_attention_scale_0.01	6.45
ngram_lm_scale_4.0_attention_scale_2.3	6.49
ngram_lm_scale_1.7_attention_scale_0.3	6.5
ngram_lm_scale_2.2_attention_scale_0.7	6.5
ngram_lm_scale_2.1_attention_scale_0.6	6.51
ngram_lm_scale_2.0_attention_scale_0.5	6.54
ngram_lm_scale_4.0_attention_scale_2.2	6.54
ngram_lm_scale_2.5_attention_scale_0.9	6.56
ngram_lm_scale_3.0_attention_scale_1.3	6.59
ngram_lm_scale_5.0_attention_scale_3.0	6.59
ngram_lm_scale_1.5_attention_scale_0.1	6.62
ngram_lm_scale_4.0_attention_scale_2.1	6.63
ngram_lm_scale_2.3_attention_scale_0.7	6.64
ngram_lm_scale_1.5_attention_scale_0.08	6.67
ngram_lm_scale_2.2_attention_scale_0.6	6.68
ngram_lm_scale_2.1_attention_scale_0.5	6.7
ngram_lm_scale_3.0_attention_scale_1.2	6.72
ngram_lm_scale_4.0_attention_scale_2.0	6.73
ngram_lm_scale_1.5_attention_scale_0.05	6.75
ngram_lm_scale_2.3_attention_scale_0.6	6.79
ngram_lm_scale_4.0_attention_scale_1.9	6.82
ngram_lm_scale_1.9_attention_scale_0.3	6.83
ngram_lm_scale_2.2_attention_scale_0.5	6.83
ngram_lm_scale_1.5_attention_scale_0.01	6.84
ngram_lm_scale_3.0_attention_scale_1.1	6.84
ngram_lm_scale_2.5_attention_scale_0.7	6.86
ngram_lm_scale_5.0_attention_scale_2.5	6.9
ngram_lm_scale_3.0_attention_scale_1.0	6.92
ngram_lm_scale_1.7_attention_scale_0.1	6.93
ngram_lm_scale_2.0_attention_scale_0.3	6.95
ngram_lm_scale_4.0_attention_scale_1.7	6.96
ngram_lm_scale_1.7_attention_scale_0.08	6.98
ngram_lm_scale_2.3_attention_scale_0.5	6.98
ngram_lm_scale_5.0_attention_scale_2.3	7.02
ngram_lm_scale_2.5_attention_scale_0.6	7.04
ngram_lm_scale_1.7_attention_scale_0.05	7.06
ngram_lm_scale_3.0_attention_scale_0.9	7.07
ngram_lm_scale_5.0_attention_scale_2.2	7.09
ngram_lm_scale_2.1_attention_scale_0.3	7.1
ngram_lm_scale_4.0_attention_scale_1.5	7.14
ngram_lm_scale_1.7_attention_scale_0.01	7.15
ngram_lm_scale_5.0_attention_scale_2.1	7.18
ngram_lm_scale_2.5_attention_scale_0.5	7.23
ngram_lm_scale_2.2_attention_scale_0.3	7.24
ngram_lm_scale_5.0_attention_scale_2.0	7.25
ngram_lm_scale_1.9_attention_scale_0.1	7.26
ngram_lm_scale_1.9_attention_scale_0.08	7.31
ngram_lm_scale_4.0_attention_scale_1.3	7.34
ngram_lm_scale_2.3_attention_scale_0.3	7.35
ngram_lm_scale_5.0_attention_scale_1.9	7.35
ngram_lm_scale_3.0_attention_scale_0.7	7.36
ngram_lm_scale_1.9_attention_scale_0.05	7.38
ngram_lm_scale_2.0_attention_scale_0.1	7.39
ngram_lm_scale_2.0_attention_scale_0.08	7.42
ngram_lm_scale_4.0_attention_scale_1.2	7.46
ngram_lm_scale_1.9_attention_scale_0.01	7.49
ngram_lm_scale_2.0_attention_scale_0.05	7.49
ngram_lm_scale_2.1_attention_scale_0.1	7.51
ngram_lm_scale_3.0_attention_scale_0.6	7.52
ngram_lm_scale_5.0_attention_scale_1.7	7.55
ngram_lm_scale_2.1_attention_scale_0.08	7.56
ngram_lm_scale_2.5_attention_scale_0.3	7.56
ngram_lm_scale_4.0_attention_scale_1.1	7.57
ngram_lm_scale_2.0_attention_scale_0.01	7.61
ngram_lm_scale_2.1_attention_scale_0.05	7.62
ngram_lm_scale_2.2_attention_scale_0.1	7.62
ngram_lm_scale_3.0_attention_scale_0.5	7.65
ngram_lm_scale_2.2_attention_scale_0.08	7.66
ngram_lm_scale_4.0_attention_scale_1.0	7.69
ngram_lm_scale_5.0_attention_scale_1.5	7.7
ngram_lm_scale_2.3_attention_scale_0.1	7.71
ngram_lm_scale_2.1_attention_scale_0.01	7.72
ngram_lm_scale_2.2_attention_scale_0.05	7.72
ngram_lm_scale_2.3_attention_scale_0.08	7.75
ngram_lm_scale_2.2_attention_scale_0.01	7.79
ngram_lm_scale_4.0_attention_scale_0.9	7.79
ngram_lm_scale_2.3_attention_scale_0.05	7.81
ngram_lm_scale_5.0_attention_scale_1.3	7.89
ngram_lm_scale_2.3_attention_scale_0.01	7.92
ngram_lm_scale_2.5_attention_scale_0.1	7.92
ngram_lm_scale_2.5_attention_scale_0.08	7.96
ngram_lm_scale_3.0_attention_scale_0.3	7.97
ngram_lm_scale_5.0_attention_scale_1.2	7.98
ngram_lm_scale_2.5_attention_scale_0.05	8.01
ngram_lm_scale_4.0_attention_scale_0.7	8.04
ngram_lm_scale_5.0_attention_scale_1.1	8.06
ngram_lm_scale_2.5_attention_scale_0.01	8.08
ngram_lm_scale_4.0_attention_scale_0.6	8.14
ngram_lm_scale_5.0_attention_scale_1.0	8.17
ngram_lm_scale_5.0_attention_scale_0.9	8.27
ngram_lm_scale_4.0_attention_scale_0.5	8.28
ngram_lm_scale_3.0_attention_scale_0.1	8.3
ngram_lm_scale_3.0_attention_scale_0.08	8.34
ngram_lm_scale_3.0_attention_scale_0.05	8.38
ngram_lm_scale_5.0_attention_scale_0.7	8.43
ngram_lm_scale_3.0_attention_scale_0.01	8.46
ngram_lm_scale_4.0_attention_scale_0.3	8.48
ngram_lm_scale_5.0_attention_scale_0.6	8.51
ngram_lm_scale_5.0_attention_scale_0.5	8.58
ngram_lm_scale_4.0_attention_scale_0.1	8.68
ngram_lm_scale_4.0_attention_scale_0.08	8.71
ngram_lm_scale_4.0_attention_scale_0.05	8.73
ngram_lm_scale_5.0_attention_scale_0.3	8.75
ngram_lm_scale_4.0_attention_scale_0.01	8.8
ngram_lm_scale_5.0_attention_scale_0.1	8.97
ngram_lm_scale_5.0_attention_scale_0.08	8.98
ngram_lm_scale_5.0_attention_scale_0.05	9.0
ngram_lm_scale_5.0_attention_scale_0.01	9.03

2022-07-20 21:46:22,023 INFO [decode.py:868] Done!