csukuangfj commited on
Commit
330bab0
1 Parent(s): 553c294

Add README.

Browse files
Files changed (2) hide show
  1. README.md +114 -0
  2. log/log-decode-2021-11-09-17-38-28 +1183 -0
README.md ADDED
@@ -0,0 +1,114 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Introduction
2
+
3
+ ## How to clone this repo
4
+ ```
5
+ sudo apt-get install git-lfs
6
+ git clone https://huggingface.co/csukuangfj/icefall-asr-librispeech-conformer-ctc-jit-bpe-500-2021-11-09
7
+ cd icefall-asr-librispeech-conformer-ctc-jit-bpe-500-2021-11-09
8
+ git lfs pull
9
+ ```
10
+
11
+ **Catuion**: You have to run `git lfs pull`. Otherwise, you will be SAD later.
12
+
13
+ -----
14
+
15
+ ## Description
16
+
17
+ This repo provides pre-trained conformer CTC model for the librispeech dataset
18
+ using [icefall][icefall].
19
+
20
+ The commands for training are:
21
+
22
+ ```
23
+ cd egs/librispeech/ASR/conformer_ctc
24
+ ./prepare.sh
25
+ export CUDA_VISIBLE_DEVICES="0,1,2,3"
26
+ ./conformer_ctc/train.py \
27
+ --exp-dir conformer_ctc/exp_500_att0.8 \
28
+ --lang-dir data/lang_bpe_500 \
29
+ --att-rate 0.8 \
30
+ --full-libri 1 \
31
+ --max-duration 200 \
32
+ --concatenate-cuts 0 \
33
+ --world-size 4 \
34
+ --bucketing-sampler 1 \
35
+ --start-epoch 00 \
36
+ --num-epochs 80
37
+ ```
38
+
39
+ The command for decoding is:
40
+ ```
41
+ ./conformer_ctc/decode.py \
42
+ --exp-dir conformer_ctc/exp_500_att0.8 \
43
+ --lang-dir data/lang_bpe_500 \
44
+ --max-duration 30 \
45
+ --concatenate-cuts 0 \
46
+ --bucketing-sampler 1 \
47
+ --num-paths 1000 \
48
+ --epoch 77 \
49
+ --avg 55 \
50
+ --method attention-decoder \
51
+ --nbest-scale 0.5
52
+ ```
53
+
54
+ You can find the log in this repo: [log/log-decode-2021-11-09-17-38-28](log/log-decode-2021-11-09-17-38-28).
55
+
56
+ The best WER for the librispeech test dataset is:
57
+
58
+ | | test-clean | test-other |
59
+ |-----|------------|------------|
60
+ | WER | 2.42 | 5.73 |
61
+
62
+ The best scale values are:
63
+
64
+ | ngram_lm_scale | attention_scale |
65
+ |----------------|-----------------|
66
+ | 2.0 | 2.0 |
67
+
68
+
69
+ # File description
70
+
71
+ - `log/`, this directory contains the decoding log
72
+ - `data/`, this directory contains files generated by `./prepare.sh`
73
+
74
+ Note: For the `data/lm` directory, we provide only `G_4_gram.pt`. If you need other files
75
+ in this directory, please run `./prepare.sh`.
76
+
77
+ - `exp`, this directory contains two files: `preprained.pt` and `cpu_jit.pt`.
78
+
79
+ `exp/pretrained.pt` is generated by the following command:
80
+ ```
81
+ ./conformer_ctc/export.py \
82
+ --epoch 77 \
83
+ --avg 55 \
84
+ --jit 0 \
85
+ --lang-dir data/lang_bpe_500 \
86
+ --exp-dir conformer_ctc/exp_500_att0.8
87
+ ```
88
+
89
+ `exp/cpu_jit.pt` is generated by the following command:
90
+ ```
91
+ ./conformer_ctc/export.py \
92
+ --epoch 77 \
93
+ --avg 55 \
94
+ --jit 1 \
95
+ --lang-dir data/lang_bpe_500 \
96
+ --exp-dir conformer_ctc/exp_500_att0.8
97
+ ```
98
+
99
+ # Deploy your model in C++ using k2
100
+
101
+ To deploy your model in C++ using k2 without depending on Python, do the following:
102
+
103
+ ```
104
+ # Note: It requires torch >= 1.8.0
105
+ git clone https://github.com/k2-fsa/k2
106
+ cd k2
107
+ git checkout v2.0-pre
108
+ mkdir build_release
109
+ cd build_release
110
+ cmake -DCMAKE_BUILD_TYPE=Release ..
111
+ make -j ctc_decode ngram_lm_rescore attention_rescore
112
+ ```
113
+
114
+ [icefall]: https://github.com/k2-fsa/icefall
log/log-decode-2021-11-09-17-38-28 ADDED
@@ -0,0 +1,1183 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2021-11-09 17:38:28,224 INFO [decode.py:540] Decoding started
2
+ 2021-11-09 17:38:28,224 INFO [decode.py:541] {'lm_dir': PosixPath('data/lm'), 'subsampling_factor': 4, 'vgg_frontend': False, 'use_feat_batchnorm': True, 'feature_dim': 80, 'nhead': 8, 'attention_dim': 512, 'num_decoder_layers': 6, 'search_beam': 20, 'output_beam': 8, 'min_active_states': 30, 'max_active_states': 10000, 'use_double_scores': True, 'env_info': {'k2-version': '1.9', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': '7178d67e594bc7fa89c2b331ad7bd1c62a6a9eb4', 'k2-git-date': 'Tue Oct 26 22:12:54 2021', 'lhotse-version': '0.11.0.dev+missing.version.file', 'torch-cuda-available': True, 'torch-cuda-version': '10.1', 'python-version': '3.8', 'icefall-git-branch': 'master', 'icefall-git-sha1': '42b437b-dirty', 'icefall-git-date': 'Fri Oct 29 13:46:41 2021', 'icefall-path': '/ceph-fj/fangjun/open-source-2/icefall-bpe-500', 'k2-path': '/ceph-fj/fangjun/open-source-2/k2-bpe-500/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-fj/fangjun/open-source-2/lhotse-bpe-500/lhotse/__init__.py'}, 'epoch': 77, 'avg': 55, 'method': 'attention-decoder', 'num_paths': 1000, 'nbest_scale': 0.5, 'export': False, 'exp_dir': PosixPath('conformer_ctc/exp_500_att0.8'), 'lang_dir': PosixPath('data/lang_bpe_500'), 'full_libri': True, 'feature_dir': PosixPath('data/fbank'), 'max_duration': 30, 'bucketing_sampler': True, 'num_buckets': 30, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'on_the_fly_feats': False, 'shuffle': True, 'return_cuts': True, 'num_workers': 2}
3
+ 2021-11-09 17:38:28,593 INFO [lexicon.py:176] Loading pre-compiled data/lang_bpe_500/Linv.pt
4
+ 2021-11-09 17:38:28,643 INFO [decode.py:551] device: cuda:0
5
+ 2021-11-09 17:38:35,618 INFO [decode.py:606] Loading pre-compiled G_4_gram.pt
6
+ 2021-11-09 17:38:49,084 INFO [decode.py:642] averaging ['conformer_ctc/exp_500_att0.8/epoch-23.pt', 'conformer_ctc/exp_500_att0.8/epoch-24.pt', 'conformer_ctc/exp_500_att0.8/epoch-25.pt', 'conformer_ctc/exp_500_att0.8/epoch-26.pt', 'conformer_ctc/exp_500_att0.8/epoch-27.pt', 'conformer_ctc/exp_500_att0.8/epoch-28.pt', 'conformer_ctc/exp_500_att0.8/epoch-29.pt', 'conformer_ctc/exp_500_att0.8/epoch-30.pt', 'conformer_ctc/exp_500_att0.8/epoch-31.pt', 'conformer_ctc/exp_500_att0.8/epoch-32.pt', 'conformer_ctc/exp_500_att0.8/epoch-33.pt', 'conformer_ctc/exp_500_att0.8/epoch-34.pt', 'conformer_ctc/exp_500_att0.8/epoch-35.pt', 'conformer_ctc/exp_500_att0.8/epoch-36.pt', 'conformer_ctc/exp_500_att0.8/epoch-37.pt', 'conformer_ctc/exp_500_att0.8/epoch-38.pt', 'conformer_ctc/exp_500_att0.8/epoch-39.pt', 'conformer_ctc/exp_500_att0.8/epoch-40.pt', 'conformer_ctc/exp_500_att0.8/epoch-41.pt', 'conformer_ctc/exp_500_att0.8/epoch-42.pt', 'conformer_ctc/exp_500_att0.8/epoch-43.pt', 'conformer_ctc/exp_500_att0.8/epoch-44.pt', 'conformer_ctc/exp_500_att0.8/epoch-45.pt', 'conformer_ctc/exp_500_att0.8/epoch-46.pt', 'conformer_ctc/exp_500_att0.8/epoch-47.pt', 'conformer_ctc/exp_500_att0.8/epoch-48.pt', 'conformer_ctc/exp_500_att0.8/epoch-49.pt', 'conformer_ctc/exp_500_att0.8/epoch-50.pt', 'conformer_ctc/exp_500_att0.8/epoch-51.pt', 'conformer_ctc/exp_500_att0.8/epoch-52.pt', 'conformer_ctc/exp_500_att0.8/epoch-53.pt', 'conformer_ctc/exp_500_att0.8/epoch-54.pt', 'conformer_ctc/exp_500_att0.8/epoch-55.pt', 'conformer_ctc/exp_500_att0.8/epoch-56.pt', 'conformer_ctc/exp_500_att0.8/epoch-57.pt', 'conformer_ctc/exp_500_att0.8/epoch-58.pt', 'conformer_ctc/exp_500_att0.8/epoch-59.pt', 'conformer_ctc/exp_500_att0.8/epoch-60.pt', 'conformer_ctc/exp_500_att0.8/epoch-61.pt', 'conformer_ctc/exp_500_att0.8/epoch-62.pt', 'conformer_ctc/exp_500_att0.8/epoch-63.pt', 'conformer_ctc/exp_500_att0.8/epoch-64.pt', 'conformer_ctc/exp_500_att0.8/epoch-65.pt', 'conformer_ctc/exp_500_att0.8/epoch-66.pt', 'conformer_ctc/exp_500_att0.8/epoch-67.pt', 'conformer_ctc/exp_500_att0.8/epoch-68.pt', 'conformer_ctc/exp_500_att0.8/epoch-69.pt', 'conformer_ctc/exp_500_att0.8/epoch-70.pt', 'conformer_ctc/exp_500_att0.8/epoch-71.pt', 'conformer_ctc/exp_500_att0.8/epoch-72.pt', 'conformer_ctc/exp_500_att0.8/epoch-73.pt', 'conformer_ctc/exp_500_att0.8/epoch-74.pt', 'conformer_ctc/exp_500_att0.8/epoch-75.pt', 'conformer_ctc/exp_500_att0.8/epoch-76.pt', 'conformer_ctc/exp_500_att0.8/epoch-77.pt']
7
+ 2021-11-09 17:39:41,544 INFO [decode.py:656] Number of model parameters: 109226120
8
+ 2021-11-09 17:39:42,948 INFO [decode.py:476] batch 0/?, cuts processed until now is 6
9
+ 2021-11-09 17:41:18,029 INFO [decode.py:476] batch 100/?, cuts processed until now is 398
10
+ 2021-11-09 17:42:46,219 INFO [decode.py:476] batch 200/?, cuts processed until now is 792
11
+ 2021-11-09 17:44:11,780 INFO [decode.py:476] batch 300/?, cuts processed until now is 1160
12
+ 2021-11-09 17:45:35,022 INFO [decode.py:476] batch 400/?, cuts processed until now is 1574
13
+ 2021-11-09 17:47:01,868 INFO [decode.py:476] batch 500/?, cuts processed until now is 1965
14
+ 2021-11-09 17:48:28,097 INFO [decode.py:476] batch 600/?, cuts processed until now is 2308
15
+ 2021-11-09 17:50:02,831 INFO [decode.py:476] batch 700/?, cuts processed until now is 2498
16
+ 2021-11-09 17:51:46,607 INFO [decode.py:476] batch 800/?, cuts processed until now is 2614
17
+ 2021-11-09 17:55:15,052 INFO [decode.py:525]
18
+ For test-clean, WER of different settings are:
19
+ ngram_lm_scale_1.5_attention_scale_1.3 2.42 best for test-clean
20
+ ngram_lm_scale_1.5_attention_scale_1.5 2.42
21
+ ngram_lm_scale_1.7_attention_scale_1.7 2.42
22
+ ngram_lm_scale_1.9_attention_scale_1.9 2.42
23
+ ngram_lm_scale_1.9_attention_scale_2.0 2.42
24
+ ngram_lm_scale_2.0_attention_scale_2.0 2.42
25
+ ngram_lm_scale_2.0_attention_scale_2.1 2.42
26
+ ngram_lm_scale_1.2_attention_scale_0.9 2.43
27
+ ngram_lm_scale_1.3_attention_scale_1.0 2.43
28
+ ngram_lm_scale_1.3_attention_scale_1.1 2.43
29
+ ngram_lm_scale_1.3_attention_scale_1.2 2.43
30
+ ngram_lm_scale_1.5_attention_scale_0.9 2.43
31
+ ngram_lm_scale_1.5_attention_scale_1.0 2.43
32
+ ngram_lm_scale_1.5_attention_scale_1.1 2.43
33
+ ngram_lm_scale_1.5_attention_scale_1.2 2.43
34
+ ngram_lm_scale_1.7_attention_scale_1.3 2.43
35
+ ngram_lm_scale_1.7_attention_scale_1.5 2.43
36
+ ngram_lm_scale_1.7_attention_scale_1.9 2.43
37
+ ngram_lm_scale_1.7_attention_scale_2.0 2.43
38
+ ngram_lm_scale_1.9_attention_scale_2.1 2.43
39
+ ngram_lm_scale_1.9_attention_scale_2.2 2.43
40
+ ngram_lm_scale_1.9_attention_scale_2.3 2.43
41
+ ngram_lm_scale_2.0_attention_scale_2.2 2.43
42
+ ngram_lm_scale_2.0_attention_scale_2.3 2.43
43
+ ngram_lm_scale_2.1_attention_scale_2.1 2.43
44
+ ngram_lm_scale_2.1_attention_scale_2.2 2.43
45
+ ngram_lm_scale_2.1_attention_scale_2.3 2.43
46
+ ngram_lm_scale_2.1_attention_scale_2.5 2.43
47
+ ngram_lm_scale_2.2_attention_scale_2.3 2.43
48
+ ngram_lm_scale_2.2_attention_scale_2.5 2.43
49
+ ngram_lm_scale_1.0_attention_scale_0.6 2.44
50
+ ngram_lm_scale_1.0_attention_scale_0.7 2.44
51
+ ngram_lm_scale_1.1_attention_scale_0.7 2.44
52
+ ngram_lm_scale_1.1_attention_scale_1.1 2.44
53
+ ngram_lm_scale_1.2_attention_scale_0.6 2.44
54
+ ngram_lm_scale_1.2_attention_scale_0.7 2.44
55
+ ngram_lm_scale_1.2_attention_scale_1.0 2.44
56
+ ngram_lm_scale_1.2_attention_scale_1.1 2.44
57
+ ngram_lm_scale_1.2_attention_scale_1.2 2.44
58
+ ngram_lm_scale_1.2_attention_scale_1.3 2.44
59
+ ngram_lm_scale_1.3_attention_scale_0.7 2.44
60
+ ngram_lm_scale_1.3_attention_scale_0.9 2.44
61
+ ngram_lm_scale_1.3_attention_scale_1.3 2.44
62
+ ngram_lm_scale_1.5_attention_scale_1.7 2.44
63
+ ngram_lm_scale_1.7_attention_scale_1.1 2.44
64
+ ngram_lm_scale_1.7_attention_scale_1.2 2.44
65
+ ngram_lm_scale_1.7_attention_scale_2.1 2.44
66
+ ngram_lm_scale_1.9_attention_scale_1.5 2.44
67
+ ngram_lm_scale_1.9_attention_scale_1.7 2.44
68
+ ngram_lm_scale_2.0_attention_scale_1.9 2.44
69
+ ngram_lm_scale_2.0_attention_scale_2.5 2.44
70
+ ngram_lm_scale_2.1_attention_scale_1.9 2.44
71
+ ngram_lm_scale_2.1_attention_scale_2.0 2.44
72
+ ngram_lm_scale_2.2_attention_scale_2.0 2.44
73
+ ngram_lm_scale_2.2_attention_scale_2.1 2.44
74
+ ngram_lm_scale_2.2_attention_scale_2.2 2.44
75
+ ngram_lm_scale_2.3_attention_scale_2.1 2.44
76
+ ngram_lm_scale_2.3_attention_scale_2.2 2.44
77
+ ngram_lm_scale_2.3_attention_scale_2.3 2.44
78
+ ngram_lm_scale_2.3_attention_scale_2.5 2.44
79
+ ngram_lm_scale_2.5_attention_scale_2.3 2.44
80
+ ngram_lm_scale_2.5_attention_scale_2.5 2.44
81
+ ngram_lm_scale_2.5_attention_scale_3.0 2.44
82
+ ngram_lm_scale_1.1_attention_scale_0.9 2.45
83
+ ngram_lm_scale_1.1_attention_scale_1.2 2.45
84
+ ngram_lm_scale_1.1_attention_scale_1.3 2.45
85
+ ngram_lm_scale_1.3_attention_scale_1.5 2.45
86
+ ngram_lm_scale_1.7_attention_scale_1.0 2.45
87
+ ngram_lm_scale_1.9_attention_scale_1.3 2.45
88
+ ngram_lm_scale_2.0_attention_scale_1.5 2.45
89
+ ngram_lm_scale_2.0_attention_scale_1.7 2.45
90
+ ngram_lm_scale_2.1_attention_scale_1.7 2.45
91
+ ngram_lm_scale_2.2_attention_scale_1.9 2.45
92
+ ngram_lm_scale_2.3_attention_scale_1.9 2.45
93
+ ngram_lm_scale_2.3_attention_scale_2.0 2.45
94
+ ngram_lm_scale_2.5_attention_scale_2.2 2.45
95
+ ngram_lm_scale_0.9_attention_scale_0.5 2.46
96
+ ngram_lm_scale_0.9_attention_scale_0.6 2.46
97
+ ngram_lm_scale_0.9_attention_scale_0.7 2.46
98
+ ngram_lm_scale_1.0_attention_scale_0.5 2.46
99
+ ngram_lm_scale_1.0_attention_scale_0.9 2.46
100
+ ngram_lm_scale_1.1_attention_scale_0.5 2.46
101
+ ngram_lm_scale_1.1_attention_scale_0.6 2.46
102
+ ngram_lm_scale_1.1_attention_scale_1.0 2.46
103
+ ngram_lm_scale_1.2_attention_scale_0.5 2.46
104
+ ngram_lm_scale_1.2_attention_scale_1.5 2.46
105
+ ngram_lm_scale_1.3_attention_scale_0.6 2.46
106
+ ngram_lm_scale_1.5_attention_scale_1.9 2.46
107
+ ngram_lm_scale_1.5_attention_scale_2.0 2.46
108
+ ngram_lm_scale_1.5_attention_scale_2.1 2.46
109
+ ngram_lm_scale_1.7_attention_scale_2.2 2.46
110
+ ngram_lm_scale_1.9_attention_scale_2.5 2.46
111
+ ngram_lm_scale_2.1_attention_scale_1.5 2.46
112
+ ngram_lm_scale_2.2_attention_scale_3.0 2.46
113
+ ngram_lm_scale_2.3_attention_scale_3.0 2.46
114
+ ngram_lm_scale_3.0_attention_scale_3.0 2.46
115
+ ngram_lm_scale_0.9_attention_scale_0.9 2.47
116
+ ngram_lm_scale_1.0_attention_scale_1.0 2.47
117
+ ngram_lm_scale_1.0_attention_scale_1.1 2.47
118
+ ngram_lm_scale_1.0_attention_scale_1.2 2.47
119
+ ngram_lm_scale_1.2_attention_scale_1.7 2.47
120
+ ngram_lm_scale_1.3_attention_scale_1.7 2.47
121
+ ngram_lm_scale_1.3_attention_scale_1.9 2.47
122
+ ngram_lm_scale_1.3_attention_scale_2.0 2.47
123
+ ngram_lm_scale_1.3_attention_scale_2.3 2.47
124
+ ngram_lm_scale_1.5_attention_scale_2.2 2.47
125
+ ngram_lm_scale_1.5_attention_scale_2.3 2.47
126
+ ngram_lm_scale_1.5_attention_scale_3.0 2.47
127
+ ngram_lm_scale_1.7_attention_scale_0.9 2.47
128
+ ngram_lm_scale_1.7_attention_scale_2.3 2.47
129
+ ngram_lm_scale_1.7_attention_scale_2.5 2.47
130
+ ngram_lm_scale_1.7_attention_scale_3.0 2.47
131
+ ngram_lm_scale_1.9_attention_scale_1.2 2.47
132
+ ngram_lm_scale_1.9_attention_scale_3.0 2.47
133
+ ngram_lm_scale_1.9_attention_scale_4.0 2.47
134
+ ngram_lm_scale_2.0_attention_scale_3.0 2.47
135
+ ngram_lm_scale_2.0_attention_scale_4.0 2.47
136
+ ngram_lm_scale_2.1_attention_scale_3.0 2.47
137
+ ngram_lm_scale_2.1_attention_scale_4.0 2.47
138
+ ngram_lm_scale_2.2_attention_scale_1.7 2.47
139
+ ngram_lm_scale_2.2_attention_scale_4.0 2.47
140
+ ngram_lm_scale_2.3_attention_scale_4.0 2.47
141
+ ngram_lm_scale_2.5_attention_scale_2.1 2.47
142
+ ngram_lm_scale_2.5_attention_scale_5.0 2.47
143
+ ngram_lm_scale_3.0_attention_scale_4.0 2.47
144
+ ngram_lm_scale_3.0_attention_scale_5.0 2.47
145
+ ngram_lm_scale_4.0_attention_scale_5.0 2.47
146
+ ngram_lm_scale_0.9_attention_scale_1.0 2.48
147
+ ngram_lm_scale_0.9_attention_scale_1.1 2.48
148
+ ngram_lm_scale_1.0_attention_scale_1.3 2.48
149
+ ngram_lm_scale_1.1_attention_scale_2.1 2.48
150
+ ngram_lm_scale_1.1_attention_scale_2.2 2.48
151
+ ngram_lm_scale_1.1_attention_scale_2.3 2.48
152
+ ngram_lm_scale_1.2_attention_scale_1.9 2.48
153
+ ngram_lm_scale_1.2_attention_scale_2.0 2.48
154
+ ngram_lm_scale_1.2_attention_scale_2.1 2.48
155
+ ngram_lm_scale_1.2_attention_scale_2.5 2.48
156
+ ngram_lm_scale_1.3_attention_scale_0.5 2.48
157
+ ngram_lm_scale_1.3_attention_scale_2.1 2.48
158
+ ngram_lm_scale_1.3_attention_scale_2.2 2.48
159
+ ngram_lm_scale_1.3_attention_scale_2.5 2.48
160
+ ngram_lm_scale_1.5_attention_scale_0.7 2.48
161
+ ngram_lm_scale_1.5_attention_scale_2.5 2.48
162
+ ngram_lm_scale_1.7_attention_scale_4.0 2.48
163
+ ngram_lm_scale_2.0_attention_scale_1.3 2.48
164
+ ngram_lm_scale_2.1_attention_scale_5.0 2.48
165
+ ngram_lm_scale_2.2_attention_scale_5.0 2.48
166
+ ngram_lm_scale_2.3_attention_scale_5.0 2.48
167
+ ngram_lm_scale_2.5_attention_scale_2.0 2.48
168
+ ngram_lm_scale_2.5_attention_scale_4.0 2.48
169
+ ngram_lm_scale_0.7_attention_scale_0.3 2.49
170
+ ngram_lm_scale_0.9_attention_scale_0.3 2.49
171
+ ngram_lm_scale_0.9_attention_scale_1.2 2.49
172
+ ngram_lm_scale_0.9_attention_scale_1.7 2.49
173
+ ngram_lm_scale_1.0_attention_scale_0.3 2.49
174
+ ngram_lm_scale_1.0_attention_scale_1.5 2.49
175
+ ngram_lm_scale_1.0_attention_scale_1.7 2.49
176
+ ngram_lm_scale_1.0_attention_scale_1.9 2.49
177
+ ngram_lm_scale_1.0_attention_scale_2.0 2.49
178
+ ngram_lm_scale_1.0_attention_scale_2.1 2.49
179
+ ngram_lm_scale_1.0_attention_scale_2.2 2.49
180
+ ngram_lm_scale_1.1_attention_scale_0.3 2.49
181
+ ngram_lm_scale_1.1_attention_scale_1.5 2.49
182
+ ngram_lm_scale_1.1_attention_scale_1.7 2.49
183
+ ngram_lm_scale_1.1_attention_scale_1.9 2.49
184
+ ngram_lm_scale_1.1_attention_scale_2.0 2.49
185
+ ngram_lm_scale_1.1_attention_scale_2.5 2.49
186
+ ngram_lm_scale_1.2_attention_scale_2.2 2.49
187
+ ngram_lm_scale_1.2_attention_scale_2.3 2.49
188
+ ngram_lm_scale_1.3_attention_scale_3.0 2.49
189
+ ngram_lm_scale_1.9_attention_scale_1.1 2.49
190
+ ngram_lm_scale_2.0_attention_scale_5.0 2.49
191
+ ngram_lm_scale_2.3_attention_scale_1.7 2.49
192
+ ngram_lm_scale_0.7_attention_scale_0.5 2.5
193
+ ngram_lm_scale_0.7_attention_scale_0.6 2.5
194
+ ngram_lm_scale_0.7_attention_scale_0.7 2.5
195
+ ngram_lm_scale_0.9_attention_scale_1.3 2.5
196
+ ngram_lm_scale_0.9_attention_scale_1.5 2.5
197
+ ngram_lm_scale_0.9_attention_scale_1.9 2.5
198
+ ngram_lm_scale_1.0_attention_scale_2.3 2.5
199
+ ngram_lm_scale_1.2_attention_scale_3.0 2.5
200
+ ngram_lm_scale_1.5_attention_scale_0.6 2.5
201
+ ngram_lm_scale_1.5_attention_scale_4.0 2.5
202
+ ngram_lm_scale_1.9_attention_scale_5.0 2.5
203
+ ngram_lm_scale_2.2_attention_scale_1.5 2.5
204
+ ngram_lm_scale_0.6_attention_scale_0.3 2.51
205
+ ngram_lm_scale_0.6_attention_scale_0.6 2.51
206
+ ngram_lm_scale_0.6_attention_scale_0.7 2.51
207
+ ngram_lm_scale_0.7_attention_scale_0.9 2.51
208
+ ngram_lm_scale_0.7_attention_scale_1.0 2.51
209
+ ngram_lm_scale_0.7_attention_scale_1.1 2.51
210
+ ngram_lm_scale_0.9_attention_scale_2.0 2.51
211
+ ngram_lm_scale_1.0_attention_scale_2.5 2.51
212
+ ngram_lm_scale_1.2_attention_scale_0.3 2.51
213
+ ngram_lm_scale_1.7_attention_scale_5.0 2.51
214
+ ngram_lm_scale_2.0_attention_scale_1.2 2.51
215
+ ngram_lm_scale_2.1_attention_scale_1.3 2.51
216
+ ngram_lm_scale_2.5_attention_scale_1.9 2.51
217
+ ngram_lm_scale_4.0_attention_scale_4.0 2.51
218
+ ngram_lm_scale_0.6_attention_scale_0.5 2.52
219
+ ngram_lm_scale_0.6_attention_scale_0.9 2.52
220
+ ngram_lm_scale_0.6_attention_scale_1.0 2.52
221
+ ngram_lm_scale_0.7_attention_scale_1.2 2.52
222
+ ngram_lm_scale_0.7_attention_scale_1.3 2.52
223
+ ngram_lm_scale_0.9_attention_scale_0.08 2.52
224
+ ngram_lm_scale_0.9_attention_scale_2.1 2.52
225
+ ngram_lm_scale_1.1_attention_scale_3.0 2.52
226
+ ngram_lm_scale_1.3_attention_scale_4.0 2.52
227
+ ngram_lm_scale_1.5_attention_scale_0.5 2.52
228
+ ngram_lm_scale_1.5_attention_scale_5.0 2.52
229
+ ngram_lm_scale_0.6_attention_scale_1.1 2.53
230
+ ngram_lm_scale_0.7_attention_scale_0.08 2.53
231
+ ngram_lm_scale_0.7_attention_scale_0.1 2.53
232
+ ngram_lm_scale_0.7_attention_scale_1.5 2.53
233
+ ngram_lm_scale_0.9_attention_scale_0.1 2.53
234
+ ngram_lm_scale_0.9_attention_scale_2.2 2.53
235
+ ngram_lm_scale_0.9_attention_scale_2.3 2.53
236
+ ngram_lm_scale_1.0_attention_scale_3.0 2.53
237
+ ngram_lm_scale_1.2_attention_scale_4.0 2.53
238
+ ngram_lm_scale_1.9_attention_scale_1.0 2.53
239
+ ngram_lm_scale_2.3_attention_scale_1.5 2.53
240
+ ngram_lm_scale_3.0_attention_scale_2.5 2.53
241
+ ngram_lm_scale_0.5_attention_scale_0.3 2.54
242
+ ngram_lm_scale_0.5_attention_scale_0.5 2.54
243
+ ngram_lm_scale_0.5_attention_scale_0.6 2.54
244
+ ngram_lm_scale_0.5_attention_scale_0.7 2.54
245
+ ngram_lm_scale_0.6_attention_scale_0.1 2.54
246
+ ngram_lm_scale_0.6_attention_scale_1.2 2.54
247
+ ngram_lm_scale_0.6_attention_scale_1.3 2.54
248
+ ngram_lm_scale_0.7_attention_scale_0.05 2.54
249
+ ngram_lm_scale_0.7_attention_scale_1.7 2.54
250
+ ngram_lm_scale_0.7_attention_scale_1.9 2.54
251
+ ngram_lm_scale_0.7_attention_scale_2.0 2.54
252
+ ngram_lm_scale_0.7_attention_scale_2.1 2.54
253
+ ngram_lm_scale_0.9_attention_scale_2.5 2.54
254
+ ngram_lm_scale_0.9_attention_scale_3.0 2.54
255
+ ngram_lm_scale_1.0_attention_scale_0.08 2.54
256
+ ngram_lm_scale_1.0_attention_scale_0.1 2.54
257
+ ngram_lm_scale_1.3_attention_scale_0.3 2.54
258
+ ngram_lm_scale_1.3_attention_scale_5.0 2.54
259
+ ngram_lm_scale_2.0_attention_scale_1.1 2.54
260
+ ngram_lm_scale_2.2_attention_scale_1.3 2.54
261
+ ngram_lm_scale_2.5_attention_scale_1.7 2.54
262
+ ngram_lm_scale_5.0_attention_scale_5.0 2.54
263
+ ngram_lm_scale_0.5_attention_scale_0.05 2.55
264
+ ngram_lm_scale_0.5_attention_scale_0.08 2.55
265
+ ngram_lm_scale_0.5_attention_scale_0.1 2.55
266
+ ngram_lm_scale_0.5_attention_scale_0.9 2.55
267
+ ngram_lm_scale_0.6_attention_scale_0.08 2.55
268
+ ngram_lm_scale_0.6_attention_scale_1.5 2.55
269
+ ngram_lm_scale_0.6_attention_scale_1.7 2.55
270
+ ngram_lm_scale_0.6_attention_scale_2.0 2.55
271
+ ngram_lm_scale_0.7_attention_scale_2.2 2.55
272
+ ngram_lm_scale_0.7_attention_scale_2.3 2.55
273
+ ngram_lm_scale_0.7_attention_scale_2.5 2.55
274
+ ngram_lm_scale_0.9_attention_scale_0.05 2.55
275
+ ngram_lm_scale_1.0_attention_scale_0.05 2.55
276
+ ngram_lm_scale_1.1_attention_scale_4.0 2.55
277
+ ngram_lm_scale_1.2_attention_scale_5.0 2.55
278
+ ngram_lm_scale_2.1_attention_scale_1.2 2.55
279
+ ngram_lm_scale_3.0_attention_scale_2.3 2.55
280
+ ngram_lm_scale_0.5_attention_scale_1.0 2.56
281
+ ngram_lm_scale_0.5_attention_scale_1.1 2.56
282
+ ngram_lm_scale_0.5_attention_scale_1.3 2.56
283
+ ngram_lm_scale_0.6_attention_scale_0.01 2.56
284
+ ngram_lm_scale_0.6_attention_scale_0.05 2.56
285
+ ngram_lm_scale_0.6_attention_scale_1.9 2.56
286
+ ngram_lm_scale_0.6_attention_scale_2.1 2.56
287
+ ngram_lm_scale_0.6_attention_scale_2.2 2.56
288
+ ngram_lm_scale_0.7_attention_scale_0.01 2.56
289
+ ngram_lm_scale_0.9_attention_scale_0.01 2.56
290
+ ngram_lm_scale_0.9_attention_scale_4.0 2.56
291
+ ngram_lm_scale_1.0_attention_scale_0.01 2.56
292
+ ngram_lm_scale_1.0_attention_scale_4.0 2.56
293
+ ngram_lm_scale_1.1_attention_scale_0.08 2.56
294
+ ngram_lm_scale_1.1_attention_scale_0.1 2.56
295
+ ngram_lm_scale_1.1_attention_scale_5.0 2.56
296
+ ngram_lm_scale_1.7_attention_scale_0.7 2.56
297
+ ngram_lm_scale_0.5_attention_scale_0.01 2.57
298
+ ngram_lm_scale_0.5_attention_scale_1.2 2.57
299
+ ngram_lm_scale_0.6_attention_scale_2.3 2.57
300
+ ngram_lm_scale_2.1_attention_scale_1.1 2.57
301
+ ngram_lm_scale_2.2_attention_scale_1.2 2.57
302
+ ngram_lm_scale_2.3_attention_scale_1.3 2.57
303
+ ngram_lm_scale_2.5_attention_scale_1.5 2.57
304
+ ngram_lm_scale_3.0_attention_scale_2.2 2.57
305
+ ngram_lm_scale_0.5_attention_scale_1.5 2.58
306
+ ngram_lm_scale_0.5_attention_scale_1.7 2.58
307
+ ngram_lm_scale_0.5_attention_scale_1.9 2.58
308
+ ngram_lm_scale_0.5_attention_scale_2.0 2.58
309
+ ngram_lm_scale_0.6_attention_scale_2.5 2.58
310
+ ngram_lm_scale_0.7_attention_scale_3.0 2.58
311
+ ngram_lm_scale_0.7_attention_scale_5.0 2.58
312
+ ngram_lm_scale_0.9_attention_scale_5.0 2.58
313
+ ngram_lm_scale_1.0_attention_scale_5.0 2.58
314
+ ngram_lm_scale_1.1_attention_scale_0.05 2.58
315
+ ngram_lm_scale_1.9_attention_scale_0.9 2.58
316
+ ngram_lm_scale_2.0_attention_scale_1.0 2.58
317
+ ngram_lm_scale_0.3_attention_scale_0.9 2.59
318
+ ngram_lm_scale_0.3_attention_scale_1.0 2.59
319
+ ngram_lm_scale_0.5_attention_scale_2.1 2.59
320
+ ngram_lm_scale_0.5_attention_scale_2.2 2.59
321
+ ngram_lm_scale_0.6_attention_scale_3.0 2.59
322
+ ngram_lm_scale_0.6_attention_scale_4.0 2.59
323
+ ngram_lm_scale_0.6_attention_scale_5.0 2.59
324
+ ngram_lm_scale_0.7_attention_scale_4.0 2.59
325
+ ngram_lm_scale_1.1_attention_scale_0.01 2.59
326
+ ngram_lm_scale_1.2_attention_scale_0.1 2.59
327
+ ngram_lm_scale_3.0_attention_scale_2.1 2.59
328
+ ngram_lm_scale_0.3_attention_scale_0.7 2.6
329
+ ngram_lm_scale_0.3_attention_scale_1.1 2.6
330
+ ngram_lm_scale_0.3_attention_scale_1.2 2.6
331
+ ngram_lm_scale_0.3_attention_scale_1.3 2.6
332
+ ngram_lm_scale_0.3_attention_scale_2.5 2.6
333
+ ngram_lm_scale_0.5_attention_scale_2.3 2.6
334
+ ngram_lm_scale_0.5_attention_scale_2.5 2.6
335
+ ngram_lm_scale_0.5_attention_scale_3.0 2.6
336
+ ngram_lm_scale_0.5_attention_scale_4.0 2.6
337
+ ngram_lm_scale_0.5_attention_scale_5.0 2.6
338
+ ngram_lm_scale_1.2_attention_scale_0.08 2.6
339
+ ngram_lm_scale_1.7_attention_scale_0.6 2.6
340
+ ngram_lm_scale_2.0_attention_scale_0.9 2.6
341
+ ngram_lm_scale_2.1_attention_scale_1.0 2.6
342
+ ngram_lm_scale_2.2_attention_scale_1.1 2.6
343
+ ngram_lm_scale_0.3_attention_scale_0.3 2.61
344
+ ngram_lm_scale_0.3_attention_scale_1.5 2.61
345
+ ngram_lm_scale_0.3_attention_scale_1.9 2.61
346
+ ngram_lm_scale_0.3_attention_scale_2.0 2.61
347
+ ngram_lm_scale_0.3_attention_scale_2.1 2.61
348
+ ngram_lm_scale_0.3_attention_scale_2.2 2.61
349
+ ngram_lm_scale_0.3_attention_scale_2.3 2.61
350
+ ngram_lm_scale_0.3_attention_scale_4.0 2.61
351
+ ngram_lm_scale_0.3_attention_scale_5.0 2.61
352
+ ngram_lm_scale_2.3_attention_scale_1.2 2.61
353
+ ngram_lm_scale_0.1_attention_scale_5.0 2.62
354
+ ngram_lm_scale_0.3_attention_scale_0.1 2.62
355
+ ngram_lm_scale_0.3_attention_scale_0.5 2.62
356
+ ngram_lm_scale_0.3_attention_scale_0.6 2.62
357
+ ngram_lm_scale_0.3_attention_scale_1.7 2.62
358
+ ngram_lm_scale_0.3_attention_scale_3.0 2.62
359
+ ngram_lm_scale_3.0_attention_scale_2.0 2.62
360
+ ngram_lm_scale_0.01_attention_scale_4.0 2.63
361
+ ngram_lm_scale_0.01_attention_scale_5.0 2.63
362
+ ngram_lm_scale_0.05_attention_scale_2.2 2.63
363
+ ngram_lm_scale_0.05_attention_scale_2.3 2.63
364
+ ngram_lm_scale_0.05_attention_scale_2.5 2.63
365
+ ngram_lm_scale_0.05_attention_scale_4.0 2.63
366
+ ngram_lm_scale_0.05_attention_scale_5.0 2.63
367
+ ngram_lm_scale_0.08_attention_scale_2.1 2.63
368
+ ngram_lm_scale_0.08_attention_scale_2.2 2.63
369
+ ngram_lm_scale_0.08_attention_scale_2.3 2.63
370
+ ngram_lm_scale_0.08_attention_scale_2.5 2.63
371
+ ngram_lm_scale_0.08_attention_scale_3.0 2.63
372
+ ngram_lm_scale_0.08_attention_scale_4.0 2.63
373
+ ngram_lm_scale_0.08_attention_scale_5.0 2.63
374
+ ngram_lm_scale_0.1_attention_scale_2.1 2.63
375
+ ngram_lm_scale_0.1_attention_scale_2.2 2.63
376
+ ngram_lm_scale_0.1_attention_scale_2.3 2.63
377
+ ngram_lm_scale_0.1_attention_scale_2.5 2.63
378
+ ngram_lm_scale_0.1_attention_scale_3.0 2.63
379
+ ngram_lm_scale_0.1_attention_scale_4.0 2.63
380
+ ngram_lm_scale_0.3_attention_scale_0.08 2.63
381
+ ngram_lm_scale_1.2_attention_scale_0.05 2.63
382
+ ngram_lm_scale_0.01_attention_scale_2.2 2.64
383
+ ngram_lm_scale_0.01_attention_scale_2.3 2.64
384
+ ngram_lm_scale_0.01_attention_scale_2.5 2.64
385
+ ngram_lm_scale_0.01_attention_scale_3.0 2.64
386
+ ngram_lm_scale_0.05_attention_scale_1.9 2.64
387
+ ngram_lm_scale_0.05_attention_scale_2.0 2.64
388
+ ngram_lm_scale_0.05_attention_scale_2.1 2.64
389
+ ngram_lm_scale_0.05_attention_scale_3.0 2.64
390
+ ngram_lm_scale_0.08_attention_scale_1.9 2.64
391
+ ngram_lm_scale_0.08_attention_scale_2.0 2.64
392
+ ngram_lm_scale_0.1_attention_scale_1.9 2.64
393
+ ngram_lm_scale_0.1_attention_scale_2.0 2.64
394
+ ngram_lm_scale_0.3_attention_scale_0.05 2.64
395
+ ngram_lm_scale_3.0_attention_scale_1.9 2.64
396
+ ngram_lm_scale_0.01_attention_scale_1.5 2.65
397
+ ngram_lm_scale_0.01_attention_scale_1.9 2.65
398
+ ngram_lm_scale_0.01_attention_scale_2.0 2.65
399
+ ngram_lm_scale_0.01_attention_scale_2.1 2.65
400
+ ngram_lm_scale_0.05_attention_scale_1.5 2.65
401
+ ngram_lm_scale_0.05_attention_scale_1.7 2.65
402
+ ngram_lm_scale_0.08_attention_scale_1.5 2.65
403
+ ngram_lm_scale_0.08_attention_scale_1.7 2.65
404
+ ngram_lm_scale_0.1_attention_scale_1.2 2.65
405
+ ngram_lm_scale_0.1_attention_scale_1.3 2.65
406
+ ngram_lm_scale_0.1_attention_scale_1.5 2.65
407
+ ngram_lm_scale_0.1_attention_scale_1.7 2.65
408
+ ngram_lm_scale_0.3_attention_scale_0.01 2.65
409
+ ngram_lm_scale_1.9_attention_scale_0.7 2.65
410
+ ngram_lm_scale_2.5_attention_scale_1.3 2.65
411
+ ngram_lm_scale_4.0_attention_scale_3.0 2.65
412
+ ngram_lm_scale_0.01_attention_scale_1.3 2.66
413
+ ngram_lm_scale_0.01_attention_scale_1.7 2.66
414
+ ngram_lm_scale_0.05_attention_scale_1.3 2.66
415
+ ngram_lm_scale_0.08_attention_scale_0.9 2.66
416
+ ngram_lm_scale_0.08_attention_scale_1.0 2.66
417
+ ngram_lm_scale_0.08_attention_scale_1.1 2.66
418
+ ngram_lm_scale_0.08_attention_scale_1.2 2.66
419
+ ngram_lm_scale_0.08_attention_scale_1.3 2.66
420
+ ngram_lm_scale_0.1_attention_scale_0.9 2.66
421
+ ngram_lm_scale_0.1_attention_scale_1.0 2.66
422
+ ngram_lm_scale_0.1_attention_scale_1.1 2.66
423
+ ngram_lm_scale_1.5_attention_scale_0.3 2.66
424
+ ngram_lm_scale_1.7_attention_scale_0.5 2.66
425
+ ngram_lm_scale_2.1_attention_scale_0.9 2.66
426
+ ngram_lm_scale_2.2_attention_scale_1.0 2.66
427
+ ngram_lm_scale_2.3_attention_scale_1.1 2.66
428
+ ngram_lm_scale_0.01_attention_scale_1.0 2.67
429
+ ngram_lm_scale_0.01_attention_scale_1.2 2.67
430
+ ngram_lm_scale_0.05_attention_scale_0.9 2.67
431
+ ngram_lm_scale_0.05_attention_scale_1.0 2.67
432
+ ngram_lm_scale_0.05_attention_scale_1.1 2.67
433
+ ngram_lm_scale_0.05_attention_scale_1.2 2.67
434
+ ngram_lm_scale_1.2_attention_scale_0.01 2.67
435
+ ngram_lm_scale_0.01_attention_scale_0.9 2.68
436
+ ngram_lm_scale_0.01_attention_scale_1.1 2.68
437
+ ngram_lm_scale_0.1_attention_scale_0.7 2.68
438
+ ngram_lm_scale_1.3_attention_scale_0.08 2.68
439
+ ngram_lm_scale_1.3_attention_scale_0.1 2.68
440
+ ngram_lm_scale_5.0_attention_scale_4.0 2.68
441
+ ngram_lm_scale_0.05_attention_scale_0.7 2.69
442
+ ngram_lm_scale_0.08_attention_scale_0.7 2.69
443
+ ngram_lm_scale_0.1_attention_scale_0.6 2.69
444
+ ngram_lm_scale_0.01_attention_scale_0.6 2.7
445
+ ngram_lm_scale_0.01_attention_scale_0.7 2.7
446
+ ngram_lm_scale_0.08_attention_scale_0.3 2.7
447
+ ngram_lm_scale_0.08_attention_scale_0.6 2.7
448
+ ngram_lm_scale_0.1_attention_scale_0.3 2.7
449
+ ngram_lm_scale_0.1_attention_scale_0.5 2.7
450
+ ngram_lm_scale_0.05_attention_scale_0.6 2.71
451
+ ngram_lm_scale_0.08_attention_scale_0.5 2.71
452
+ ngram_lm_scale_0.01_attention_scale_0.5 2.72
453
+ ngram_lm_scale_0.05_attention_scale_0.3 2.72
454
+ ngram_lm_scale_0.05_attention_scale_0.5 2.72
455
+ ngram_lm_scale_3.0_attention_scale_1.7 2.72
456
+ ngram_lm_scale_1.3_attention_scale_0.05 2.73
457
+ ngram_lm_scale_1.9_attention_scale_0.6 2.73
458
+ ngram_lm_scale_2.0_attention_scale_0.7 2.73
459
+ ngram_lm_scale_2.2_attention_scale_0.9 2.73
460
+ ngram_lm_scale_2.3_attention_scale_1.0 2.73
461
+ ngram_lm_scale_2.5_attention_scale_1.2 2.73
462
+ ngram_lm_scale_0.01_attention_scale_0.3 2.74
463
+ ngram_lm_scale_0.05_attention_scale_0.1 2.74
464
+ ngram_lm_scale_0.08_attention_scale_0.05 2.74
465
+ ngram_lm_scale_0.08_attention_scale_0.08 2.74
466
+ ngram_lm_scale_0.08_attention_scale_0.1 2.74
467
+ ngram_lm_scale_0.1_attention_scale_0.05 2.74
468
+ ngram_lm_scale_0.1_attention_scale_0.08 2.74
469
+ ngram_lm_scale_0.1_attention_scale_0.1 2.74
470
+ ngram_lm_scale_0.05_attention_scale_0.08 2.75
471
+ ngram_lm_scale_0.01_attention_scale_0.1 2.76
472
+ ngram_lm_scale_0.1_attention_scale_0.01 2.76
473
+ ngram_lm_scale_0.05_attention_scale_0.05 2.77
474
+ ngram_lm_scale_0.08_attention_scale_0.01 2.77
475
+ ngram_lm_scale_0.01_attention_scale_0.08 2.78
476
+ ngram_lm_scale_2.5_attention_scale_1.1 2.78
477
+ ngram_lm_scale_0.01_attention_scale_0.05 2.79
478
+ ngram_lm_scale_0.05_attention_scale_0.01 2.79
479
+ ngram_lm_scale_1.3_attention_scale_0.01 2.79
480
+ ngram_lm_scale_2.3_attention_scale_0.9 2.79
481
+ ngram_lm_scale_0.01_attention_scale_0.01 2.81
482
+ ngram_lm_scale_2.1_attention_scale_0.7 2.81
483
+ ngram_lm_scale_4.0_attention_scale_2.5 2.81
484
+ ngram_lm_scale_1.9_attention_scale_0.5 2.82
485
+ ngram_lm_scale_2.0_attention_scale_0.6 2.82
486
+ ngram_lm_scale_3.0_attention_scale_1.5 2.82
487
+ ngram_lm_scale_1.7_attention_scale_0.3 2.83
488
+ ngram_lm_scale_1.5_attention_scale_0.1 2.86
489
+ ngram_lm_scale_2.5_attention_scale_1.0 2.86
490
+ ngram_lm_scale_1.5_attention_scale_0.08 2.89
491
+ ngram_lm_scale_2.1_attention_scale_0.6 2.9
492
+ ngram_lm_scale_2.2_attention_scale_0.7 2.9
493
+ ngram_lm_scale_2.0_attention_scale_0.5 2.91
494
+ ngram_lm_scale_4.0_attention_scale_2.3 2.92
495
+ ngram_lm_scale_1.5_attention_scale_0.05 2.93
496
+ ngram_lm_scale_2.5_attention_scale_0.9 2.94
497
+ ngram_lm_scale_4.0_attention_scale_2.2 2.95
498
+ ngram_lm_scale_3.0_attention_scale_1.3 2.97
499
+ ngram_lm_scale_1.5_attention_scale_0.01 2.98
500
+ ngram_lm_scale_2.3_attention_scale_0.7 2.98
501
+ ngram_lm_scale_2.2_attention_scale_0.6 3.0
502
+ ngram_lm_scale_4.0_attention_scale_2.1 3.0
503
+ ngram_lm_scale_5.0_attention_scale_3.0 3.0
504
+ ngram_lm_scale_3.0_attention_scale_1.2 3.02
505
+ ngram_lm_scale_2.1_attention_scale_0.5 3.03
506
+ ngram_lm_scale_1.9_attention_scale_0.3 3.06
507
+ ngram_lm_scale_2.3_attention_scale_0.6 3.07
508
+ ngram_lm_scale_4.0_attention_scale_2.0 3.07
509
+ ngram_lm_scale_2.2_attention_scale_0.5 3.09
510
+ ngram_lm_scale_1.7_attention_scale_0.1 3.12
511
+ ngram_lm_scale_2.5_attention_scale_0.7 3.12
512
+ ngram_lm_scale_3.0_attention_scale_1.1 3.12
513
+ ngram_lm_scale_4.0_attention_scale_1.9 3.13
514
+ ngram_lm_scale_1.7_attention_scale_0.08 3.15
515
+ ngram_lm_scale_2.0_attention_scale_0.3 3.17
516
+ ngram_lm_scale_2.3_attention_scale_0.5 3.18
517
+ ngram_lm_scale_1.7_attention_scale_0.05 3.19
518
+ ngram_lm_scale_3.0_attention_scale_1.0 3.22
519
+ ngram_lm_scale_2.5_attention_scale_0.6 3.23
520
+ ngram_lm_scale_1.7_attention_scale_0.01 3.24
521
+ ngram_lm_scale_5.0_attention_scale_2.5 3.25
522
+ ngram_lm_scale_2.1_attention_scale_0.3 3.26
523
+ ngram_lm_scale_4.0_attention_scale_1.7 3.27
524
+ ngram_lm_scale_3.0_attention_scale_0.9 3.31
525
+ ngram_lm_scale_1.9_attention_scale_0.1 3.32
526
+ ngram_lm_scale_2.5_attention_scale_0.5 3.34
527
+ ngram_lm_scale_2.2_attention_scale_0.3 3.35
528
+ ngram_lm_scale_5.0_attention_scale_2.3 3.35
529
+ ngram_lm_scale_1.9_attention_scale_0.08 3.36
530
+ ngram_lm_scale_1.9_attention_scale_0.05 3.41
531
+ ngram_lm_scale_4.0_attention_scale_1.5 3.42
532
+ ngram_lm_scale_5.0_attention_scale_2.2 3.42
533
+ ngram_lm_scale_2.0_attention_scale_0.1 3.44
534
+ ngram_lm_scale_2.3_attention_scale_0.3 3.44
535
+ ngram_lm_scale_1.9_attention_scale_0.01 3.47
536
+ ngram_lm_scale_2.0_attention_scale_0.08 3.48
537
+ ngram_lm_scale_5.0_attention_scale_2.1 3.48
538
+ ngram_lm_scale_2.0_attention_scale_0.05 3.51
539
+ ngram_lm_scale_3.0_attention_scale_0.7 3.51
540
+ ngram_lm_scale_5.0_attention_scale_2.0 3.52
541
+ ngram_lm_scale_2.1_attention_scale_0.1 3.55
542
+ ngram_lm_scale_4.0_attention_scale_1.3 3.55
543
+ ngram_lm_scale_2.0_attention_scale_0.01 3.59
544
+ ngram_lm_scale_2.1_attention_scale_0.08 3.59
545
+ ngram_lm_scale_5.0_attention_scale_1.9 3.59
546
+ ngram_lm_scale_2.5_attention_scale_0.3 3.61
547
+ ngram_lm_scale_3.0_attention_scale_0.6 3.62
548
+ ngram_lm_scale_2.1_attention_scale_0.05 3.63
549
+ ngram_lm_scale_2.2_attention_scale_0.1 3.63
550
+ ngram_lm_scale_4.0_attention_scale_1.2 3.64
551
+ ngram_lm_scale_2.2_attention_scale_0.08 3.67
552
+ ngram_lm_scale_4.0_attention_scale_1.1 3.68
553
+ ngram_lm_scale_2.1_attention_scale_0.01 3.69
554
+ ngram_lm_scale_3.0_attention_scale_0.5 3.71
555
+ ngram_lm_scale_5.0_attention_scale_1.7 3.71
556
+ ngram_lm_scale_2.2_attention_scale_0.05 3.72
557
+ ngram_lm_scale_2.3_attention_scale_0.1 3.75
558
+ ngram_lm_scale_2.3_attention_scale_0.08 3.76
559
+ ngram_lm_scale_2.2_attention_scale_0.01 3.78
560
+ ngram_lm_scale_4.0_attention_scale_1.0 3.78
561
+ ngram_lm_scale_2.3_attention_scale_0.05 3.8
562
+ ngram_lm_scale_5.0_attention_scale_1.5 3.84
563
+ ngram_lm_scale_4.0_attention_scale_0.9 3.88
564
+ ngram_lm_scale_2.3_attention_scale_0.01 3.89
565
+ ngram_lm_scale_2.5_attention_scale_0.1 3.91
566
+ ngram_lm_scale_2.5_attention_scale_0.08 3.94
567
+ ngram_lm_scale_2.5_attention_scale_0.05 3.98
568
+ ngram_lm_scale_3.0_attention_scale_0.3 4.0
569
+ ngram_lm_scale_5.0_attention_scale_1.3 4.01
570
+ ngram_lm_scale_2.5_attention_scale_0.01 4.05
571
+ ngram_lm_scale_5.0_attention_scale_1.2 4.08
572
+ ngram_lm_scale_4.0_attention_scale_0.7 4.1
573
+ ngram_lm_scale_5.0_attention_scale_1.1 4.14
574
+ ngram_lm_scale_4.0_attention_scale_0.6 4.18
575
+ ngram_lm_scale_5.0_attention_scale_1.0 4.21
576
+ ngram_lm_scale_3.0_attention_scale_0.1 4.26
577
+ ngram_lm_scale_5.0_attention_scale_0.9 4.27
578
+ ngram_lm_scale_3.0_attention_scale_0.08 4.28
579
+ ngram_lm_scale_4.0_attention_scale_0.5 4.28
580
+ ngram_lm_scale_3.0_attention_scale_0.05 4.3
581
+ ngram_lm_scale_3.0_attention_scale_0.01 4.34
582
+ ngram_lm_scale_5.0_attention_scale_0.7 4.44
583
+ ngram_lm_scale_4.0_attention_scale_0.3 4.45
584
+ ngram_lm_scale_5.0_attention_scale_0.6 4.5
585
+ ngram_lm_scale_5.0_attention_scale_0.5 4.56
586
+ ngram_lm_scale_4.0_attention_scale_0.1 4.61
587
+ ngram_lm_scale_4.0_attention_scale_0.08 4.62
588
+ ngram_lm_scale_4.0_attention_scale_0.05 4.65
589
+ ngram_lm_scale_4.0_attention_scale_0.01 4.71
590
+ ngram_lm_scale_5.0_attention_scale_0.3 4.71
591
+ ngram_lm_scale_5.0_attention_scale_0.1 4.84
592
+ ngram_lm_scale_5.0_attention_scale_0.08 4.86
593
+ ngram_lm_scale_5.0_attention_scale_0.05 4.87
594
+ ngram_lm_scale_5.0_attention_scale_0.01 4.9
595
+
596
+ 2021-11-09 17:55:16,263 INFO [decode.py:476] batch 0/?, cuts processed until now is 6
597
+ 2021-11-09 17:56:58,045 INFO [decode.py:476] batch 100/?, cuts processed until now is 434
598
+ 2021-11-09 17:58:29,358 INFO [decode.py:476] batch 200/?, cuts processed until now is 885
599
+ 2021-11-09 18:00:01,752 INFO [decode.py:476] batch 300/?, cuts processed until now is 1327
600
+ 2021-11-09 18:01:37,944 INFO [decode.py:476] batch 400/?, cuts processed until now is 1807
601
+ 2021-11-09 18:03:17,784 INFO [decode.py:476] batch 500/?, cuts processed until now is 2238
602
+ 2021-11-09 18:04:44,506 INFO [decode.py:476] batch 600/?, cuts processed until now is 2584
603
+ 2021-11-09 18:06:26,405 INFO [decode.py:476] batch 700/?, cuts processed until now is 2785
604
+ 2021-11-09 18:11:34,377 INFO [decode.py:525]
605
+ For test-other, WER of different settings are:
606
+ ngram_lm_scale_2.0_attention_scale_2.0 5.73 best for test-other
607
+ ngram_lm_scale_2.1_attention_scale_2.2 5.73
608
+ ngram_lm_scale_2.2_attention_scale_2.3 5.73
609
+ ngram_lm_scale_2.2_attention_scale_2.5 5.73
610
+ ngram_lm_scale_2.3_attention_scale_2.5 5.73
611
+ ngram_lm_scale_1.5_attention_scale_1.3 5.74
612
+ ngram_lm_scale_1.5_attention_scale_1.5 5.74
613
+ ngram_lm_scale_2.0_attention_scale_2.1 5.74
614
+ ngram_lm_scale_2.1_attention_scale_2.1 5.74
615
+ ngram_lm_scale_2.1_attention_scale_2.3 5.74
616
+ ngram_lm_scale_2.5_attention_scale_3.0 5.74
617
+ ngram_lm_scale_3.0_attention_scale_4.0 5.74
618
+ ngram_lm_scale_1.3_attention_scale_1.0 5.75
619
+ ngram_lm_scale_1.3_attention_scale_1.1 5.75
620
+ ngram_lm_scale_1.7_attention_scale_1.7 5.75
621
+ ngram_lm_scale_1.9_attention_scale_1.9 5.75
622
+ ngram_lm_scale_1.9_attention_scale_2.1 5.75
623
+ ngram_lm_scale_2.0_attention_scale_1.9 5.75
624
+ ngram_lm_scale_2.0_attention_scale_2.2 5.75
625
+ ngram_lm_scale_2.3_attention_scale_3.0 5.75
626
+ ngram_lm_scale_2.5_attention_scale_4.0 5.75
627
+ ngram_lm_scale_3.0_attention_scale_5.0 5.75
628
+ ngram_lm_scale_1.2_attention_scale_1.1 5.76
629
+ ngram_lm_scale_1.3_attention_scale_0.9 5.76
630
+ ngram_lm_scale_1.3_attention_scale_1.2 5.76
631
+ ngram_lm_scale_1.3_attention_scale_1.3 5.76
632
+ ngram_lm_scale_1.5_attention_scale_1.2 5.76
633
+ ngram_lm_scale_1.7_attention_scale_1.5 5.76
634
+ ngram_lm_scale_1.9_attention_scale_1.7 5.76
635
+ ngram_lm_scale_1.9_attention_scale_2.0 5.76
636
+ ngram_lm_scale_2.0_attention_scale_3.0 5.76
637
+ ngram_lm_scale_2.1_attention_scale_3.0 5.76
638
+ ngram_lm_scale_2.2_attention_scale_2.2 5.76
639
+ ngram_lm_scale_1.1_attention_scale_0.9 5.77
640
+ ngram_lm_scale_1.1_attention_scale_1.0 5.77
641
+ ngram_lm_scale_1.2_attention_scale_0.9 5.77
642
+ ngram_lm_scale_1.9_attention_scale_2.2 5.77
643
+ ngram_lm_scale_1.9_attention_scale_2.3 5.77
644
+ ngram_lm_scale_2.0_attention_scale_2.3 5.77
645
+ ngram_lm_scale_2.0_attention_scale_2.5 5.77
646
+ ngram_lm_scale_2.2_attention_scale_2.1 5.77
647
+ ngram_lm_scale_2.2_attention_scale_3.0 5.77
648
+ ngram_lm_scale_2.3_attention_scale_2.3 5.77
649
+ ngram_lm_scale_1.0_attention_scale_1.0 5.78
650
+ ngram_lm_scale_1.1_attention_scale_1.3 5.78
651
+ ngram_lm_scale_1.2_attention_scale_1.0 5.78
652
+ ngram_lm_scale_1.2_attention_scale_1.2 5.78
653
+ ngram_lm_scale_1.3_attention_scale_1.5 5.78
654
+ ngram_lm_scale_1.5_attention_scale_1.1 5.78
655
+ ngram_lm_scale_1.5_attention_scale_1.7 5.78
656
+ ngram_lm_scale_1.5_attention_scale_2.0 5.78
657
+ ngram_lm_scale_1.7_attention_scale_1.9 5.78
658
+ ngram_lm_scale_1.7_attention_scale_2.0 5.78
659
+ ngram_lm_scale_1.7_attention_scale_2.2 5.78
660
+ ngram_lm_scale_1.7_attention_scale_2.3 5.78
661
+ ngram_lm_scale_1.9_attention_scale_2.5 5.78
662
+ ngram_lm_scale_2.0_attention_scale_1.7 5.78
663
+ ngram_lm_scale_2.1_attention_scale_1.9 5.78
664
+ ngram_lm_scale_2.1_attention_scale_2.0 5.78
665
+ ngram_lm_scale_2.1_attention_scale_2.5 5.78
666
+ ngram_lm_scale_2.3_attention_scale_2.2 5.78
667
+ ngram_lm_scale_2.3_attention_scale_4.0 5.78
668
+ ngram_lm_scale_2.5_attention_scale_2.5 5.78
669
+ ngram_lm_scale_4.0_attention_scale_5.0 5.78
670
+ ngram_lm_scale_1.0_attention_scale_0.9 5.79
671
+ ngram_lm_scale_1.0_attention_scale_1.2 5.79
672
+ ngram_lm_scale_1.1_attention_scale_1.1 5.79
673
+ ngram_lm_scale_1.1_attention_scale_1.2 5.79
674
+ ngram_lm_scale_1.2_attention_scale_1.3 5.79
675
+ ngram_lm_scale_1.2_attention_scale_1.5 5.79
676
+ ngram_lm_scale_1.5_attention_scale_1.9 5.79
677
+ ngram_lm_scale_1.5_attention_scale_2.1 5.79
678
+ ngram_lm_scale_1.7_attention_scale_1.3 5.79
679
+ ngram_lm_scale_1.7_attention_scale_2.1 5.79
680
+ ngram_lm_scale_1.7_attention_scale_2.5 5.79
681
+ ngram_lm_scale_1.9_attention_scale_3.0 5.79
682
+ ngram_lm_scale_2.2_attention_scale_4.0 5.79
683
+ ngram_lm_scale_2.5_attention_scale_5.0 5.79
684
+ ngram_lm_scale_0.9_attention_scale_0.7 5.8
685
+ ngram_lm_scale_1.0_attention_scale_1.1 5.8
686
+ ngram_lm_scale_1.0_attention_scale_1.3 5.8
687
+ ngram_lm_scale_1.3_attention_scale_1.7 5.8
688
+ ngram_lm_scale_1.5_attention_scale_0.9 5.8
689
+ ngram_lm_scale_1.5_attention_scale_1.0 5.8
690
+ ngram_lm_scale_1.5_attention_scale_2.2 5.8
691
+ ngram_lm_scale_1.7_attention_scale_3.0 5.8
692
+ ngram_lm_scale_2.2_attention_scale_2.0 5.8
693
+ ngram_lm_scale_0.9_attention_scale_1.1 5.81
694
+ ngram_lm_scale_1.0_attention_scale_0.5 5.81
695
+ ngram_lm_scale_1.0_attention_scale_0.7 5.81
696
+ ngram_lm_scale_1.1_attention_scale_0.7 5.81
697
+ ngram_lm_scale_1.1_attention_scale_1.5 5.81
698
+ ngram_lm_scale_1.2_attention_scale_0.7 5.81
699
+ ngram_lm_scale_1.2_attention_scale_1.7 5.81
700
+ ngram_lm_scale_1.5_attention_scale_2.3 5.81
701
+ ngram_lm_scale_1.5_attention_scale_2.5 5.81
702
+ ngram_lm_scale_1.9_attention_scale_1.5 5.81
703
+ ngram_lm_scale_2.1_attention_scale_4.0 5.81
704
+ ngram_lm_scale_2.2_attention_scale_1.9 5.81
705
+ ngram_lm_scale_2.3_attention_scale_2.1 5.81
706
+ ngram_lm_scale_0.9_attention_scale_0.6 5.82
707
+ ngram_lm_scale_0.9_attention_scale_0.9 5.82
708
+ ngram_lm_scale_0.9_attention_scale_1.0 5.82
709
+ ngram_lm_scale_0.9_attention_scale_1.2 5.82
710
+ ngram_lm_scale_1.0_attention_scale_1.5 5.82
711
+ ngram_lm_scale_1.1_attention_scale_1.7 5.82
712
+ ngram_lm_scale_1.2_attention_scale_2.0 5.82
713
+ ngram_lm_scale_1.2_attention_scale_2.1 5.82
714
+ ngram_lm_scale_1.3_attention_scale_0.7 5.82
715
+ ngram_lm_scale_1.3_attention_scale_1.9 5.82
716
+ ngram_lm_scale_1.3_attention_scale_2.0 5.82
717
+ ngram_lm_scale_1.3_attention_scale_2.1 5.82
718
+ ngram_lm_scale_1.3_attention_scale_2.2 5.82
719
+ ngram_lm_scale_1.7_attention_scale_1.2 5.82
720
+ ngram_lm_scale_2.0_attention_scale_4.0 5.82
721
+ ngram_lm_scale_2.3_attention_scale_2.0 5.82
722
+ ngram_lm_scale_2.5_attention_scale_2.3 5.82
723
+ ngram_lm_scale_3.0_attention_scale_3.0 5.82
724
+ ngram_lm_scale_0.9_attention_scale_1.3 5.83
725
+ ngram_lm_scale_1.0_attention_scale_0.6 5.83
726
+ ngram_lm_scale_1.0_attention_scale_1.7 5.83
727
+ ngram_lm_scale_1.1_attention_scale_0.6 5.83
728
+ ngram_lm_scale_1.1_attention_scale_1.9 5.83
729
+ ngram_lm_scale_1.2_attention_scale_1.9 5.83
730
+ ngram_lm_scale_1.3_attention_scale_2.3 5.83
731
+ ngram_lm_scale_1.9_attention_scale_4.0 5.83
732
+ ngram_lm_scale_2.1_attention_scale_1.7 5.83
733
+ ngram_lm_scale_0.9_attention_scale_0.5 5.84
734
+ ngram_lm_scale_0.9_attention_scale_1.5 5.84
735
+ ngram_lm_scale_1.0_attention_scale_1.9 5.84
736
+ ngram_lm_scale_1.1_attention_scale_2.0 5.84
737
+ ngram_lm_scale_1.2_attention_scale_0.6 5.84
738
+ ngram_lm_scale_1.2_attention_scale_2.2 5.84
739
+ ngram_lm_scale_1.2_attention_scale_2.3 5.84
740
+ ngram_lm_scale_1.7_attention_scale_1.1 5.84
741
+ ngram_lm_scale_2.0_attention_scale_1.5 5.84
742
+ ngram_lm_scale_2.0_attention_scale_5.0 5.84
743
+ ngram_lm_scale_2.1_attention_scale_5.0 5.84
744
+ ngram_lm_scale_2.3_attention_scale_5.0 5.84
745
+ ngram_lm_scale_2.5_attention_scale_2.1 5.84
746
+ ngram_lm_scale_2.5_attention_scale_2.2 5.84
747
+ ngram_lm_scale_1.0_attention_scale_2.0 5.85
748
+ ngram_lm_scale_1.0_attention_scale_2.1 5.85
749
+ ngram_lm_scale_1.1_attention_scale_0.5 5.85
750
+ ngram_lm_scale_1.1_attention_scale_2.1 5.85
751
+ ngram_lm_scale_1.1_attention_scale_2.2 5.85
752
+ ngram_lm_scale_1.2_attention_scale_0.5 5.85
753
+ ngram_lm_scale_1.3_attention_scale_0.6 5.85
754
+ ngram_lm_scale_1.3_attention_scale_2.5 5.85
755
+ ngram_lm_scale_1.5_attention_scale_3.0 5.85
756
+ ngram_lm_scale_1.7_attention_scale_4.0 5.85
757
+ ngram_lm_scale_1.9_attention_scale_1.3 5.85
758
+ ngram_lm_scale_2.2_attention_scale_5.0 5.85
759
+ ngram_lm_scale_2.3_attention_scale_1.9 5.85
760
+ ngram_lm_scale_0.7_attention_scale_0.6 5.86
761
+ ngram_lm_scale_0.9_attention_scale_1.7 5.86
762
+ ngram_lm_scale_1.1_attention_scale_2.3 5.86
763
+ ngram_lm_scale_1.2_attention_scale_2.5 5.86
764
+ ngram_lm_scale_1.9_attention_scale_1.2 5.86
765
+ ngram_lm_scale_1.9_attention_scale_5.0 5.86
766
+ ngram_lm_scale_2.2_attention_scale_1.7 5.86
767
+ ngram_lm_scale_0.7_attention_scale_0.7 5.87
768
+ ngram_lm_scale_0.7_attention_scale_0.9 5.87
769
+ ngram_lm_scale_1.0_attention_scale_2.2 5.87
770
+ ngram_lm_scale_1.0_attention_scale_2.3 5.87
771
+ ngram_lm_scale_1.2_attention_scale_3.0 5.87
772
+ ngram_lm_scale_1.3_attention_scale_3.0 5.87
773
+ ngram_lm_scale_1.5_attention_scale_4.0 5.87
774
+ ngram_lm_scale_1.7_attention_scale_1.0 5.87
775
+ ngram_lm_scale_2.1_attention_scale_1.5 5.87
776
+ ngram_lm_scale_2.3_attention_scale_1.7 5.87
777
+ ngram_lm_scale_2.5_attention_scale_2.0 5.87
778
+ ngram_lm_scale_0.7_attention_scale_0.5 5.88
779
+ ngram_lm_scale_0.9_attention_scale_0.3 5.88
780
+ ngram_lm_scale_0.9_attention_scale_1.9 5.88
781
+ ngram_lm_scale_1.1_attention_scale_2.5 5.88
782
+ ngram_lm_scale_1.5_attention_scale_0.7 5.88
783
+ ngram_lm_scale_2.0_attention_scale_1.3 5.88
784
+ ngram_lm_scale_0.7_attention_scale_1.0 5.89
785
+ ngram_lm_scale_0.9_attention_scale_2.0 5.89
786
+ ngram_lm_scale_1.0_attention_scale_2.5 5.89
787
+ ngram_lm_scale_1.3_attention_scale_0.5 5.89
788
+ ngram_lm_scale_1.7_attention_scale_5.0 5.89
789
+ ngram_lm_scale_2.5_attention_scale_1.9 5.89
790
+ ngram_lm_scale_0.7_attention_scale_1.1 5.9
791
+ ngram_lm_scale_0.7_attention_scale_1.3 5.9
792
+ ngram_lm_scale_0.9_attention_scale_2.1 5.9
793
+ ngram_lm_scale_1.7_attention_scale_0.9 5.9
794
+ ngram_lm_scale_2.2_attention_scale_1.5 5.9
795
+ ngram_lm_scale_4.0_attention_scale_4.0 5.9
796
+ ngram_lm_scale_0.6_attention_scale_0.6 5.91
797
+ ngram_lm_scale_0.7_attention_scale_1.2 5.91
798
+ ngram_lm_scale_0.9_attention_scale_2.2 5.91
799
+ ngram_lm_scale_1.1_attention_scale_3.0 5.91
800
+ ngram_lm_scale_1.5_attention_scale_5.0 5.91
801
+ ngram_lm_scale_1.9_attention_scale_1.1 5.91
802
+ ngram_lm_scale_2.0_attention_scale_1.2 5.91
803
+ ngram_lm_scale_0.6_attention_scale_0.5 5.92
804
+ ngram_lm_scale_0.7_attention_scale_1.5 5.92
805
+ ngram_lm_scale_0.9_attention_scale_2.3 5.92
806
+ ngram_lm_scale_1.0_attention_scale_0.3 5.92
807
+ ngram_lm_scale_1.3_attention_scale_4.0 5.92
808
+ ngram_lm_scale_3.0_attention_scale_2.5 5.92
809
+ ngram_lm_scale_0.6_attention_scale_0.7 5.93
810
+ ngram_lm_scale_0.7_attention_scale_0.3 5.93
811
+ ngram_lm_scale_1.0_attention_scale_3.0 5.93
812
+ ngram_lm_scale_2.1_attention_scale_1.3 5.93
813
+ ngram_lm_scale_2.3_attention_scale_1.5 5.93
814
+ ngram_lm_scale_0.9_attention_scale_2.5 5.94
815
+ ngram_lm_scale_1.2_attention_scale_4.0 5.94
816
+ ngram_lm_scale_1.9_attention_scale_1.0 5.94
817
+ ngram_lm_scale_2.0_attention_scale_1.1 5.94
818
+ ngram_lm_scale_0.7_attention_scale_1.7 5.95
819
+ ngram_lm_scale_0.9_attention_scale_3.0 5.95
820
+ ngram_lm_scale_1.1_attention_scale_0.3 5.95
821
+ ngram_lm_scale_2.1_attention_scale_1.2 5.95
822
+ ngram_lm_scale_0.6_attention_scale_1.0 5.96
823
+ ngram_lm_scale_0.6_attention_scale_1.1 5.96
824
+ ngram_lm_scale_0.6_attention_scale_1.2 5.96
825
+ ngram_lm_scale_0.7_attention_scale_1.9 5.96
826
+ ngram_lm_scale_1.1_attention_scale_4.0 5.96
827
+ ngram_lm_scale_1.3_attention_scale_5.0 5.96
828
+ ngram_lm_scale_1.5_attention_scale_0.6 5.96
829
+ ngram_lm_scale_5.0_attention_scale_5.0 5.96
830
+ ngram_lm_scale_0.6_attention_scale_0.3 5.97
831
+ ngram_lm_scale_0.6_attention_scale_0.9 5.97
832
+ ngram_lm_scale_0.6_attention_scale_1.3 5.97
833
+ ngram_lm_scale_0.7_attention_scale_2.0 5.97
834
+ ngram_lm_scale_0.7_attention_scale_2.1 5.97
835
+ ngram_lm_scale_1.2_attention_scale_5.0 5.97
836
+ ngram_lm_scale_2.2_attention_scale_1.3 5.97
837
+ ngram_lm_scale_0.7_attention_scale_2.2 5.98
838
+ ngram_lm_scale_0.7_attention_scale_2.3 5.98
839
+ ngram_lm_scale_1.0_attention_scale_4.0 5.98
840
+ ngram_lm_scale_2.5_attention_scale_1.7 5.98
841
+ ngram_lm_scale_0.5_attention_scale_0.5 5.99
842
+ ngram_lm_scale_0.5_attention_scale_0.9 5.99
843
+ ngram_lm_scale_0.6_attention_scale_1.5 5.99
844
+ ngram_lm_scale_0.6_attention_scale_1.7 5.99
845
+ ngram_lm_scale_0.7_attention_scale_0.05 5.99
846
+ ngram_lm_scale_0.7_attention_scale_0.1 5.99
847
+ ngram_lm_scale_0.7_attention_scale_2.5 5.99
848
+ ngram_lm_scale_0.9_attention_scale_0.1 5.99
849
+ ngram_lm_scale_0.9_attention_scale_4.0 5.99
850
+ ngram_lm_scale_1.1_attention_scale_5.0 5.99
851
+ ngram_lm_scale_2.0_attention_scale_1.0 5.99
852
+ ngram_lm_scale_3.0_attention_scale_2.3 5.99
853
+ ngram_lm_scale_0.5_attention_scale_0.7 6.0
854
+ ngram_lm_scale_0.5_attention_scale_1.0 6.0
855
+ ngram_lm_scale_0.5_attention_scale_1.1 6.0
856
+ ngram_lm_scale_0.6_attention_scale_1.9 6.0
857
+ ngram_lm_scale_0.7_attention_scale_0.08 6.0
858
+ ngram_lm_scale_0.9_attention_scale_0.08 6.0
859
+ ngram_lm_scale_1.2_attention_scale_0.3 6.0
860
+ ngram_lm_scale_1.7_attention_scale_0.7 6.0
861
+ ngram_lm_scale_1.9_attention_scale_0.9 6.0
862
+ ngram_lm_scale_2.1_attention_scale_1.1 6.0
863
+ ngram_lm_scale_0.5_attention_scale_0.3 6.01
864
+ ngram_lm_scale_0.5_attention_scale_0.6 6.01
865
+ ngram_lm_scale_0.6_attention_scale_2.0 6.01
866
+ ngram_lm_scale_0.7_attention_scale_3.0 6.01
867
+ ngram_lm_scale_0.9_attention_scale_5.0 6.01
868
+ ngram_lm_scale_1.0_attention_scale_5.0 6.01
869
+ ngram_lm_scale_2.2_attention_scale_1.2 6.01
870
+ ngram_lm_scale_2.3_attention_scale_1.3 6.01
871
+ ngram_lm_scale_3.0_attention_scale_2.2 6.01
872
+ ngram_lm_scale_0.5_attention_scale_1.2 6.02
873
+ ngram_lm_scale_0.5_attention_scale_1.3 6.02
874
+ ngram_lm_scale_0.6_attention_scale_2.1 6.02
875
+ ngram_lm_scale_0.6_attention_scale_2.2 6.02
876
+ ngram_lm_scale_0.6_attention_scale_2.3 6.02
877
+ ngram_lm_scale_1.5_attention_scale_0.5 6.02
878
+ ngram_lm_scale_0.5_attention_scale_1.5 6.03
879
+ ngram_lm_scale_0.6_attention_scale_2.5 6.03
880
+ ngram_lm_scale_0.9_attention_scale_0.05 6.03
881
+ ngram_lm_scale_2.5_attention_scale_1.5 6.03
882
+ ngram_lm_scale_0.5_attention_scale_1.7 6.04
883
+ ngram_lm_scale_0.5_attention_scale_1.9 6.04
884
+ ngram_lm_scale_0.5_attention_scale_2.0 6.04
885
+ ngram_lm_scale_0.6_attention_scale_3.0 6.04
886
+ ngram_lm_scale_0.7_attention_scale_0.01 6.04
887
+ ngram_lm_scale_0.5_attention_scale_2.1 6.05
888
+ ngram_lm_scale_0.5_attention_scale_2.5 6.05
889
+ ngram_lm_scale_0.6_attention_scale_0.08 6.05
890
+ ngram_lm_scale_0.6_attention_scale_0.1 6.05
891
+ ngram_lm_scale_1.0_attention_scale_0.1 6.05
892
+ ngram_lm_scale_1.7_attention_scale_0.6 6.05
893
+ ngram_lm_scale_0.5_attention_scale_2.2 6.06
894
+ ngram_lm_scale_0.5_attention_scale_2.3 6.06
895
+ ngram_lm_scale_0.6_attention_scale_0.05 6.06
896
+ ngram_lm_scale_0.7_attention_scale_4.0 6.06
897
+ ngram_lm_scale_1.3_attention_scale_0.3 6.06
898
+ ngram_lm_scale_2.0_attention_scale_0.9 6.06
899
+ ngram_lm_scale_3.0_attention_scale_2.1 6.06
900
+ ngram_lm_scale_0.5_attention_scale_3.0 6.07
901
+ ngram_lm_scale_0.6_attention_scale_4.0 6.07
902
+ ngram_lm_scale_0.7_attention_scale_5.0 6.07
903
+ ngram_lm_scale_1.0_attention_scale_0.08 6.07
904
+ ngram_lm_scale_2.1_attention_scale_1.0 6.07
905
+ ngram_lm_scale_0.5_attention_scale_0.08 6.08
906
+ ngram_lm_scale_0.5_attention_scale_4.0 6.08
907
+ ngram_lm_scale_0.9_attention_scale_0.01 6.08
908
+ ngram_lm_scale_1.0_attention_scale_0.05 6.08
909
+ ngram_lm_scale_2.2_attention_scale_1.1 6.08
910
+ ngram_lm_scale_2.3_attention_scale_1.2 6.08
911
+ ngram_lm_scale_0.5_attention_scale_0.1 6.09
912
+ ngram_lm_scale_0.6_attention_scale_0.01 6.09
913
+ ngram_lm_scale_3.0_attention_scale_2.0 6.09
914
+ ngram_lm_scale_0.6_attention_scale_5.0 6.1
915
+ ngram_lm_scale_1.1_attention_scale_0.1 6.1
916
+ ngram_lm_scale_0.3_attention_scale_2.3 6.11
917
+ ngram_lm_scale_0.3_attention_scale_2.5 6.11
918
+ ngram_lm_scale_0.5_attention_scale_0.05 6.11
919
+ ngram_lm_scale_3.0_attention_scale_1.9 6.11
920
+ ngram_lm_scale_0.3_attention_scale_1.0 6.12
921
+ ngram_lm_scale_0.3_attention_scale_1.1 6.12
922
+ ngram_lm_scale_0.3_attention_scale_1.2 6.12
923
+ ngram_lm_scale_0.3_attention_scale_1.3 6.12
924
+ ngram_lm_scale_0.3_attention_scale_2.2 6.12
925
+ ngram_lm_scale_0.3_attention_scale_3.0 6.12
926
+ ngram_lm_scale_0.5_attention_scale_5.0 6.12
927
+ ngram_lm_scale_1.1_attention_scale_0.08 6.12
928
+ ngram_lm_scale_0.3_attention_scale_0.7 6.13
929
+ ngram_lm_scale_0.3_attention_scale_0.9 6.13
930
+ ngram_lm_scale_0.3_attention_scale_1.5 6.13
931
+ ngram_lm_scale_0.3_attention_scale_2.1 6.13
932
+ ngram_lm_scale_1.0_attention_scale_0.01 6.13
933
+ ngram_lm_scale_0.3_attention_scale_0.5 6.14
934
+ ngram_lm_scale_0.3_attention_scale_0.6 6.14
935
+ ngram_lm_scale_0.3_attention_scale_1.7 6.14
936
+ ngram_lm_scale_0.3_attention_scale_1.9 6.14
937
+ ngram_lm_scale_0.3_attention_scale_2.0 6.14
938
+ ngram_lm_scale_0.3_attention_scale_4.0 6.14
939
+ ngram_lm_scale_0.5_attention_scale_0.01 6.14
940
+ ngram_lm_scale_0.3_attention_scale_0.3 6.15
941
+ ngram_lm_scale_1.1_attention_scale_0.05 6.15
942
+ ngram_lm_scale_4.0_attention_scale_3.0 6.15
943
+ ngram_lm_scale_2.2_attention_scale_1.0 6.16
944
+ ngram_lm_scale_2.3_attention_scale_1.1 6.16
945
+ ngram_lm_scale_0.08_attention_scale_4.0 6.17
946
+ ngram_lm_scale_0.1_attention_scale_4.0 6.17
947
+ ngram_lm_scale_0.3_attention_scale_5.0 6.17
948
+ ngram_lm_scale_1.2_attention_scale_0.1 6.17
949
+ ngram_lm_scale_1.9_attention_scale_0.7 6.17
950
+ ngram_lm_scale_2.1_attention_scale_0.9 6.17
951
+ ngram_lm_scale_2.5_attention_scale_1.3 6.17
952
+ ngram_lm_scale_5.0_attention_scale_4.0 6.17
953
+ ngram_lm_scale_0.05_attention_scale_4.0 6.18
954
+ ngram_lm_scale_0.05_attention_scale_5.0 6.18
955
+ ngram_lm_scale_0.1_attention_scale_3.0 6.18
956
+ ngram_lm_scale_0.1_attention_scale_5.0 6.18
957
+ ngram_lm_scale_1.1_attention_scale_0.01 6.18
958
+ ngram_lm_scale_1.2_attention_scale_0.08 6.18
959
+ ngram_lm_scale_0.01_attention_scale_4.0 6.19
960
+ ngram_lm_scale_0.01_attention_scale_5.0 6.19
961
+ ngram_lm_scale_0.05_attention_scale_3.0 6.19
962
+ ngram_lm_scale_0.08_attention_scale_3.0 6.19
963
+ ngram_lm_scale_0.08_attention_scale_5.0 6.19
964
+ ngram_lm_scale_0.1_attention_scale_2.2 6.19
965
+ ngram_lm_scale_0.08_attention_scale_2.2 6.2
966
+ ngram_lm_scale_0.08_attention_scale_2.3 6.2
967
+ ngram_lm_scale_0.08_attention_scale_2.5 6.2
968
+ ngram_lm_scale_0.1_attention_scale_2.0 6.2
969
+ ngram_lm_scale_0.1_attention_scale_2.1 6.2
970
+ ngram_lm_scale_0.1_attention_scale_2.3 6.2
971
+ ngram_lm_scale_0.1_attention_scale_2.5 6.2
972
+ ngram_lm_scale_1.7_attention_scale_0.5 6.2
973
+ ngram_lm_scale_0.01_attention_scale_3.0 6.21
974
+ ngram_lm_scale_0.05_attention_scale_1.9 6.21
975
+ ngram_lm_scale_0.05_attention_scale_2.0 6.21
976
+ ngram_lm_scale_0.05_attention_scale_2.2 6.21
977
+ ngram_lm_scale_0.05_attention_scale_2.3 6.21
978
+ ngram_lm_scale_0.05_attention_scale_2.5 6.21
979
+ ngram_lm_scale_0.08_attention_scale_1.9 6.21
980
+ ngram_lm_scale_0.08_attention_scale_2.0 6.21
981
+ ngram_lm_scale_0.08_attention_scale_2.1 6.21
982
+ ngram_lm_scale_0.1_attention_scale_1.3 6.21
983
+ ngram_lm_scale_0.1_attention_scale_1.5 6.21
984
+ ngram_lm_scale_0.1_attention_scale_1.7 6.21
985
+ ngram_lm_scale_0.1_attention_scale_1.9 6.21
986
+ ngram_lm_scale_1.2_attention_scale_0.05 6.21
987
+ ngram_lm_scale_0.01_attention_scale_2.2 6.22
988
+ ngram_lm_scale_0.05_attention_scale_2.1 6.22
989
+ ngram_lm_scale_0.08_attention_scale_1.5 6.22
990
+ ngram_lm_scale_0.08_attention_scale_1.7 6.22
991
+ ngram_lm_scale_0.3_attention_scale_0.08 6.22
992
+ ngram_lm_scale_0.01_attention_scale_1.9 6.23
993
+ ngram_lm_scale_0.01_attention_scale_2.0 6.23
994
+ ngram_lm_scale_0.01_attention_scale_2.1 6.23
995
+ ngram_lm_scale_0.01_attention_scale_2.3 6.23
996
+ ngram_lm_scale_0.01_attention_scale_2.5 6.23
997
+ ngram_lm_scale_0.05_attention_scale_1.5 6.23
998
+ ngram_lm_scale_0.05_attention_scale_1.7 6.23
999
+ ngram_lm_scale_0.08_attention_scale_1.2 6.23
1000
+ ngram_lm_scale_0.08_attention_scale_1.3 6.23
1001
+ ngram_lm_scale_0.1_attention_scale_1.2 6.23
1002
+ ngram_lm_scale_0.3_attention_scale_0.1 6.23
1003
+ ngram_lm_scale_1.5_attention_scale_0.3 6.23
1004
+ ngram_lm_scale_0.01_attention_scale_1.7 6.24
1005
+ ngram_lm_scale_0.08_attention_scale_1.1 6.24
1006
+ ngram_lm_scale_0.1_attention_scale_1.0 6.24
1007
+ ngram_lm_scale_0.1_attention_scale_1.1 6.24
1008
+ ngram_lm_scale_0.3_attention_scale_0.05 6.24
1009
+ ngram_lm_scale_0.01_attention_scale_1.5 6.25
1010
+ ngram_lm_scale_0.05_attention_scale_1.3 6.25
1011
+ ngram_lm_scale_0.08_attention_scale_1.0 6.25
1012
+ ngram_lm_scale_0.1_attention_scale_0.9 6.25
1013
+ ngram_lm_scale_2.3_attention_scale_1.0 6.25
1014
+ ngram_lm_scale_2.5_attention_scale_1.2 6.25
1015
+ ngram_lm_scale_0.05_attention_scale_1.2 6.26
1016
+ ngram_lm_scale_0.08_attention_scale_0.9 6.26
1017
+ ngram_lm_scale_0.1_attention_scale_0.7 6.26
1018
+ ngram_lm_scale_1.3_attention_scale_0.1 6.26
1019
+ ngram_lm_scale_2.2_attention_scale_0.9 6.26
1020
+ ngram_lm_scale_0.01_attention_scale_1.2 6.27
1021
+ ngram_lm_scale_0.01_attention_scale_1.3 6.27
1022
+ ngram_lm_scale_0.05_attention_scale_1.0 6.27
1023
+ ngram_lm_scale_0.05_attention_scale_1.1 6.27
1024
+ ngram_lm_scale_0.1_attention_scale_0.5 6.27
1025
+ ngram_lm_scale_0.1_attention_scale_0.6 6.27
1026
+ ngram_lm_scale_3.0_attention_scale_1.7 6.27
1027
+ ngram_lm_scale_0.01_attention_scale_1.1 6.28
1028
+ ngram_lm_scale_0.05_attention_scale_0.9 6.28
1029
+ ngram_lm_scale_0.08_attention_scale_0.6 6.28
1030
+ ngram_lm_scale_0.08_attention_scale_0.7 6.28
1031
+ ngram_lm_scale_0.3_attention_scale_0.01 6.28
1032
+ ngram_lm_scale_1.2_attention_scale_0.01 6.28
1033
+ ngram_lm_scale_1.9_attention_scale_0.6 6.28
1034
+ ngram_lm_scale_2.0_attention_scale_0.7 6.28
1035
+ ngram_lm_scale_0.05_attention_scale_0.7 6.29
1036
+ ngram_lm_scale_0.08_attention_scale_0.5 6.29
1037
+ ngram_lm_scale_0.01_attention_scale_1.0 6.3
1038
+ ngram_lm_scale_0.05_attention_scale_0.6 6.3
1039
+ ngram_lm_scale_1.3_attention_scale_0.08 6.3
1040
+ ngram_lm_scale_0.05_attention_scale_0.5 6.31
1041
+ ngram_lm_scale_0.1_attention_scale_0.3 6.31
1042
+ ngram_lm_scale_0.01_attention_scale_0.6 6.32
1043
+ ngram_lm_scale_0.01_attention_scale_0.7 6.32
1044
+ ngram_lm_scale_0.01_attention_scale_0.9 6.32
1045
+ ngram_lm_scale_0.01_attention_scale_0.5 6.33
1046
+ ngram_lm_scale_0.08_attention_scale_0.3 6.34
1047
+ ngram_lm_scale_2.5_attention_scale_1.1 6.34
1048
+ ngram_lm_scale_1.3_attention_scale_0.05 6.36
1049
+ ngram_lm_scale_2.3_attention_scale_0.9 6.36
1050
+ ngram_lm_scale_0.05_attention_scale_0.3 6.37
1051
+ ngram_lm_scale_0.01_attention_scale_0.3 6.4
1052
+ ngram_lm_scale_2.0_attention_scale_0.6 6.4
1053
+ ngram_lm_scale_2.1_attention_scale_0.7 6.4
1054
+ ngram_lm_scale_4.0_attention_scale_2.5 6.4
1055
+ ngram_lm_scale_1.9_attention_scale_0.5 6.43
1056
+ ngram_lm_scale_3.0_attention_scale_1.5 6.43
1057
+ ngram_lm_scale_1.3_attention_scale_0.01 6.44
1058
+ ngram_lm_scale_0.1_attention_scale_0.1 6.45
1059
+ ngram_lm_scale_0.08_attention_scale_0.1 6.46
1060
+ ngram_lm_scale_0.1_attention_scale_0.08 6.47
1061
+ ngram_lm_scale_1.7_attention_scale_0.3 6.47
1062
+ ngram_lm_scale_2.5_attention_scale_1.0 6.47
1063
+ ngram_lm_scale_0.08_attention_scale_0.08 6.48
1064
+ ngram_lm_scale_0.1_attention_scale_0.05 6.49
1065
+ ngram_lm_scale_0.05_attention_scale_0.1 6.5
1066
+ ngram_lm_scale_0.05_attention_scale_0.08 6.51
1067
+ ngram_lm_scale_0.08_attention_scale_0.05 6.51
1068
+ ngram_lm_scale_0.1_attention_scale_0.01 6.52
1069
+ ngram_lm_scale_2.2_attention_scale_0.7 6.53
1070
+ ngram_lm_scale_4.0_attention_scale_2.3 6.53
1071
+ ngram_lm_scale_0.05_attention_scale_0.05 6.54
1072
+ ngram_lm_scale_0.08_attention_scale_0.01 6.54
1073
+ ngram_lm_scale_2.1_attention_scale_0.6 6.54
1074
+ ngram_lm_scale_0.01_attention_scale_0.1 6.55
1075
+ ngram_lm_scale_2.0_attention_scale_0.5 6.56
1076
+ ngram_lm_scale_4.0_attention_scale_2.2 6.57
1077
+ ngram_lm_scale_0.05_attention_scale_0.01 6.58
1078
+ ngram_lm_scale_1.5_attention_scale_0.1 6.58
1079
+ ngram_lm_scale_0.01_attention_scale_0.08 6.59
1080
+ ngram_lm_scale_2.5_attention_scale_0.9 6.59
1081
+ ngram_lm_scale_5.0_attention_scale_3.0 6.59
1082
+ ngram_lm_scale_0.01_attention_scale_0.05 6.61
1083
+ ngram_lm_scale_2.3_attention_scale_0.7 6.61
1084
+ ngram_lm_scale_3.0_attention_scale_1.3 6.61
1085
+ ngram_lm_scale_1.5_attention_scale_0.08 6.62
1086
+ ngram_lm_scale_2.1_attention_scale_0.5 6.63
1087
+ ngram_lm_scale_2.2_attention_scale_0.6 6.64
1088
+ ngram_lm_scale_4.0_attention_scale_2.1 6.64
1089
+ ngram_lm_scale_0.01_attention_scale_0.01 6.65
1090
+ ngram_lm_scale_1.5_attention_scale_0.05 6.69
1091
+ ngram_lm_scale_3.0_attention_scale_1.2 6.7
1092
+ ngram_lm_scale_4.0_attention_scale_2.0 6.71
1093
+ ngram_lm_scale_2.3_attention_scale_0.6 6.72
1094
+ ngram_lm_scale_1.9_attention_scale_0.3 6.73
1095
+ ngram_lm_scale_2.2_attention_scale_0.5 6.76
1096
+ ngram_lm_scale_1.5_attention_scale_0.01 6.77
1097
+ ngram_lm_scale_2.5_attention_scale_0.7 6.8
1098
+ ngram_lm_scale_3.0_attention_scale_1.1 6.8
1099
+ ngram_lm_scale_4.0_attention_scale_1.9 6.81
1100
+ ngram_lm_scale_1.7_attention_scale_0.1 6.86
1101
+ ngram_lm_scale_2.0_attention_scale_0.3 6.86
1102
+ ngram_lm_scale_1.7_attention_scale_0.08 6.89
1103
+ ngram_lm_scale_2.3_attention_scale_0.5 6.89
1104
+ ngram_lm_scale_3.0_attention_scale_1.0 6.91
1105
+ ngram_lm_scale_5.0_attention_scale_2.5 6.92
1106
+ ngram_lm_scale_1.7_attention_scale_0.05 6.94
1107
+ ngram_lm_scale_2.5_attention_scale_0.6 6.94
1108
+ ngram_lm_scale_2.1_attention_scale_0.3 6.98
1109
+ ngram_lm_scale_4.0_attention_scale_1.7 6.99
1110
+ ngram_lm_scale_1.7_attention_scale_0.01 7.04
1111
+ ngram_lm_scale_3.0_attention_scale_0.9 7.06
1112
+ ngram_lm_scale_2.5_attention_scale_0.5 7.1
1113
+ ngram_lm_scale_5.0_attention_scale_2.3 7.1
1114
+ ngram_lm_scale_2.2_attention_scale_0.3 7.13
1115
+ ngram_lm_scale_1.9_attention_scale_0.1 7.15
1116
+ ngram_lm_scale_5.0_attention_scale_2.2 7.17
1117
+ ngram_lm_scale_4.0_attention_scale_1.5 7.2
1118
+ ngram_lm_scale_1.9_attention_scale_0.08 7.22
1119
+ ngram_lm_scale_5.0_attention_scale_2.1 7.24
1120
+ ngram_lm_scale_2.3_attention_scale_0.3 7.27
1121
+ ngram_lm_scale_1.9_attention_scale_0.05 7.3
1122
+ ngram_lm_scale_5.0_attention_scale_2.0 7.31
1123
+ ngram_lm_scale_2.0_attention_scale_0.1 7.33
1124
+ ngram_lm_scale_3.0_attention_scale_0.7 7.33
1125
+ ngram_lm_scale_4.0_attention_scale_1.3 7.36
1126
+ ngram_lm_scale_2.0_attention_scale_0.08 7.37
1127
+ ngram_lm_scale_5.0_attention_scale_1.9 7.38
1128
+ ngram_lm_scale_1.9_attention_scale_0.01 7.41
1129
+ ngram_lm_scale_2.0_attention_scale_0.05 7.45
1130
+ ngram_lm_scale_3.0_attention_scale_0.6 7.45
1131
+ ngram_lm_scale_4.0_attention_scale_1.2 7.45
1132
+ ngram_lm_scale_2.1_attention_scale_0.1 7.46
1133
+ ngram_lm_scale_2.5_attention_scale_0.3 7.48
1134
+ ngram_lm_scale_2.1_attention_scale_0.08 7.5
1135
+ ngram_lm_scale_2.0_attention_scale_0.01 7.52
1136
+ ngram_lm_scale_5.0_attention_scale_1.7 7.53
1137
+ ngram_lm_scale_4.0_attention_scale_1.1 7.56
1138
+ ngram_lm_scale_2.1_attention_scale_0.05 7.57
1139
+ ngram_lm_scale_2.2_attention_scale_0.1 7.58
1140
+ ngram_lm_scale_3.0_attention_scale_0.5 7.62
1141
+ ngram_lm_scale_2.2_attention_scale_0.08 7.64
1142
+ ngram_lm_scale_2.1_attention_scale_0.01 7.67
1143
+ ngram_lm_scale_4.0_attention_scale_1.0 7.67
1144
+ ngram_lm_scale_2.3_attention_scale_0.1 7.68
1145
+ ngram_lm_scale_2.2_attention_scale_0.05 7.69
1146
+ ngram_lm_scale_5.0_attention_scale_1.5 7.71
1147
+ ngram_lm_scale_2.3_attention_scale_0.08 7.74
1148
+ ngram_lm_scale_2.2_attention_scale_0.01 7.78
1149
+ ngram_lm_scale_4.0_attention_scale_0.9 7.79
1150
+ ngram_lm_scale_2.3_attention_scale_0.05 7.82
1151
+ ngram_lm_scale_5.0_attention_scale_1.3 7.89
1152
+ ngram_lm_scale_2.5_attention_scale_0.1 7.9
1153
+ ngram_lm_scale_2.3_attention_scale_0.01 7.93
1154
+ ngram_lm_scale_2.5_attention_scale_0.08 7.97
1155
+ ngram_lm_scale_3.0_attention_scale_0.3 7.97
1156
+ ngram_lm_scale_5.0_attention_scale_1.2 8.0
1157
+ ngram_lm_scale_2.5_attention_scale_0.05 8.04
1158
+ ngram_lm_scale_4.0_attention_scale_0.7 8.04
1159
+ ngram_lm_scale_5.0_attention_scale_1.1 8.11
1160
+ ngram_lm_scale_2.5_attention_scale_0.01 8.12
1161
+ ngram_lm_scale_4.0_attention_scale_0.6 8.18
1162
+ ngram_lm_scale_5.0_attention_scale_1.0 8.2
1163
+ ngram_lm_scale_4.0_attention_scale_0.5 8.32
1164
+ ngram_lm_scale_5.0_attention_scale_0.9 8.32
1165
+ ngram_lm_scale_3.0_attention_scale_0.1 8.33
1166
+ ngram_lm_scale_3.0_attention_scale_0.08 8.38
1167
+ ngram_lm_scale_3.0_attention_scale_0.05 8.44
1168
+ ngram_lm_scale_3.0_attention_scale_0.01 8.51
1169
+ ngram_lm_scale_5.0_attention_scale_0.7 8.52
1170
+ ngram_lm_scale_4.0_attention_scale_0.3 8.6
1171
+ ngram_lm_scale_5.0_attention_scale_0.6 8.62
1172
+ ngram_lm_scale_5.0_attention_scale_0.5 8.73
1173
+ ngram_lm_scale_4.0_attention_scale_0.1 8.83
1174
+ ngram_lm_scale_4.0_attention_scale_0.08 8.84
1175
+ ngram_lm_scale_4.0_attention_scale_0.05 8.89
1176
+ ngram_lm_scale_5.0_attention_scale_0.3 8.93
1177
+ ngram_lm_scale_4.0_attention_scale_0.01 8.94
1178
+ ngram_lm_scale_5.0_attention_scale_0.1 9.15
1179
+ ngram_lm_scale_5.0_attention_scale_0.08 9.17
1180
+ ngram_lm_scale_5.0_attention_scale_0.05 9.22
1181
+ ngram_lm_scale_5.0_attention_scale_0.01 9.26
1182
+
1183
+ 2021-11-09 18:11:34,379 INFO [decode.py:684] Done!