ESPnet2 pretrained model, kamo-naoyuki/reverb_asr_train_asr_transformer2_raw_en_char_rir_scpdatareverb_rir_singlewav.scp_noise_db_range12_17_noise_scpdatareverb_noise_singlewav.scp_speech_volume_normalize1.0_num_workers2_rir_apply_prob0.999_noise_apply_prob1._sp_valid.acc.ave, fs=16k, lang=en
Creators: name: Kamo-Naoyuki
Publisher: name: Zenodo
Year: 2021
Subjects: ESPnet
deep-learning
python
pytorch
speech-recognition
speech-synthesis
speech-translation
machine-translation

description: This model was trained by kamo-naoyuki using reverb recipe in espnet. <strong>Python API</strong><pre><code class="language-python">See https://github.com/espnet/espnet_model_zoo</code></pre> <strong>Evaluate in the recipe</strong><pre><code class="language-bash">git clone https://github.com/espnet/espnet cd espnet git checkout 03659ca572136f98dbe802aca2450f2e74be16a3 pip install -e . cd egs2/reverb/asr1 ./run.sh --skip_data_prep false --skip_train true --download_model kamo-naoyuki/reverb_asr_train_asr_transformer2_raw_en_char_rir_scpdatareverb_rir_singlewav.scp_noise_db_range12_17_noise_scpdatareverb_noise_singlewav.scp_speech_volume_normalize1.0_num_workers2_rir_apply_prob0.999_noise_apply_prob1._sp_valid.acc.ave</code> </pre> <strong>Results</strong><pre><code> # RESULTS ## Environments - date: `Fri Jan 15 07:42:01 JST 2021` - python version: `3.7.3 (default, Mar 27 2019, 22:11:17) [GCC 7.3.0]` - espnet version: `espnet 0.9.5` - pytorch version: `pytorch 1.5.1` - Git hash: `1bcf69d5d8c724cded6e5f9abef68e8000fd4b57` - Commit date: `Mon Jan 4 13:47:44 2021 +0900` ## asr_train_asr_transformer2_raw_en_char_rir_scpdatareverb_rir_singlewav.scp_noise_db_range12_17_noise_scpdatareverb_noise_singlewav.scp_speech_volume_normalize1.0_num_workers2_rir_apply_prob0.999_noise_apply_prob1._sp ### WER |dataset|Snt|Wrd|Corr|Sub|Del|Ins|Err|S.Err| |---|---|---|---|---|---|---|---|---| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_real_1ch|179|3066|94.1|4.6|1.3|0.9|6.8|48.6| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_real_1ch_far|89|1463|93.2|5.3|1.4|1.2|7.9|49.4| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_real_1ch_near|90|1603|94.8|3.9|1.2|0.6|5.8|47.8| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_real_1ch_wpe|179|3066|94.5|4.4|1.0|0.9|6.4|46.4| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_real_1ch_wpe_far|89|1463|93.3|5.5|1.2|1.2|7.9|48.3| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_real_1ch_wpe_near|90|1603|95.6|3.4|0.9|0.7|5.1|44.4| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_real_8ch_beamformit|179|3066|96.1|3.2|0.7|0.6|4.4|40.8| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_real_8ch_beamformit_far|89|1463|95.6|3.7|0.8|0.7|5.1|42.7| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_real_8ch_beamformit_near|90|1603|96.6|2.7|0.6|0.4|3.8|38.9| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_simu_1ch|1484|24338|96.2|3.1|0.7|0.3|4.1|34.2| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_simu_1ch_far|742|12169|95.5|3.6|0.9|0.3|4.8|38.5| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_simu_1ch_near|742|12169|96.9|2.5|0.6|0.2|3.3|29.9| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_simu_1ch_wpe|1484|24338|96.3|3.0|0.7|0.3|4.0|34.1| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_simu_1ch_wpe_far|742|12169|95.7|3.5|0.8|0.3|4.6|37.9| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_simu_1ch_wpe_near|742|12169|96.9|2.6|0.6|0.2|3.4|30.3| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_simu_8ch_beamformit|1484|24338|96.9|2.5|0.6|0.2|3.3|29.9| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_simu_8ch_beamformit_far|742|12169|96.8|2.6|0.6|0.3|3.5|30.5| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_simu_8ch_beamformit_near|742|12169|97.1|2.3|0.6|0.2|3.1|29.4| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_real_1ch|372|6093|94.6|4.3|1.1|0.7|6.1|43.8| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_real_1ch_far|186|2962|94.4|4.5|1.1|0.7|6.3|41.9| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_real_1ch_near|186|3131|94.8|4.2|1.0|0.8|6.0|45.7| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_real_1ch_wpe|372|6093|95.1|4.0|1.0|0.7|5.6|41.1| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_real_1ch_wpe_far|186|2962|94.9|4.1|1.1|0.6|5.8|39.2| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_real_1ch_wpe_near|186|3131|95.3|3.9|0.8|0.7|5.5|43.0| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_real_8ch_beamformit|372|6093|96.5|3.0|0.5|0.5|4.0|33.6| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_real_8ch_beamformit_far|186|2962|96.2|3.3|0.5|0.6|4.4|34.4| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_real_8ch_beamformit_near|186|3131|96.8|2.7|0.5|0.4|3.6|32.8| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_simu_1ch|2176|35972|96.1|3.2|0.7|0.3|4.2|36.8| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_simu_1ch_far|1088|17986|95.7|3.5|0.8|0.4|4.7|39.3| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_simu_1ch_near|1088|17986|96.6|2.9|0.6|0.3|3.7|34.3| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_simu_1ch_wpe|2176|35972|96.2|3.2|0.7|0.3|4.1|36.9| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_simu_1ch_wpe_far|1088|17986|95.8|3.5|0.8|0.3|4.6|39.1| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_simu_1ch_wpe_near|1088|17986|96.6|2.8|0.6|0.3|3.7|34.8| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_simu_8ch_beamformit|2176|35972|96.8|2.8|0.5|0.4|3.6|33.4| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_simu_8ch_beamformit_far|1088|17986|96.7|2.8|0.5|0.4|3.7|33.8| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_simu_8ch_beamformit_near|1088|17986|96.8|2.7|0.5|0.3|3.5|33.0| ### CER |dataset|Snt|Wrd|Corr|Sub|Del|Ins|Err|S.Err| |---|---|---|---|---|---|---|---|---| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_real_1ch|179|18181|97.4|1.3|1.3|1.0|3.6|48.6| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_real_1ch_far|89|8845|96.9|1.6|1.5|1.1|4.2|49.4| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_real_1ch_near|90|9336|97.8|1.1|1.1|0.9|3.1|47.8| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_real_1ch_wpe|179|18181|97.6|1.2|1.2|1.0|3.3|46.4| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_real_1ch_wpe_far|89|8845|97.1|1.5|1.4|1.1|4.0|48.3| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_real_1ch_wpe_near|90|9336|98.1|0.9|0.9|0.8|2.7|44.4| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_real_8ch_beamformit|179|18181|98.4|0.8|0.8|0.5|2.1|40.8| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_real_8ch_beamformit_far|89|8845|98.2|0.9|0.9|0.5|2.4|42.7| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_real_8ch_beamformit_near|90|9336|98.6|0.7|0.7|0.5|1.9|38.9| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_simu_1ch|1484|143048|98.4|0.8|0.8|0.3|1.9|34.6| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_simu_1ch_far|742|71524|98.1|1.0|0.9|0.4|2.3|38.9| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_simu_1ch_near|742|71524|98.8|0.6|0.6|0.3|1.5|30.3| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_simu_1ch_wpe|1484|143048|98.5|0.8|0.7|0.3|1.8|34.5| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_simu_1ch_wpe_far|742|71524|98.2|1.0|0.9|0.4|2.2|38.3| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_simu_1ch_wpe_near|742|71524|98.8|0.6|0.6|0.3|1.5|30.7| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_simu_8ch_beamformit|1484|143048|98.8|0.6|0.6|0.3|1.5|30.3| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_simu_8ch_beamformit_far|742|71524|98.7|0.6|0.6|0.3|1.6|30.9| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/dt_simu_8ch_beamformit_near|742|71524|98.9|0.6|0.6|0.2|1.4|29.8| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_real_1ch|372|35694|97.7|1.2|1.1|0.9|3.2|43.8| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_real_1ch_far|186|17261|97.5|1.3|1.2|0.9|3.4|41.9| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_real_1ch_near|186|18433|97.9|1.1|1.0|0.9|3.0|45.7| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_real_1ch_wpe|372|35694|97.9|1.1|0.9|0.9|2.9|41.1| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_real_1ch_wpe_far|186|17261|97.8|1.2|1.0|0.9|3.1|39.2| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_real_1ch_wpe_near|186|18433|98.0|1.1|0.9|0.9|2.8|43.0| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_real_8ch_beamformit|372|35694|98.6|0.8|0.6|0.5|1.9|33.6| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_real_8ch_beamformit_far|186|17261|98.5|0.8|0.7|0.6|2.0|34.4| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_real_8ch_beamformit_near|186|18433|98.7|0.7|0.6|0.5|1.8|32.8| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_simu_1ch|2176|210960|98.5|0.8|0.8|0.4|1.9|37.6| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_simu_1ch_far|1088|105480|98.3|0.9|0.9|0.4|2.2|40.1| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_simu_1ch_near|1088|105480|98.7|0.7|0.7|0.3|1.7|35.1| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_simu_1ch_wpe|2176|210960|98.5|0.7|0.8|0.4|1.9|37.7| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_simu_1ch_wpe_far|1088|105480|98.3|0.8|0.9|0.4|2.1|39.8| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_simu_1ch_wpe_near|1088|105480|98.7|0.6|0.7|0.3|1.6|35.7| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_simu_8ch_beamformit|2176|210960|98.7|0.6|0.6|0.4|1.6|33.9| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_simu_8ch_beamformit_far|1088|105480|98.7|0.7|0.6|0.4|1.7|34.2| |decode_lm_lm_train_lm_transformer_en_char_valid.loss.ave_asr_model_valid.acc.ave/et_simu_8ch_beamformit_near|1088|105480|98.8|0.6|0.6|0.3|1.6|33.6|</code></pre> <strong>ASR config</strong><pre><code>config: ./conf/tuning/train_asr_transformer2.yaml print_config: false log_level: INFO dry_run: false iterator_type: sequence output_dir: exp2/asr_train_asr_transformer2_raw_en_char_rir_scpdatareverb_rir_singlewav.scp_noise_db_range12_17_noise_scpdatareverb_noise_singlewav.scp_speech_volume_normalize1.0_num_workers2_rir_apply_prob0.999_noise_apply_prob1._sp ngpu: 1 seed: 0 num_workers: 2 num_att_plot: 3 dist_backend: nccl dist_init_method: env:// dist_world_size: 4 dist_rank: 0 local_rank: 0 dist_master_addr: localhost dist_master_port: 42727 dist_launcher: null multiprocessing_distributed: true cudnn_enabled: true cudnn_benchmark: false cudnn_deterministic: true collect_stats: false write_collected_feats: false max_epoch: 50 patience: null val_scheduler_criterion: - valid - loss early_stopping_criterion: - valid - loss - min best_model_criterion: - - valid - acc - max keep_nbest_models: 10 grad_clip: 5.0 grad_clip_type: 2.0 grad_noise: false accum_grad: 1 no_forward_run: false resume: true train_dtype: float32 use_amp: false log_interval: null unused_parameters: false use_tensorboard: true use_wandb: false wandb_project: null wandb_id: null pretrain_path: null init_param: [] freeze_param: [] num_iters_per_epoch: null batch_size: 20 valid_batch_size: null batch_bins: 16000000 valid_batch_bins: null train_shape_file: - exp2/asr_stats_raw_en_char_sp/train/speech_shape - exp2/asr_stats_raw_en_char_sp/train/text_shape.char valid_shape_file: - exp2/asr_stats_raw_en_char_sp/valid/speech_shape - exp2/asr_stats_raw_en_char_sp/valid/text_shape.char batch_type: numel valid_batch_type: null fold_length: - 80000 - 150 sort_in_batch: descending sort_batch: descending multiple_iterator: false chunk_length: 500 chunk_shift_ratio: 0.5 num_cache_chunks: 1024 train_data_path_and_name_and_type: - - dump2/raw/tr_wsjcam0_si284_sp/wav.scp - speech - kaldi_ark - - dump2/raw/tr_wsjcam0_si284_sp/text - text - text valid_data_path_and_name_and_type: - - dump2/raw/dt_mult_1ch/wav.scp - speech - kaldi_ark - - dump2/raw/dt_mult_1ch/text - text - text allow_variable_data_keys: false max_cache_size: 0.0 max_cache_fd: 32 valid_max_cache_size: null optim: adam optim_conf: lr: 0.005 scheduler: warmuplr scheduler_conf: warmup_steps: 30000 token_list: - - - - E - T - A - N - I - O - S - R - H - L - D - C - U - M - P - F - G - Y - W - B - V - K - . - X - '''' - J - Q - Z - - ',' - '-' - '"' - '*' - ':' - ( - ) - '?' - '!' - '&amp;' - ; - '1' - '2' - '0' - / - $ - '{' - '}' - '8' - '9' - '6' - '3' - '5' - '7' - '4' - '~' - '`' - _ - &lt;*IN*&gt; - &lt;*MR.*&gt; - \ - ^ - init: xavier_uniform input_size: null ctc_conf: dropout_rate: 0.0 ctc_type: builtin reduce: true ignore_nan_grad: false model_conf: ctc_weight: 0.3 lsm_weight: 0.1 length_normalized_loss: false use_preprocessor: true token_type: char bpemodel: null non_linguistic_symbols: data/nlsyms.txt cleaner: null g2p: null speech_volume_normalize: 1.0 rir_scp: data/reverb_rir_single/wav.scp rir_apply_prob: 0.999 noise_scp: data/reverb_noise_single/wav.scp noise_apply_prob: 1.0 noise_db_range: '12_17' frontend: default frontend_conf: fs: 16k specaug: specaug specaug_conf: apply_time_warp: true time_warp_window: 5 time_warp_mode: bicubic apply_freq_mask: true freq_mask_width_range: - 0 - 30 num_freq_mask: 2 apply_time_mask: true time_mask_width_range: - 0 - 40 num_time_mask: 2 normalize: utterance_mvn normalize_conf: norm_means: true norm_vars: false eps: 1.0e-20 preencoder: null preencoder_conf: {} encoder: transformer encoder_conf: output_size: 256 attention_heads: 4 linear_units: 2048 num_blocks: 12 dropout_rate: 0.1 positional_dropout_rate: 0.1 attention_dropout_rate: 0.0 input_layer: conv2d normalize_before: true decoder: transformer decoder_conf: attention_heads: 4 linear_units: 2028 num_blocks: 6 dropout_rate: 0.1 positional_dropout_rate: 0.1 self_attention_dropout_rate: 0.0 src_attention_dropout_rate: 0.0 required: - output_dir - token_list distributed: true</code></pre> <strong>LM config</strong><pre><code>config: conf/train_lm_transformer.yaml print_config: false log_level: INFO dry_run: false iterator_type: sequence output_dir: exp2/lm_train_lm_transformer_char ngpu: 1 seed: 0 num_workers: 1 num_att_plot: 3 dist_backend: nccl dist_init_method: env:// dist_world_size: 4 dist_rank: 0 local_rank: 0 dist_master_addr: localhost dist_master_port: 50460 dist_launcher: null multiprocessing_distributed: true cudnn_enabled: true cudnn_benchmark: false cudnn_deterministic: true collect_stats: false write_collected_feats: false max_epoch: 25 patience: null val_scheduler_criterion: - valid - loss early_stopping_criterion: - valid - loss - min best_model_criterion: - - valid - loss - min keep_nbest_models: 10 grad_clip: 5.0 grad_clip_type: 2.0 grad_noise: false accum_grad: 2 no_forward_run: false resume: true train_dtype: float32 use_amp: false log_interval: null pretrain_path: null init_param: [] num_iters_per_epoch: null batch_size: 20 valid_batch_size: null batch_bins: 350000 valid_batch_bins: null train_shape_file: - exp2/lm_stats_char/train/text_shape.char valid_shape_file: - exp2/lm_stats_char/valid/text_shape.char batch_type: numel valid_batch_type: null fold_length: - 150 sort_in_batch: descending sort_batch: descending multiple_iterator: false chunk_length: 500 chunk_shift_ratio: 0.5 num_cache_chunks: 1024 train_data_path_and_name_and_type: - - dump2/raw/lm_train.txt - text - text valid_data_path_and_name_and_type: - - dump2/raw/dt_mult_1ch/text - text - text allow_variable_data_keys: false max_cache_size: 0.0 max_cache_fd: 32 valid_max_cache_size: null optim: adam optim_conf: lr: 0.001 scheduler: warmuplr scheduler_conf: warmup_steps: 25000 token_list: - - - - E - T - A - N - I - O - S - R - H - L - D - C - U - M - P - F - G - Y - W - B - V - K - . - X - '''' - J - Q - Z - - ',' - '-' - '"' - '*' - ':' - ( - ) - '?' - '!' - '&amp;' - ; - '1' - '2' - '0' - / - $ - '{' - '}' - '8' - '9' - '6' - '3' - '5' - '7' - '4' - '~' - '`' - _ - &lt;*IN*&gt; - &lt;*MR.*&gt; - \ - ^ - init: null model_conf: ignore_id: 0 use_preprocessor: true token_type: char bpemodel: null non_linguistic_symbols: data/nlsyms.txt cleaner: null g2p: null lm: transformer lm_conf: pos_enc: null embed_unit: 128 att_unit: 512 head: 8 unit: 2048 layer: 16 dropout_rate: 0.1 required: - output_dir - token_list distributed: true</code></pre>