ESPnet2 pretrained model, Chenda Li/wsj0_2mix_joint_train_asr_transformer_raw_char_aux_valid.acc.ave, fs=8k, lang=en
Creators: name: Chenda Li
Publisher: name: Zenodo
Year: 2021
Subjects: ESPnet
deep-learning
python
pytorch
speech-recognition
speech-enhancement
speech-separation

description: This model was trained by Chenda Li using wsj0_2mix recipe in espnet. <strong>Python API</strong> <pre><code class="language-python">See https://github.com/espnet/espnet_model_zoo</code></pre> <strong>Evaluate in the recipe</strong> <pre><code class="language-bash">git clone https://github.com/espnet/espnet cd espnet git checkout 7ee55a382e7b8087daf2434451711855c76aa699 pip install -e . cd egs2/wsj0_2mix/asr1 ./run.sh --skip_data_prep false --skip_train true --download_model Chenda Li/wsj0_2mix_joint_train_asr_transformer_raw_char_aux_valid.acc.ave</code> </pre> <strong>Results</strong> <pre><code> # RESULTS ## Environments - date: `Fri Jun 18 16:47:32 CST 2021` - python version: `3.7.6 (default, Jan 8 2020, 19:59:22) [GCC 7.3.0]` - espnet version: `espnet 0.9.9` - pytorch version: `pytorch 1.7.1` - Git hash: `7ee55a382e7b8087daf2434451711855c76aa699` - Commit date: `Fri Jun 18 15:14:28 2021 +0800` ## joint_train_asr_transformer_raw_char_aux ### WER |dataset|Snt|Wrd|Corr|Sub|Del|Ins|Err|S.Err| |---|---|---|---|---|---|---|---|---| exp/joint_train_asr_transformer_raw_char_aux/decode_tt_max_8k_decode_lm_train_lm_char_valid.loss.best_asr_model_valid.acc.ave/score_wer/result.txt:|6000|98613|88.1|10.2|1.7|2.4|14.3|62.1| exp/joint_train_asr_transformer_raw_char_aux/decode_tt_max_8k_decode_lm_train_lm_char_valid.loss.best_asr_model_valid.acc.best/score_wer/result.txt:|6000|98613|84.1|13.5|2.4|3.3|19.2|68.5| ### CER |dataset|Snt|Wrd|Corr|Sub|Del|Ins|Err|S.Err| |---|---|---|---|---|---|---|---|---| exp/joint_train_asr_transformer_raw_char_aux/decode_tt_max_8k_decode_lm_train_lm_char_valid.loss.best_asr_model_valid.acc.ave/score_cer/result.txt:|6000|598296|94.8|2.9|2.3|2.5|7.7|63.6| exp/joint_train_asr_transformer_raw_char_aux/decode_tt_max_8k_decode_lm_train_lm_char_valid.loss.best_asr_model_valid.acc.best/score_cer/result.txt:|6000|598296|92.5|4.1|3.4|3.5|11.0|69.5|</code></pre> <strong>ASR config</strong> <pre><code>config: conf/tuning/train_asr_transformer.yaml print_config: false log_level: INFO dry_run: false iterator_type: sequence output_dir: exp/joint_train_asr_transformer_raw_char_aux ngpu: 1 seed: 0 num_workers: 4 num_att_plot: 0 dist_backend: nccl dist_init_method: env:// dist_world_size: 4 dist_rank: 0 local_rank: 0 dist_master_addr: localhost dist_master_port: 43100 dist_launcher: null multiprocessing_distributed: true unused_parameters: true sharded_ddp: false cudnn_enabled: true cudnn_benchmark: false cudnn_deterministic: false collect_stats: false write_collected_feats: false max_epoch: 120 patience: null val_scheduler_criterion: - valid - loss early_stopping_criterion: - valid - loss - min best_model_criterion: - - valid - acc - max - - valid - loss - min keep_nbest_models: 10 grad_clip: 3 grad_clip_type: 2.0 grad_noise: false accum_grad: 4 no_forward_run: false resume: true train_dtype: float32 use_amp: false log_interval: null use_tensorboard: true use_wandb: false wandb_project: null wandb_id: null detect_anomaly: false pretrain_path: null init_param: [] ignore_init_mismatch: false freeze_param: [] num_iters_per_epoch: null batch_size: 4 valid_batch_size: null batch_bins: 1000000 valid_batch_bins: null train_shape_file: - exp/joint_stats_raw_8k_aux/train/speech_mix_shape - exp/joint_stats_raw_8k_aux/train/utt2category_shape - exp/joint_stats_raw_8k_aux/train/speech_ref1_shape - exp/joint_stats_raw_8k_aux/train/text_ref1_shape - exp/joint_stats_raw_8k_aux/train/speech_ref2_shape - exp/joint_stats_raw_8k_aux/train/text_ref2_shape valid_shape_file: - exp/joint_stats_raw_8k_aux/valid/speech_mix_shape - exp/joint_stats_raw_8k_aux/valid/utt2category_shape - exp/joint_stats_raw_8k_aux/valid/speech_ref1_shape - exp/joint_stats_raw_8k_aux/valid/text_ref1_shape - exp/joint_stats_raw_8k_aux/valid/speech_ref2_shape - exp/joint_stats_raw_8k_aux/valid/text_ref2_shape batch_type: folded valid_batch_type: null fold_length: - 80000 - 80000 - 80000 - 80000 - 80000 - 80000 sort_in_batch: descending sort_batch: descending multiple_iterator: false chunk_length: 500 chunk_shift_ratio: 0.5 num_cache_chunks: 1024 train_data_path_and_name_and_type: - - dump/raw/tr_max_8k_train_si284/wav.scp - speech_mix - sound - - dump/raw/tr_max_8k_train_si284/utt2category - utt2category - text - - dump/raw/tr_max_8k_train_si284/spk1.scp - speech_ref1 - sound - - dump/raw/tr_max_8k_train_si284/text_spk1 - text_ref1 - text - - dump/raw/tr_max_8k_train_si284/spk2.scp - speech_ref2 - sound - - dump/raw/tr_max_8k_train_si284/text_spk2 - text_ref2 - text valid_data_path_and_name_and_type: - - dump/raw/cv_max_8k/wav.scp - speech_mix - sound - - dump/raw/cv_max_8k/utt2category - utt2category - text - - dump/raw/cv_max_8k/spk1.scp - speech_ref1 - sound - - dump/raw/cv_max_8k/text_spk1 - text_ref1 - text - - dump/raw/cv_max_8k/spk2.scp - speech_ref2 - sound - - dump/raw/cv_max_8k/text_spk2 - text_ref2 - text allow_variable_data_keys: false max_cache_size: 0.0 max_cache_fd: 32 valid_max_cache_size: null optim: adam optim_conf: lr: 0.002 eps: 1.0e-08 weight_decay: 1.0e-07 scheduler: warmuplr scheduler_conf: warmup_steps: 45000 enh_model_conf: loss_type: si_snr token_list: - - - - E - T - A - N - I - O - S - R - H - L - D - C - U - M - P - F - G - Y - W - B - V - K - . - X - '''' - J - Q - Z - - ',' - '-' - '"' - '*' - ':' - ( - ) - '?' - '!' - '&amp;' - ; - '1' - '2' - '0' - / - $ - '{' - '}' - '8' - '9' - '6' - '3' - '5' - '7' - '4' - '~' - '`' - _ - &lt;*IN*&gt; - &lt;*MR.*&gt; - \ - ^ - init: xavier_uniform input_size: null ctc_conf: reduce: true asr_model_conf: ctc_weight: 0.3 lsm_weight: 0.1 length_normalized_loss: false joint_model_conf: enh_weight: 0.8 end2end_train: true cal_enh_loss: true use_preprocessor: true token_type: char bpemodel: null non_linguistic_symbols: data/nlsyms.txt cleaner: null g2p: null enh_encoder: conv enh_encoder_conf: channel: 256 kernel_size: 20 stride: 10 enh_separator: tcn enh_separator_conf: num_spk: 2 layer: 6 stack: 3 bottleneck_dim: 256 hidden_dim: 384 kernel: 3 causal: false norm_type: gLN nonlinear: relu enh_decoder: conv enh_decoder_conf: channel: 256 kernel_size: 20 stride: 10 frontend: default frontend_conf: fs: 8000 n_fft: 256 win_length: 256 hop_length: 64 apply_stft: true specaug: null specaug_conf: {} normalize: utterance_mvn normalize_conf: {} encoder: transformer encoder_conf: output_size: 256 attention_heads: 4 linear_units: 1536 num_blocks: 12 dropout_rate: 0.1 positional_dropout_rate: 0.2 attention_dropout_rate: 0.0 input_layer: conv2d normalize_before: true decoder: transformer decoder_conf: attention_heads: 4 linear_units: 1536 num_blocks: 6 dropout_rate: 0.1 positional_dropout_rate: 0.1 self_attention_dropout_rate: 0.0 src_attention_dropout_rate: 0.0 required: - output_dir - token_list version: 0.9.9 distributed: true</code></pre> <strong>LM config</strong> <pre><code>config: conf/tuning/train_lm.yaml print_config: false log_level: INFO dry_run: false iterator_type: sequence output_dir: exp/lm_train_lm_char ngpu: 1 seed: 0 num_workers: 1 num_att_plot: 3 dist_backend: nccl dist_init_method: env:// dist_world_size: null dist_rank: null local_rank: 0 dist_master_addr: null dist_master_port: null dist_launcher: null multiprocessing_distributed: false cudnn_enabled: true cudnn_benchmark: false cudnn_deterministic: true collect_stats: false write_collected_feats: false max_epoch: 200 patience: null val_scheduler_criterion: - valid - loss early_stopping_criterion: - valid - loss - min best_model_criterion: - - valid - loss - min keep_nbest_models: 1 grad_clip: 5.0 grad_clip_type: 2.0 grad_noise: false accum_grad: 1 no_forward_run: false resume: true train_dtype: float32 use_amp: false log_interval: null unused_parameters: false use_tensorboard: true use_wandb: false wandb_project: null wandb_id: null pretrain_path: null init_param: [] freeze_param: [] num_iters_per_epoch: null batch_size: 1000 valid_batch_size: null batch_bins: 1000000 valid_batch_bins: null train_shape_file: - exp/lm_stats/train/text_shape.char valid_shape_file: - exp/lm_stats/valid/text_shape.char batch_type: folded valid_batch_type: null fold_length: - 150 sort_in_batch: descending sort_batch: descending multiple_iterator: false chunk_length: 500 chunk_shift_ratio: 0.5 num_cache_chunks: 1024 train_data_path_and_name_and_type: - - dump/raw/srctexts_with_spk - text - text valid_data_path_and_name_and_type: - - dump/raw/valid_srctexts_with_spk - text - text allow_variable_data_keys: false max_cache_size: 0.0 max_cache_fd: 32 valid_max_cache_size: null optim: sgd optim_conf: lr: 0.1 scheduler: reducelronplateau scheduler_conf: mode: min factor: 0.5 patience: 3 token_list: - - - - E - T - A - N - I - O - S - R - H - L - D - C - U - M - P - F - G - Y - W - B - V - K - . - X - '''' - J - Q - Z - - ',' - '-' - '"' - '*' - ':' - ( - ) - '?' - '!' - '&amp;' - ; - '1' - '2' - '0' - / - $ - '{' - '}' - '8' - '9' - '6' - '3' - '5' - '7' - '4' - '~' - '`' - _ - &lt;*IN*&gt; - &lt;*MR.*&gt; - \ - ^ - init: null model_conf: ignore_id: 0 use_preprocessor: true token_type: char bpemodel: null non_linguistic_symbols: data/nlsyms.txt cleaner: null g2p: null lm: seq_rnn lm_conf: unit: 650 nlayers: 2 required: - output_dir - token_list version: 0.9.7 distributed: false</code></pre>