ESPnet2 pretrained model, Shinji Watanabe/open_li52_asr_train_asr_transformer_e45_raw_bpe8000_valid.acc.ave, fs=16k, lang=noinfo
Creators: name: Watanabe, Shinji
Publisher: name: Zenodo
Year: 2021
Subjects: ESPnet
deep-learning
python
pytorch
speech-recognition
speech-synthesis
speech-translation
machine-translation

description: This model was trained by Shinji Watanabe using open_li52 recipe in espnet. <strong>Python API</strong><pre><code class="language-python">See https://github.com/espnet/espnet_model_zoo</code></pre> <strong>Evaluate in the recipe</strong><pre><code class="language-bash">git clone https://github.com/espnet/espnet cd espnet git checkout 0148927b1edb0d6203b929dcd1320bbac59bc1f7 pip install -e . cd egs2/open_li52/asr1 ./run.sh --skip_data_prep false --skip_train true --download_model Shinji Watanabe/open_li52_asr_train_asr_transformer_e45_raw_bpe8000_valid.acc.ave</code> </pre> <strong>Results</strong><pre><code> # RESULTS ## Environments - date: `Fri Feb 5 16:46:33 EST 2021` - python version: `3.8.5 (default, Sep 4 2020, 07:30:14) [GCC 7.3.0]` - espnet version: `espnet 0.9.7` - pytorch version: `pytorch 1.7.1` - Git hash: `0148927b1edb0d6203b929dcd1320bbac59bc1f7` - Commit date: `Wed Feb 3 20:39:45 2021 -0500` ## asr_train_asr_transformer_e45_raw_bpe8000 ### WER |dataset|Snt|Wrd|Corr|Sub|Del|Ins|Err|S.Err| |---|---|---|---|---|---|---|---|---| |decode_asr_asr_model_valid.acc.ave/test_ar_commonvoice_lid|1911|8603|18.5|71.3|10.2|10.3|91.8|98.4| |decode_asr_asr_model_valid.acc.ave/test_br_commonvoice_lid|1953|10147|3.5|77.4|19.1|5.7|102.2|99.8| |decode_asr_asr_model_valid.acc.ave/test_cs_commonvoice_lid|2574|16508|20.1|71.5|8.4|6.7|86.6|99.8| |decode_asr_asr_model_valid.acc.ave/test_cy_commonvoice_lid|2937|26046|62.0|34.8|3.2|4.8|42.7|86.3| |decode_asr_asr_model_valid.acc.ave/test_dv_commonvoice_lid|1902|12656|7.1|88.1|4.8|23.0|115.9|99.8| |decode_asr_asr_model_valid.acc.ave/test_el_commonvoice_lid|1625|10668|0.2|87.4|12.4|8.0|107.8|100.0| |decode_asr_asr_model_valid.acc.ave/test_eo_commonvoice_lid|8453|65874|52.6|43.5|4.0|5.0|52.4|94.3| |decode_asr_asr_model_valid.acc.ave/test_et_commonvoice_lid|2485|29791|27.2|63.1|9.7|6.4|79.1|99.9| |decode_asr_asr_model_valid.acc.ave/test_eu_commonvoice_lid|4912|36317|65.5|31.2|3.3|3.2|37.8|88.2| |decode_asr_asr_model_valid.acc.ave/test_fy_NL_commonvoice_lid|2095|19114|23.5|67.7|8.7|6.5|82.9|100.0| |decode_asr_asr_model_valid.acc.ave/test_id_commonvoice_lid|1643|9565|25.9|66.8|7.3|8.1|82.1|98.3| |decode_asr_asr_model_valid.acc.ave/test_ja_commonvoice_lid|1334|1334|1.0|99.0|0.0|143.4|242.4|99.0| |decode_asr_asr_model_valid.acc.ave/test_ky_commonvoice_lid|1476|10199|0.4|89.3|10.3|4.6|104.2|100.0| |decode_asr_asr_model_valid.acc.ave/test_mn_commonvoice_lid|1786|17351|0.0|91.4|8.6|3.0|103.0|100.0| |decode_asr_asr_model_valid.acc.ave/test_mt_commonvoice_lid|1583|11308|9.0|80.5|10.5|7.7|98.7|99.9| |decode_asr_asr_model_valid.acc.ave/test_nl_voxforge_lid|874|7742|61.7|33.6|4.7|5.6|44.0|96.2| |decode_asr_asr_model_valid.acc.ave/test_pt_commonvoice_lid|4334|33716|43.1|49.9|7.1|5.2|62.1|98.0| |decode_asr_asr_model_valid.acc.ave/test_sv_SE_commonvoice_lid|1784|9618|17.2|70.3|12.5|8.0|90.8|99.4| |decode_asr_asr_model_valid.acc.ave/test_ta_commonvoice_lid|1638|6502|22.4|69.9|7.7|11.9|89.5|98.4| |decode_asr_asr_model_valid.acc.ave/test_tr_commonvoice_lid|1639|9646|23.2|69.7|7.1|6.1|82.9|99.5| |decode_asr_asr_model_valid.acc.ave/test_tt_commonvoice_lid|4365|24331|0.0|89.8|10.2|6.9|106.9|100.0| |decode_asr_asr_model_valid.acc.ave/test_uk_commonvoice_lid|1671|12291|0.8|89.6|9.6|4.0|103.2|100.0| |decode_asr_asr_model_valid.acc.ave/test_zh_CN_commonvoice_lid|8273|8273|4.0|96.0|0.0|9.5|105.5|96.0| |decode_asr_asr_model_valid.acc.ave/test_zh_HK_commonvoice_lid|2805|2815|39.6|60.0|0.4|5.5|65.9|60.2| |decode_asr_asr_model_valid.acc.ave/test_zh_TW_commonvoice_lid|2627|2627|39.1|60.8|0.0|9.2|70.1|60.9| ### CER |dataset|Snt|Wrd|Corr|Sub|Del|Ins|Err|S.Err| |---|---|---|---|---|---|---|---|---| |decode_asr_asr_model_valid.acc.ave/test_ar_commonvoice_lid|1911|43355|57.8|31.8|10.4|14.3|56.5|98.4| |decode_asr_asr_model_valid.acc.ave/test_br_commonvoice_lid|1953|51751|56.2|24.8|19.0|10.8|54.6|99.8| |decode_asr_asr_model_valid.acc.ave/test_cs_commonvoice_lid|2574|100007|71.4|22.7|5.9|4.8|33.4|99.8| |decode_asr_asr_model_valid.acc.ave/test_cy_commonvoice_lid|2937|139576|88.7|6.6|4.7|3.3|14.6|86.3| |decode_asr_asr_model_valid.acc.ave/test_dv_commonvoice_lid|1902|112529|28.0|56.5|15.5|2.2|74.2|99.8| |decode_asr_asr_model_valid.acc.ave/test_el_commonvoice_lid|1625|62617|12.7|77.7|9.6|4.5|91.9|100.0| |decode_asr_asr_model_valid.acc.ave/test_eo_commonvoice_lid|8453|394730|88.9|7.8|3.2|3.2|14.3|94.1| |decode_asr_asr_model_valid.acc.ave/test_et_commonvoice_lid|2485|216225|81.7|10.8|7.5|4.3|22.7|99.9| |decode_asr_asr_model_valid.acc.ave/test_eu_commonvoice_lid|4912|274944|94.0|3.1|2.9|1.7|7.7|88.2| |decode_asr_asr_model_valid.acc.ave/test_fy_NL_commonvoice_lid|2095|104237|73.2|16.5|10.2|6.8|33.5|100.0| |decode_asr_asr_model_valid.acc.ave/test_id_commonvoice_lid|1643|61563|74.0|15.5|10.5|5.5|31.5|98.3| |decode_asr_asr_model_valid.acc.ave/test_ja_commonvoice_lid|1334|23813|49.4|47.5|3.1|39.3|89.8|99.0| |decode_asr_asr_model_valid.acc.ave/test_ky_commonvoice_lid|1476|71286|14.4|78.9|6.7|2.7|88.3|100.0| |decode_asr_asr_model_valid.acc.ave/test_mn_commonvoice_lid|1786|112710|14.6|76.2|9.2|2.6|88.0|100.0| |decode_asr_asr_model_valid.acc.ave/test_mt_commonvoice_lid|1583|79943|65.4|18.1|16.6|5.3|39.9|99.9| |decode_asr_asr_model_valid.acc.ave/test_nl_voxforge_lid|874|46666|88.6|5.9|5.5|3.2|14.6|96.2| |decode_asr_asr_model_valid.acc.ave/test_pt_commonvoice_lid|4334|191499|80.1|12.4|7.5|3.8|23.7|98.0| |decode_asr_asr_model_valid.acc.ave/test_sv_SE_commonvoice_lid|1784|48812|65.5|21.9|12.6|8.0|42.5|99.4| |decode_asr_asr_model_valid.acc.ave/test_ta_commonvoice_lid|1638|55541|73.7|18.8|7.5|4.2|30.6|98.5| |decode_asr_asr_model_valid.acc.ave/test_tr_commonvoice_lid|1639|67841|72.5|19.6|7.9|3.1|30.6|99.4| |decode_asr_asr_model_valid.acc.ave/test_tt_commonvoice_lid|4365|159202|14.4|79.4|6.3|3.8|89.4|100.0| |decode_asr_asr_model_valid.acc.ave/test_uk_commonvoice_lid|1671|80323|15.1|79.6|5.2|2.5|87.4|100.0| |decode_asr_asr_model_valid.acc.ave/test_zh_CN_commonvoice_lid|8273|134476|68.2|29.7|2.1|3.7|35.5|96.0| |decode_asr_asr_model_valid.acc.ave/test_zh_HK_commonvoice_lid|2805|32994|86.3|12.7|1.0|2.5|16.3|60.2| |decode_asr_asr_model_valid.acc.ave/test_zh_TW_commonvoice_lid|2627|21991|81.6|16.9|1.5|5.5|24.0|60.6| ### TER |dataset|Snt|Wrd|Corr|Sub|Del|Ins|Err|S.Err| |---|---|---|---|---|---|---|---|---| |decode_asr_asr_model_valid.acc.ave/test_ar_commonvoice_lid|1911|44015|55.0|32.0|13.0|3.8|48.8|98.4| |decode_asr_asr_model_valid.acc.ave/test_br_commonvoice_lid|1953|34509|29.8|54.4|15.8|3.4|73.6|99.8| |decode_asr_asr_model_valid.acc.ave/test_cs_commonvoice_lid|2574|68613|54.9|38.6|6.5|3.5|48.7|99.8| |decode_asr_asr_model_valid.acc.ave/test_cy_commonvoice_lid|2937|85093|78.7|16.5|4.8|2.6|23.9|86.3| |decode_asr_asr_model_valid.acc.ave/test_dv_commonvoice_lid|1902|120283|25.8|33.0|41.2|0.7|74.9|99.8| |decode_asr_asr_model_valid.acc.ave/test_el_commonvoice_lid|1625|29193|27.0|71.8|1.3|43.7|116.7|100.0| |decode_asr_asr_model_valid.acc.ave/test_eo_commonvoice_lid|8453|219645|75.0|21.3|3.7|2.3|27.3|94.3| |decode_asr_asr_model_valid.acc.ave/test_et_commonvoice_lid|2485|118610|61.7|31.4|6.9|3.4|41.7|99.9| |decode_asr_asr_model_valid.acc.ave/test_eu_commonvoice_lid|4912|147117|85.4|11.5|3.1|1.4|16.0|88.2| |decode_asr_asr_model_valid.acc.ave/test_fy_NL_commonvoice_lid|2095|58260|47.8|41.1|11.1|3.8|56.0|100.0| |decode_asr_asr_model_valid.acc.ave/test_id_commonvoice_lid|1643|34550|54.8|38.4|6.8|4.0|49.2|98.3| |decode_asr_asr_model_valid.acc.ave/test_ja_commonvoice_lid|1334|29149|56.2|40.6|3.2|10.8|54.6|99.0| |decode_asr_asr_model_valid.acc.ave/test_ky_commonvoice_lid|1476|28213|42.7|57.0|0.3|97.4|154.7|100.0| |decode_asr_asr_model_valid.acc.ave/test_mn_commonvoice_lid|1786|44168|38.6|61.0|0.4|112.3|173.7|100.0| |decode_asr_asr_model_valid.acc.ave/test_mt_commonvoice_lid|1583|49521|37.1|45.3|17.6|2.3|65.2|99.9| |decode_asr_asr_model_valid.acc.ave/test_nl_voxforge_lid|874|23568|76.8|17.9|5.2|2.0|25.1|96.2| |decode_asr_asr_model_valid.acc.ave/test_pt_commonvoice_lid|4334|103902|64.4|28.7|6.9|3.1|38.7|98.0| |decode_asr_asr_model_valid.acc.ave/test_sv_SE_commonvoice_lid|1784|31661|43.0|42.8|14.2|5.5|62.6|99.4| |decode_asr_asr_model_valid.acc.ave/test_ta_commonvoice_lid|1638|61768|75.2|13.4|11.4|2.4|27.2|98.5| |decode_asr_asr_model_valid.acc.ave/test_tr_commonvoice_lid|1639|44068|55.1|34.8|10.0|2.4|47.3|99.5| |decode_asr_asr_model_valid.acc.ave/test_tt_commonvoice_lid|4365|72684|33.2|66.2|0.5|70.1|136.9|100.0| |decode_asr_asr_model_valid.acc.ave/test_uk_commonvoice_lid|1671|34199|37.1|61.7|1.2|78.3|141.2|100.0| |decode_asr_asr_model_valid.acc.ave/test_zh_CN_commonvoice_lid|8273|159284|72.4|25.9|1.8|1.5|29.1|95.8| |decode_asr_asr_model_valid.acc.ave/test_zh_HK_commonvoice_lid|2805|41408|89.3|9.9|0.8|0.8|11.5|57.5| |decode_asr_asr_model_valid.acc.ave/test_zh_TW_commonvoice_lid|2627|29868|85.9|13.0|1.1|1.7|15.7|60.5|</code></pre> <strong>ASR config</strong><pre><code>config: conf/tuning/train_asr_transformer_e45.yaml print_config: false log_level: INFO dry_run: false iterator_type: sequence output_dir: exp/asr_train_asr_transformer_e45_raw_bpe8000 ngpu: 1 seed: 0 num_workers: 1 num_att_plot: 3 dist_backend: nccl dist_init_method: env:// dist_world_size: 4 dist_rank: 0 local_rank: 0 dist_master_addr: localhost dist_master_port: 49156 dist_launcher: null multiprocessing_distributed: true cudnn_enabled: true cudnn_benchmark: false cudnn_deterministic: true collect_stats: false write_collected_feats: false max_epoch: 63 patience: null val_scheduler_criterion: - valid - loss early_stopping_criterion: - valid - loss - min best_model_criterion: - - valid - acc - max keep_nbest_models: 10 grad_clip: 5 grad_clip_type: 2.0 grad_noise: false accum_grad: 4 no_forward_run: false resume: true train_dtype: float32 use_amp: false log_interval: null unused_parameters: false use_tensorboard: true use_wandb: false wandb_project: null wandb_id: null pretrain_path: null init_param: [] freeze_param: [] num_iters_per_epoch: null batch_size: 20 valid_batch_size: null batch_bins: 40000000 valid_batch_bins: null train_shape_file: - exp/asr_stats_raw_bpe8000/train/speech_shape - exp/asr_stats_raw_bpe8000/train/text_shape.bpe valid_shape_file: - exp/asr_stats_raw_bpe8000/valid/speech_shape - exp/asr_stats_raw_bpe8000/valid/text_shape.bpe batch_type: numel valid_batch_type: null fold_length: - 80000 - 150 sort_in_batch: descending sort_batch: descending multiple_iterator: false chunk_length: 500 chunk_shift_ratio: 0.5 num_cache_chunks: 1024 train_data_path_and_name_and_type: - - dump/raw/train_li52_lid/wav.scp - speech - sound - - dump/raw/train_li52_lid/text - text - text valid_data_path_and_name_and_type: - - dump/raw/dev_li52_lid/wav.scp - speech - sound - - dump/raw/dev_li52_lid/text - text - text allow_variable_data_keys: false max_cache_size: 0.0 max_cache_fd: 32 valid_max_cache_size: null optim: adam optim_conf: lr: 1.0 scheduler: noamlr scheduler_conf: warmup_steps: 25000 token_list: - - - ▁[ - ']' - . - S - ▁ - e - T - n - ',' - A - N - ▁A - D - I - E - r - ▁DE - f - '-' - ▁THE - a - R - '''' - de - b - ka - M - EN - L - U - ▁I - Y - ']"' - O - ." - TE - c - ▁IN - C - ▁LA - ▁TO - ED - ▁D - RE - ER - RA - G - IN - K - LA - ES - LE - ▁S - RI - IT - ▁OF - '?' - AL - W - UR - SE - TA - B - s - ▁EN - IS - ▁L - F - ▁N - ▁AND - AR - DE - AN - ING - Z - EL - ▁BE - NA - THE - MA - NE - w - IL - ▁RE - RO - ▁IS - H - LI - ▁SE - LL - t - P - CH - ▁LE - GE - DA - ▁WAS - ME - TO - ▁Y - ' - ▁UN - ▁T - ▁CON - م - CE - GA - ی - ه - WE - ST - HE - 'NO' - AS - OR - TI - É - ▁BA - ▁HE - ▁E - ZE - l - ▁MA - J - ▁O - ▁EL - u - ▁AN - ZA - BA - MI - ▁DI - KO - TEN - ▁MU - YE - IG - ▁EST - WA - ▁F - VI - ▁GE - ▁ME - SI - CA - p - ZI - UN - ▁FOR - KA - ▁DO - ▁DIE - 'ON' - ▁NO - ▁W - DER - LY - TER - NI - VE - EM - ▁ES - ▁QUE - ▁AL - DI - CI - TU - AD - AT - IR - HA - ▁SO - ENT - HO - '!' - MENT - BE - MO - ▁YOU - ▁DER - ش - ▁U - ▁G - DO - US - ▁DU - LO - ▁HA - ▁PO - ▁K - ▁VI - GI - SA - CK - ▁M - GU - ▁NA - GO - CO - TH - OS - ر - VA - و - ک - ▁ON - ▁B - ▁PER - GEN - Ɣ - ▁NE - BI - ▁SU - ▁AD - ▁DA - ▁VER - ▁DES - ▁COM - KE - Ä - ▁CO - ▁MO - ▁IT - Í - ▁TE - RU - ▁IST - JE - Н - UM - ▁C - NT - i - ▁WE - ▁THAT - UNG - IM - SCH - Ḥ - ت - ▁BI - DEN - BO - À - AM - ▁FA - LES - С - Ü - ▁KU - MAN - ▁BY - WI - ET - ▁AR - ▁PRO - ION - ▁TA - YA - ▁RO - PO - ▁WITH - ▁GU - EST - ▁À - ▁P - TW - Е - ▁LES - ID - ▁می - Р - Ó - ▁ARE - VER - V - ▁DEL - Q - RY - Л - ▁AS - ن - ▁BO - UL - ▁UND - ▁TI - Й - ▁HIS - FF - ▁PAR - y - ▁ET - ▁ER - PE - ▁MI - ▁PA - ▁SI - UT - د - ▁SA - FA - SO - LU - ▁KO - ▁MAN - В - AK - ل - ▁AT - DU - ؟ - Т - ▁EX - Ɛ - ▁WA - MU - ▁ZU - К - X - ▁VA - ▁ب - ▁HO - ▁EIN - HI - ND - ▁LO - È - ا - ▁RA - ▁YA - У - ▁JE - AU - TION - TRE - ب - DIE - TS - PA - Д - MEN - KI - З - ▁IM - INE - ▁LI - ELLE - ABA - ▁NI - QUE - ان - ▁"" - М - Á - Ḍ - ATION - ▁CA - Ṛ - CHE - ▁CAN - И - AC - ▁GA - REN - ANT - ز - IA - ▁OR - STE - IX - TRA - EƔ - ▁ARA - TES - ▁BU - OL - ق - MP - BER - ▁UNA - ▁AM - TOR - ▁SCH - NG - ▁FE - RES - PER - ']"""' - ▁FO - ▁NOT - Я - ▁NICHT - ▁TRA - ▁PI - س - ▁HAVE - Ö - ▁Z - PI - '""' - ▁HER - ▁MAR - ع - CU - TT - ▁YE - CHT - ▁HAD - KU - ▁RU - STA - П - JA - НО - ▁AU - ▁PRE - ف - ZU - РА - ICH - o - Х - ▁RI - GER - ▁م - ▁DEN - ▁AUF - ▁PE - ▁H - ▁CAR - ▁TU - ▁خ - Ы - ▁SICH - ▁DIS - FI - YO - BEN - ▁ALL - LICH - AND - ▁WERE - BY - О - UND - SU - ▁JO - ▁JA - IST - BU - SH - Э - Ә - Г - ▁WAR - TED - ▁VON - ▁UR - ▁SP - ▁POR - ید - EK - ▁В - ▁UM - SON - ▁و - ، - ▁WO - ▁DAS - ▁KI - VEN - TZ - ▁AUS - ▁MIT - ▁FROM - ▁MY - ▁SIE - AG - ▁KA - ▁É - DAS - Ò - ▁با - ▁THIS - ▁AB - ▁HI - RT - ▁VO - خ - ITE - ▁CE - EZ - ▁FI - ▁به - IE - DES - ▁GO - ند - FE - MIN - ▁QU - HAN - OK - ▁ا - ▁SON - IK - TIC - ▁И - ':' - НИ - ADA - RAN - ون - Ę - ONE - ▁PU - PORT - SSE - IC - ▁IL - ▁DON - IF - ▁HAS - ار - ▁EINE - ▁TH - HER - SEN - Ш - ▁YI - WO - FER - ▁را - ▁С - RON - А - LLE - ▁JU - Ą - TRO - VO - Ẓ - NES - СТ - ▁STA - ▁ALSO - WER - FT - Ю - EF - РЕ - ▁DEG - ▁ن - ÉE - TY - Ł - НА - ARD - BAN - ▁SER - KEN - CES - ZO - ▁DÉ - ERS - ЛА - ▁CENT - OM - RIA - ABLE - ▁SUR - NIE - CHEN - ▁PAS - ▁BOY - ТА - NY - ▁AMB - ÉS - OUS - HN - TING - SHI - ARI - EḌ - І - ▁AC - ▁LOS - ACH - ▁V - QUI - ▁ONE - OP - НЫ - BLE - QU - ست - DY - PRE - HU - JO - AB - ▁INTER - ▁ZA - ▁OUT - КО - ЛИ - OD - ВО - ▁GI - ELLA - Ж - CON - ECT - ВА - Ê - PP - PH - ▁KNOW - ДЕ - NDI - UD - ▁HAT - ДА - RIE - ▁VE - ▁TER - EX - PAR - ده - EDD - ▁PRI - ▁UMU - ▁ÉS - 的 - ▁OB - WHAT - VU - ▁است - NU - HR - AGE - ص - ▁YN - MER - ▁SHE - ▁QUI - ERA - SHE - Ч - ERE - ▁این - ▁SAID - CIÓ - ЛЕ - ▁UNE - ▁در - РО - ▁ABA - ▁DANS - HEN - ▁HIM - PLE - IENT - EIN - ▁НА - ▁ش - ▁HU - یم - TON - NYA - NNI - FO - FU - TUR - ▁CI - YOU - IRE - ▁US - NER - PT - ▁CU - ▁س - ▁WILL - ▁FU - ALLY - ▁NIE - ▁که - UGH - IZ - ALL - URE - ▁TEN - ТО - ▁BUT - FOR - ▁ПО - SSEN - ▁CHA - ط - ▁PART - EB - TTER - ?" - گ - ای - ▁POUR - Ż - LAND - ▁آ - FORM - ▁CHE - USE - THIS - ح - IO - ▁ت - من - KAN - ▁چ - Ú - UF - URA - ام - ▁DEM - ▁BAR - Ү - ▁SIND - THEY - HK - LAR - IƔ - Ц - TURE - ▁ALS - GLI - ▁MON - ÍA - BLI - ▁از - ТИ - GAR - ▁О - BRA - ▁К - '"' - TURA - ▁VOR - ▁TIME - GRA - '""."' - ▁ZE - ▁RÉ - UTE - ▁ELS - بی - STER - ▁WURDE - NEN - BUT - ▁RES - KK - می - TAL - ▁STO - VING - SIE - STRU - ▁BEEN - ЛО - BRE - ▁UP - ین - ТЕ - EMENT - ج - ISH - CTION - TAN - ▁من - ▁ABOUT - ',""' - RED - IQUE - EG - ் - ▁COR - ▁ZI - ▁STE - WN - ▁R - RING - ▁WERDEN - MON - IVE - ▁MEN - UCH - ▁FÜR - AMA - CUL - ال - UE - ▁رو - ▁GRA - لی - ACIÓ - ▁MIN - QUES - UB - ور - ▁ST - ▁TRE - MIT - ▁AMA - JU - OU - ▁AUCH - جا - Ṭ - ▁WI - MAR - IYI - LEN - DEM - VEL - ▁WIR - ГО - GES - ▁PLAN - ▁MAL - TIVE - ▁У - ▁NACH - Ç - ▁CAS - ری - RWA - ▁WIRD - ▁PR - ERN - QUA - TIN - ▁YOUR - ▁NEW - CER - Ś - k - RÉ - LOS - ▁CHI - ▁REG - ▁SOL - ▁SOME - CIA - GAN - NCE - نی - THERE - IḌ - BIL - TRES - TÉ - ÇA - ▁WHAT - STI - ▁THEY - ▁WIN - ITAT - UMU - IW - ▁FRE - МИ - WY - КИ - Ө - ▁KE - 。 - وا - ENCE - ANCE - ADO - ▁APP - ▁TWO - INA - SIDE - را - Ć - XI - NGE - ГА - ▁THERE - BAR - DAN - UP - ▁COL - ▁J - ▁FIN - ▁DIESE - دا - MES - LLO - ▁REP - ▁Б - IRA - ▁LIKE - DRE - KER - LER - LIN - ŁA - ▁CH - اد - HL - ▁تو - KING - LAN - VES - LLEN - PLA - Ь - TRI - ▁SPE - YI - ЛЬ - КА - СЕ - ▁NU - TAR - FEN - ÈRE - МА - ها - دی - ANDA - ▁CAP - ISE - ▁IMP - ▁ج - ▁ÜBER - ▁KON - ONS - ▁کن - MME - НЕ - ▁NOCH - WIE - END - IEN - PU - ▁هم - MAL - BEI - ▁KAN - ALS - Ε - ▁THEIR - MBA - MY - ▁SEU - ▁CRE - ▁CY - ▁PLA - ما - CIE - ▁AY - ▁UBU - ▁WOULD - ▁BRI - ▁BRO - ▁ICH - ு - از - ILLE - ▁SONT - ▁PARA - LOG - ЕТ - WAL - STAND - تر - ▁OTHER - سی - EIX - CY - ▁TRO - ▁MOR - ANG - ▁WANT - ▁PERSON - INT - ITY - ி - ▁EM - ZEN - ELS - ▁НЕ - ЧЕ - ▁SIĘ - ▁BRA - ▁NAME - GIN - COM - ▁VAN - SERV - با - SHA - UNE - IER - ▁INTO - ▁OVER - PRO - PEN - ▁А - YEN - ▁PASS - ▁LU - CN - ▁MURI - ▁POLI - WAY - LIE - ▁OP - KUN - РИ - ▁HAR - ▁WORK - QQ - ▁MORE - NDO - ▁TRI - ZY - Č - ▁SEE - ▁د - ▁پ - ▁GEN - KIN - IERT - TIV - ▁ITS - Ǧ - ÜR - DING - ▁SEG - ТЬ - ƔA - رد - GIRA - ▁MÉS - ▁VOL - ▁ERA - ▁ANY - HIS - Ṣ - HIN - ATED - ÖR - Б - AQUEST - ▁TEM - ▁IBI - لا - RÀ - PON - ▁JUST - NET - AIRE - ▁PLAY - ▁FIRST - ▁ЗА - KT - МЕ - BRI - LAS - ▁GET - ▁KANN - EC - نه - FIN - ▁VEN - ▁GAR - CRI - AY - ▁FER - AƔ - ▁REC - UNGEN - VAN - رو - ▁ح - '...' - ▁WAY - ṬṬ - AVA - ŁO - RICA - UKO - IZA - WAN - زی - ▁STAR - ▁COULD - ▁BAT - ▁HAND - فت - ▁UNTER - CRE - NIC - TZEN - ▁ع - ▁AF - ▁بر - VOR - ަ - ÜH - GEL - COMP - WHERE - IAN - ▁THEM - ALI - UX - DON - ▁MIL - WIN - NTA - STEN - COR - ▁WHO - CAR - CHER - СЯ - ▁AKK - ▁ASS - UNA - БО - IBI - ITA - OUT - MBO - WOR - ▁ESP - DIA - ▁PLUS - ▁CRI - ▁ق - ▁کرد - ▁DAY - RIES - CZ - ATI - TENT - ATS - AMENT - AH - IÓ - در - UƔ - CHO - SSER - ▁یک - ▁OC - NÉ - ▁YEAR - ISCHE - IGEN - ▁" - ЖЕ - ▁SUB - ITS - ДИ - ÓN - ▁ƔER - ▁PARTI - ВИ - ▁EINEN - AI - ▁DEUX - ▁SEN - های - ي - ▁TRANS - PLI - ▁PEOPLE - پ - WIR - او - DOS - ▁FELL - ▁BEI - MÉ - ▁SAL - ▁GRE - ITÉ - ▁SC - ▁TT - ▁LAS - RIO - DAY - ▁ما - TTA - ISCHEN - ▁ƔEF - ▁ПРО - CUR - CHA - LIC - ▁BUR - NIA - TIONS - ICI - LING - ▁BAS - ВЕ - ▁SAN - ANDO - ▁بود - NGER - دار - DUC - ▁ZO - ITZ - ALE - ÉR - Ô - ▁ALLE - ▁FLO - چ - ▁HOR - ЕН - TAMBÉ - YUBA - AUX - ICAL - DOR - یا - STRA - BEL - ▁NOM - ▁BACK - ▁OLD - ZWE - ▁LONG - ▁ف - TANT - МЫ - ISTE - ▁FORM - CIONS - CIÓN - ▁EU - PRI - АР - شت - ▁! - ▁BER - ▁СО - ▁STRA - ▁DAR - ▁MET - ▁ONLY - MENTE - 一 - ▁هست - ▁CAL - CAN - ▁FUN - ▁DID - БЕ - АН - ANTE - ▁— - TIK - BWA - IKI - РУ - ÄR - VIS - Ĝ - ▁WIE - ▁INDI - VENT - ▁THAN - SES - ULA - AUF - FUL - TORI - ▁AK - ▁SIN - GARA - LÄ - Ě - RIT - EGO - POR - '!"' - RICH - VERS - THAT - ▁CRO - GUE - ЛЯ - CENT - REICH - ELLI - DEL - اس - ZZ - ▁DELS - ▁COME - ▁ARI - ▁SEIN - MBI - ▁AFTER - XE - ▁PRÉ - ОБ - گر - UBU - SCHAFT - VAL - ▁NUR - ▁TAM - ▁ENTRE - DIC - ▁SHA - EUX - ▁П - Â - ▁MAY - ТЫ - ▁NEVER - ▁PROP - ▁گ - ▁NOW - ▁EMP - ▁POS - ▁MUSS - ▁YID - ▁GOING - АЛ - WARD - WAR - ▁Я - Ф - ▁MADE - ']—' - ▁ACC - VENIM - ▁CAT - LIGHT - ▁PEN - ▁Т - ▁THROUGH - ▁DASS - ▁AUTO - CIO - ▁THINK - NZE - GUN - ; - ▁GRAN - ТУ - SPEC - ▁NEU - ▁SCHOOL - VUGA - ▁ДО - ▁WHEN - CLE - YDD - ▁MOLT - ▁REAL - ▁SEINE - 是 - IBLE - ▁GRAND - ▁Х - ات - ▁QUATRE - ▁KRA - FIC - ЕМ - ÄH - РЫ - க - ARE - 有 - ▁HAUPTSTADT - KORA - ▁FUE - CKE - ▁ACU - TICA - UKA - ▁CLO - ▁NGO - ▁BRE - ▁HERE - ▁AVEC - ▁MOST - LIT - ▁VAL - NYE - ▁COMME - ▁IF - BERT - ▁USED - ▁EI - HOW - ▁MAKE - ா - غ - · - Ï - Α - ப - އ - " - ض - Ñ - Î - த - Ş - ர - Š - ެ - ட - Ĉ - 我 - வ - ك - ު - v - Ң - 人 - Ο - آ - 不 - ظ - Ž - ை - ް - Σ - ި - 大 - d - Τ - ற - 去 - ய - ذ - Ř - 在 - m - ً - Ι - ث - Ა - أ - Ŝ - Õ - 了 - ம - Ù - Ი - 要 - 個 - ச - Ν - " - Ğ - ல - 到 - ާ - 街 - ள - Щ - " - 喺 - ނ - ன - 中 - Ё - 道 - – - 家 - Є - Œ - 好 - Ý - 會 - މ - Ე - Û - ކ - ރ - Ń - 路 - Ρ - ئ - Ї - ே - ވ - Κ - Π - 上 - 以 - 你 - 來 - Ă - Å - j - « - 下 - ண - ހ - ¡ - 生 - ة - 地 - Γ - 他 - ந - » - ژ - Ӑ - ¿ - ގ - 都 - 就 - ெ - ى - 這 - Μ - ' - h - 知 - 唔 - 出 - Ħ - 多 - Ს - Υ - Һ - 可 - Λ - Җ - 天</code></pre>