| 01/31/2022 07:15:59 - WARNING - __main__ - Process rank: -1, device: cuda:0, n_gpu: 1distributed training: False, 16-bits training: True | |
| 01/31/2022 07:15:59 - INFO - __main__ - Training/evaluation parameters TrainingArguments( | |
| _n_gpu=1, | |
| adafactor=False, | |
| adam_beta1=0.9, | |
| adam_beta2=0.999, | |
| adam_epsilon=1e-08, | |
| bf16=False, | |
| bf16_full_eval=False, | |
| dataloader_drop_last=False, | |
| dataloader_num_workers=0, | |
| dataloader_pin_memory=True, | |
| ddp_bucket_cap_mb=None, | |
| ddp_find_unused_parameters=None, | |
| debug=[], | |
| deepspeed=None, | |
| disable_tqdm=False, | |
| do_eval=True, | |
| do_predict=False, | |
| do_train=True, | |
| eval_accumulation_steps=None, | |
| eval_steps=500, | |
| evaluation_strategy=IntervalStrategy.STEPS, | |
| fp16=True, | |
| fp16_backend=auto, | |
| fp16_full_eval=False, | |
| fp16_opt_level=O1, | |
| gradient_accumulation_steps=4, | |
| gradient_checkpointing=True, | |
| greater_is_better=None, | |
| group_by_length=True, | |
| half_precision_backend=auto, | |
| hub_model_id=None, | |
| hub_strategy=HubStrategy.EVERY_SAVE, | |
| hub_token=<HUB_TOKEN>, | |
| ignore_data_skip=False, | |
| label_names=None, | |
| label_smoothing_factor=0.0, | |
| learning_rate=7.5e-05, | |
| length_column_name=input_length, | |
| load_best_model_at_end=False, | |
| local_rank=-1, | |
| log_level=-1, | |
| log_level_replica=-1, | |
| log_on_each_node=True, | |
| logging_dir=./runs/Jan31_07-15-59_job-2c68f48a-2d5d-4013-9043-3f2cb25f3ff6, | |
| logging_first_step=False, | |
| logging_nan_inf_filter=True, | |
| logging_steps=100, | |
| logging_strategy=IntervalStrategy.STEPS, | |
| lr_scheduler_type=SchedulerType.LINEAR, | |
| max_grad_norm=1.0, | |
| max_steps=-1, | |
| metric_for_best_model=None, | |
| mp_parameters=, | |
| no_cuda=False, | |
| num_train_epochs=50.0, | |
| optim=OptimizerNames.ADAMW_HF, | |
| output_dir=./, | |
| overwrite_output_dir=True, | |
| past_index=-1, | |
| per_device_eval_batch_size=8, | |
| per_device_train_batch_size=8, | |
| prediction_loss_only=False, | |
| push_to_hub=True, | |
| push_to_hub_model_id=None, | |
| push_to_hub_organization=None, | |
| push_to_hub_token=<PUSH_TO_HUB_TOKEN>, | |
| remove_unused_columns=True, | |
| report_to=['tensorboard'], | |
| resume_from_checkpoint=None, | |
| run_name=./, | |
| save_on_each_node=False, | |
| save_steps=500, | |
| save_strategy=IntervalStrategy.STEPS, | |
| save_total_limit=3, | |
| seed=42, | |
| sharded_ddp=[], | |
| skip_memory_metrics=True, | |
| tf32=None, | |
| tpu_metrics_debug=False, | |
| tpu_num_cores=None, | |
| use_legacy_prediction_loop=False, | |
| warmup_ratio=0.0, | |
| warmup_steps=2000, | |
| weight_decay=0.0, | |
| xpu_backend=None, | |
| ) | |
| 01/31/2022 07:16:01 - WARNING - datasets.builder - Reusing dataset zeroth_korean_asr (/workspace/.cache/huggingface/datasets/kresnik___zeroth_korean_asr/clean/1.0.1/f6cf96a53d5512525e3113bab8048d36ce268658d6e0c40d45f65dfa3f0bc343) | |
| 01/31/2022 07:16:03 - WARNING - datasets.builder - Reusing dataset zeroth_korean_asr (/workspace/.cache/huggingface/datasets/kresnik___zeroth_korean_asr/clean/1.0.1/f6cf96a53d5512525e3113bab8048d36ce268658d6e0c40d45f65dfa3f0bc343) | |
| remove special characters from datasets: 0ex [00:00, ?ex/s] remove special characters from datasets: 1000ex [00:00, 9974.66ex/s] remove special characters from datasets: 2055ex [00:00, 10308.75ex/s] remove special characters from datasets: 3199ex [00:00, 10824.47ex/s] remove special characters from datasets: 4345ex [00:00, 11074.98ex/s] remove special characters from datasets: 5495ex [00:00, 11227.17ex/s] remove special characters from datasets: 6633ex [00:00, 11276.25ex/s] remove special characters from datasets: 7761ex [00:00, 11148.49ex/s] remove special characters from datasets: 8877ex [00:00, 10968.51ex/s] remove special characters from datasets: 9975ex [00:00, 10891.69ex/s] remove special characters from datasets: 11065ex [00:01, 10876.53ex/s] remove special characters from datasets: 12204ex [00:01, 11029.97ex/s] remove special characters from datasets: 13308ex [00:01, 10876.84ex/s] remove special characters from datasets: 14405ex [00:01, 10901.35ex/s] remove special characters from datasets: 15496ex [00:01, 10883.42ex/s] remove special characters from datasets: 16585ex [00:01, 10507.14ex/s] remove special characters from datasets: 17639ex [00:01, 10394.81ex/s] remove special characters from datasets: 18681ex [00:01, 10306.72ex/s] remove special characters from datasets: 19750ex [00:01, 10416.89ex/s] remove special characters from datasets: 20893ex [00:01, 10714.37ex/s] remove special characters from datasets: 22000ex [00:02, 10798.35ex/s] remove special characters from datasets: 22263ex [00:02, 10809.37ex/s] | |
| remove special characters from datasets: 0ex [00:00, ?ex/s] remove special characters from datasets: 457ex [00:00, 12085.35ex/s] | |
| loading configuration file https://huggingface.co/facebook/wav2vec2-xls-r-300m/resolve/main/config.json from cache at /workspace/.cache/huggingface/transformers/dabc27df63e37bd2a7a221c7774e35f36a280fbdf917cf54cadfc7df8c786f6f.a3e4c3c967d9985881e0ae550a5f6f668f897db5ab2e0802f9b97973b15970e6 | |
| Model config Wav2Vec2Config { | |
| "_name_or_path": "facebook/wav2vec2-xls-r-300m", | |
| "activation_dropout": 0.0, | |
| "adapter_kernel_size": 3, | |
| "adapter_stride": 2, | |
| "add_adapter": false, | |
| "apply_spec_augment": true, | |
| "architectures": [ | |
| "Wav2Vec2ForPreTraining" | |
| ], | |
| "attention_dropout": 0.1, | |
| "bos_token_id": 1, | |
| "classifier_proj_size": 256, | |
| "codevector_dim": 768, | |
| "contrastive_logits_temperature": 0.1, | |
| "conv_bias": true, | |
| "conv_dim": [ | |
| 512, | |
| 512, | |
| 512, | |
| 512, | |
| 512, | |
| 512, | |
| 512 | |
| ], | |
| "conv_kernel": [ | |
| 10, | |
| 3, | |
| 3, | |
| 3, | |
| 3, | |
| 2, | |
| 2 | |
| ], | |
| "conv_stride": [ | |
| 5, | |
| 2, | |
| 2, | |
| 2, | |
| 2, | |
| 2, | |
| 2 | |
| ], | |
| "ctc_loss_reduction": "sum", | |
| "ctc_zero_infinity": false, | |
| "diversity_loss_weight": 0.1, | |
| "do_stable_layer_norm": true, | |
| "eos_token_id": 2, | |
| "feat_extract_activation": "gelu", | |
| "feat_extract_dropout": 0.0, | |
| "feat_extract_norm": "layer", | |
| "feat_proj_dropout": 0.1, | |
| "feat_quantizer_dropout": 0.0, | |
| "final_dropout": 0.0, | |
| "gradient_checkpointing": false, | |
| "hidden_act": "gelu", | |
| "hidden_dropout": 0.1, | |
| "hidden_size": 1024, | |
| "initializer_range": 0.02, | |
| "intermediate_size": 4096, | |
| "layer_norm_eps": 1e-05, | |
| "layerdrop": 0.1, | |
| "mask_feature_length": 10, | |
| "mask_feature_min_masks": 0, | |
| "mask_feature_prob": 0.0, | |
| "mask_time_length": 10, | |
| "mask_time_min_masks": 2, | |
| "mask_time_prob": 0.075, | |
| "model_type": "wav2vec2", | |
| "num_adapter_layers": 3, | |
| "num_attention_heads": 16, | |
| "num_codevector_groups": 2, | |
| "num_codevectors_per_group": 320, | |
| "num_conv_pos_embedding_groups": 16, | |
| "num_conv_pos_embeddings": 128, | |
| "num_feat_extract_layers": 7, | |
| "num_hidden_layers": 24, | |
| "num_negatives": 100, | |
| "output_hidden_size": 1024, | |
| "pad_token_id": 0, | |
| "proj_codevector_dim": 768, | |
| "tdnn_dilation": [ | |
| 1, | |
| 2, | |
| 3, | |
| 1, | |
| 1 | |
| ], | |
| "tdnn_dim": [ | |
| 512, | |
| 512, | |
| 512, | |
| 512, | |
| 1500 | |
| ], | |
| "tdnn_kernel": [ | |
| 5, | |
| 3, | |
| 3, | |
| 1, | |
| 1 | |
| ], | |
| "torch_dtype": "float32", | |
| "transformers_version": "4.17.0.dev0", | |
| "use_weighted_layer_sum": false, | |
| "vocab_size": 32, | |
| "xvector_output_dim": 512 | |
| } | |
| 0%| | 0/1 [00:00<?, ?ba/s] 100%|██████████| 1/1 [00:00<00:00, 3.75ba/s] 100%|██████████| 1/1 [00:00<00:00, 3.74ba/s] | |
| 0%| | 0/1 [00:00<?, ?ba/s] 100%|██████████| 1/1 [00:00<00:00, 169.84ba/s] | |
| Didn't find file ./tokenizer_config.json. We won't load it. | |
| Didn't find file ./added_tokens.json. We won't load it. | |
| Didn't find file ./special_tokens_map.json. We won't load it. | |
| Didn't find file ./tokenizer.json. We won't load it. | |
| loading file ./vocab.json | |
| loading file None | |
| loading file None | |
| loading file None | |
| loading file None | |
| file ./config.json not found | |
| Adding <s> to the vocabulary | |
| Adding </s> to the vocabulary | |
| Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained. | |
| loading configuration file https://huggingface.co/facebook/wav2vec2-xls-r-300m/resolve/main/config.json from cache at /workspace/.cache/huggingface/transformers/dabc27df63e37bd2a7a221c7774e35f36a280fbdf917cf54cadfc7df8c786f6f.a3e4c3c967d9985881e0ae550a5f6f668f897db5ab2e0802f9b97973b15970e6 | |
| Model config Wav2Vec2Config { | |
| "_name_or_path": "facebook/wav2vec2-xls-r-300m", | |
| "activation_dropout": 0.0, | |
| "adapter_kernel_size": 3, | |
| "adapter_stride": 2, | |
| "add_adapter": false, | |
| "apply_spec_augment": true, | |
| "architectures": [ | |
| "Wav2Vec2ForPreTraining" | |
| ], | |
| "attention_dropout": 0.1, | |
| "bos_token_id": 1, | |
| "classifier_proj_size": 256, | |
| "codevector_dim": 768, | |
| "contrastive_logits_temperature": 0.1, | |
| "conv_bias": true, | |
| "conv_dim": [ | |
| 512, | |
| 512, | |
| 512, | |
| 512, | |
| 512, | |
| 512, | |
| 512 | |
| ], | |
| "conv_kernel": [ | |
| 10, | |
| 3, | |
| 3, | |
| 3, | |
| 3, | |
| 2, | |
| 2 | |
| ], | |
| "conv_stride": [ | |
| 5, | |
| 2, | |
| 2, | |
| 2, | |
| 2, | |
| 2, | |
| 2 | |
| ], | |
| "ctc_loss_reduction": "sum", | |
| "ctc_zero_infinity": false, | |
| "diversity_loss_weight": 0.1, | |
| "do_stable_layer_norm": true, | |
| "eos_token_id": 2, | |
| "feat_extract_activation": "gelu", | |
| "feat_extract_dropout": 0.0, | |
| "feat_extract_norm": "layer", | |
| "feat_proj_dropout": 0.1, | |
| "feat_quantizer_dropout": 0.0, | |
| "final_dropout": 0.0, | |
| "gradient_checkpointing": false, | |
| "hidden_act": "gelu", | |
| "hidden_dropout": 0.1, | |
| "hidden_size": 1024, | |
| "initializer_range": 0.02, | |
| "intermediate_size": 4096, | |
| "layer_norm_eps": 1e-05, | |
| "layerdrop": 0.1, | |
| "mask_feature_length": 10, | |
| "mask_feature_min_masks": 0, | |
| "mask_feature_prob": 0.0, | |
| "mask_time_length": 10, | |
| "mask_time_min_masks": 2, | |
| "mask_time_prob": 0.075, | |
| "model_type": "wav2vec2", | |
| "num_adapter_layers": 3, | |
| "num_attention_heads": 16, | |
| "num_codevector_groups": 2, | |
| "num_codevectors_per_group": 320, | |
| "num_conv_pos_embedding_groups": 16, | |
| "num_conv_pos_embeddings": 128, | |
| "num_feat_extract_layers": 7, | |
| "num_hidden_layers": 24, | |
| "num_negatives": 100, | |
| "output_hidden_size": 1024, | |
| "pad_token_id": 0, | |
| "proj_codevector_dim": 768, | |
| "tdnn_dilation": [ | |
| 1, | |
| 2, | |
| 3, | |
| 1, | |
| 1 | |
| ], | |
| "tdnn_dim": [ | |
| 512, | |
| 512, | |
| 512, | |
| 512, | |
| 1500 | |
| ], | |
| "tdnn_kernel": [ | |
| 5, | |
| 3, | |
| 3, | |
| 1, | |
| 1 | |
| ], | |
| "torch_dtype": "float32", | |
| "transformers_version": "4.17.0.dev0", | |
| "use_weighted_layer_sum": false, | |
| "vocab_size": 32, | |
| "xvector_output_dim": 512 | |
| } | |
| loading feature extractor configuration file https://huggingface.co/facebook/wav2vec2-xls-r-300m/resolve/main/preprocessor_config.json from cache at /workspace/.cache/huggingface/transformers/6fb028b95b394059e7d3b367bbca2382b576c66aebe896f04d2cd34e1b575f5b.d4484dc1c81456a2461485e7168b04347a7b9a4e3b1ef3aba723323b33e12326 | |
| Feature extractor Wav2Vec2FeatureExtractor { | |
| "do_normalize": true, | |
| "feature_extractor_type": "Wav2Vec2FeatureExtractor", | |
| "feature_size": 1, | |
| "padding_side": "right", | |
| "padding_value": 0, | |
| "return_attention_mask": true, | |
| "sampling_rate": 16000 | |
| } | |
| loading weights file https://huggingface.co/facebook/wav2vec2-xls-r-300m/resolve/main/pytorch_model.bin from cache at /workspace/.cache/huggingface/transformers/1e6a6507f3b689035cd4b247e2a37c154e27f39143f31357a49b4e38baeccc36.1edb32803799e27ed554eb7dd935f6745b1a0b17b0ea256442fe24db6eb546cd | |
| Some weights of the model checkpoint at facebook/wav2vec2-xls-r-300m were not used when initializing Wav2Vec2ForCTC: ['quantizer.weight_proj.bias', 'project_q.bias', 'quantizer.weight_proj.weight', 'project_hid.bias', 'project_q.weight', 'quantizer.codevectors', 'project_hid.weight'] | |
| - This IS expected if you are initializing Wav2Vec2ForCTC from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model). | |
| - This IS NOT expected if you are initializing Wav2Vec2ForCTC from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model). | |
| Some weights of Wav2Vec2ForCTC were not initialized from the model checkpoint at facebook/wav2vec2-xls-r-300m and are newly initialized: ['lm_head.bias', 'lm_head.weight'] | |
| You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference. | |
| preprocess datasets: 0ex [00:00, ?ex/s] preprocess datasets: 1ex [00:00, 1.60ex/s] preprocess datasets: 36ex [00:00, 66.01ex/s] preprocess datasets: 67ex [00:00, 116.67ex/s] preprocess datasets: 93ex [00:00, 148.25ex/s] preprocess datasets: 118ex [00:01, 171.71ex/s] preprocess datasets: 143ex [00:01, 190.53ex/s] preprocess datasets: 168ex [00:01, 203.30ex/s] preprocess datasets: 195ex [00:01, 220.45ex/s] preprocess datasets: 220ex [00:01, 225.79ex/s] preprocess datasets: 245ex [00:01, 229.97ex/s] preprocess datasets: 270ex [00:01, 234.06ex/s] preprocess datasets: 295ex [00:01, 230.04ex/s] preprocess datasets: 320ex [00:01, 234.98ex/s] preprocess datasets: 345ex [00:01, 234.81ex/s] preprocess datasets: 369ex [00:02, 233.36ex/s] preprocess datasets: 395ex [00:02, 239.85ex/s] preprocess datasets: 420ex [00:02, 241.40ex/s] preprocess datasets: 447ex [00:02, 247.52ex/s] preprocess datasets: 472ex [00:02, 246.01ex/s] preprocess datasets: 497ex [00:02, 245.10ex/s] preprocess datasets: 522ex [00:02, 240.95ex/s] preprocess datasets: 547ex [00:02, 242.33ex/s] preprocess datasets: 578ex [00:02, 261.68ex/s] preprocess datasets: 611ex [00:03, 281.20ex/s] preprocess datasets: 646ex [00:03, 298.05ex/s] preprocess datasets: 679ex [00:03, 307.13ex/s] preprocess datasets: 711ex [00:03, 310.35ex/s] preprocess datasets: 743ex [00:03, 310.39ex/s] preprocess datasets: 775ex [00:03, 307.19ex/s] preprocess datasets: 809ex [00:03, 315.38ex/s] preprocess datasets: 844ex [00:03, 323.86ex/s] preprocess datasets: 878ex [00:03, 327.28ex/s] preprocess datasets: 911ex [00:03, 325.39ex/s] preprocess datasets: 944ex [00:04, 322.41ex/s] preprocess datasets: 977ex [00:04, 315.13ex/s] preprocess datasets: 1009ex [00:06, 42.75ex/s] preprocess datasets: 1044ex [00:06, 58.86ex/s] preprocess datasets: 1074ex [00:06, 75.68ex/s] preprocess datasets: 1104ex [00:06, 96.01ex/s] preprocess datasets: 1135ex [00:06, 120.33ex/s] preprocess datasets: 1166ex [00:06, 146.37ex/s] preprocess datasets: 1198ex [00:07, 174.27ex/s] preprocess datasets: 1228ex [00:07, 197.23ex/s] preprocess datasets: 1260ex [00:07, 222.15ex/s] preprocess datasets: 1291ex [00:07, 242.20ex/s] preprocess datasets: 1322ex [00:07, 259.01ex/s] preprocess datasets: 1353ex [00:07, 271.02ex/s] preprocess datasets: 1385ex [00:07, 283.17ex/s] preprocess datasets: 1416ex [00:07, 286.25ex/s] preprocess datasets: 1447ex [00:07, 288.57ex/s] preprocess datasets: 1479ex [00:07, 296.07ex/s] preprocess datasets: 1511ex [00:08, 300.63ex/s] preprocess datasets: 1543ex [00:08, 305.36ex/s] preprocess datasets: 1577ex [00:08, 310.98ex/s] preprocess datasets: 1609ex [00:08, 309.74ex/s] preprocess datasets: 1643ex [00:08, 314.49ex/s] preprocess datasets: 1675ex [00:08, 311.95ex/s] preprocess datasets: 1707ex [00:08, 311.51ex/s] preprocess datasets: 1740ex [00:08, 314.82ex/s] preprocess datasets: 1773ex [00:08, 318.97ex/s] preprocess datasets: 1806ex [00:09, 320.06ex/s] preprocess datasets: 1839ex [00:09, 314.34ex/s] preprocess datasets: 1871ex [00:09, 301.36ex/s] preprocess datasets: 1902ex [00:09, 296.06ex/s] preprocess datasets: 1932ex [00:09, 277.26ex/s] preprocess datasets: 1960ex [00:09, 263.74ex/s] preprocess datasets: 1988ex [00:09, 264.25ex/s] preprocess datasets: 2015ex [00:11, 45.72ex/s] preprocess datasets: 2044ex [00:11, 61.21ex/s] preprocess datasets: 2070ex [00:11, 77.71ex/s] preprocess datasets: 2099ex [00:11, 100.01ex/s] preprocess datasets: 2126ex [00:11, 121.94ex/s] preprocess datasets: 2156ex [00:12, 149.32ex/s] preprocess datasets: 2185ex [00:12, 174.20ex/s] preprocess datasets: 2212ex [00:12, 192.99ex/s] preprocess datasets: 2241ex [00:12, 213.70ex/s] preprocess datasets: 2269ex [00:12, 229.04ex/s] preprocess datasets: 2298ex [00:12, 244.49ex/s] preprocess datasets: 2329ex [00:12, 260.35ex/s] preprocess datasets: 2362ex [00:12, 279.07ex/s] preprocess datasets: 2393ex [00:12, 287.10ex/s] preprocess datasets: 2424ex [00:12, 277.86ex/s] preprocess datasets: 2454ex [00:13, 281.97ex/s] preprocess datasets: 2483ex [00:13, 283.44ex/s] preprocess datasets: 2512ex [00:13, 275.14ex/s] preprocess datasets: 2543ex [00:13, 284.24ex/s] preprocess datasets: 2572ex [00:13, 278.29ex/s] preprocess datasets: 2601ex [00:13, 275.43ex/s] preprocess datasets: 2629ex [00:13, 273.17ex/s] preprocess datasets: 2658ex [00:13, 276.24ex/s] preprocess datasets: 2687ex [00:13, 278.92ex/s] preprocess datasets: 2719ex [00:14, 289.97ex/s] preprocess datasets: 2749ex [00:14, 292.75ex/s] preprocess datasets: 2779ex [00:14, 272.36ex/s] preprocess datasets: 2807ex [00:14, 272.20ex/s] preprocess datasets: 2836ex [00:14, 275.88ex/s] preprocess datasets: 2866ex [00:14, 281.08ex/s] preprocess datasets: 2898ex [00:14, 290.71ex/s] preprocess datasets: 2931ex [00:14, 299.46ex/s] preprocess datasets: 2962ex [00:14, 287.98ex/s] preprocess datasets: 2996ex [00:15, 302.71ex/s] preprocess datasets: 3027ex [00:17, 46.29ex/s] preprocess datasets: 3061ex [00:17, 63.54ex/s] preprocess datasets: 3092ex [00:17, 82.51ex/s] preprocess datasets: 3124ex [00:17, 105.96ex/s] preprocess datasets: 3154ex [00:17, 130.06ex/s] preprocess datasets: 3187ex [00:17, 159.24ex/s] preprocess datasets: 3220ex [00:17, 188.16ex/s] preprocess datasets: 3251ex [00:17, 211.99ex/s] preprocess datasets: 3282ex [00:17, 232.25ex/s] preprocess datasets: 3313ex [00:17, 243.74ex/s] preprocess datasets: 3344ex [00:18, 258.48ex/s] preprocess datasets: 3376ex [00:18, 272.95ex/s] preprocess datasets: 3407ex [00:18, 276.12ex/s] preprocess datasets: 3437ex [00:18, 281.73ex/s] preprocess datasets: 3467ex [00:18, 284.33ex/s] preprocess datasets: 3498ex [00:18, 290.61ex/s] preprocess datasets: 3528ex [00:18, 274.40ex/s] preprocess datasets: 3561ex [00:18, 288.99ex/s] preprocess datasets: 3595ex [00:18, 303.08ex/s] preprocess datasets: 3627ex [00:19, 307.21ex/s] preprocess datasets: 3659ex [00:19, 310.82ex/s] preprocess datasets: 3693ex [00:19, 319.31ex/s] preprocess datasets: 3727ex [00:19, 322.34ex/s] preprocess datasets: 3760ex [00:19, 324.49ex/s] preprocess datasets: 3794ex [00:19, 325.65ex/s] preprocess datasets: 3827ex [00:19, 314.29ex/s] preprocess datasets: 3859ex [00:19, 308.29ex/s] preprocess datasets: 3890ex [00:19, 306.32ex/s] preprocess datasets: 3921ex [00:19, 305.89ex/s] preprocess datasets: 3952ex [00:20, 302.62ex/s] preprocess datasets: 3984ex [00:20, 306.19ex/s] preprocess datasets: 4015ex [00:21, 51.31ex/s] preprocess datasets: 4044ex [00:22, 66.78ex/s] preprocess datasets: 4074ex [00:22, 86.36ex/s] preprocess datasets: 4103ex [00:22, 108.32ex/s] preprocess datasets: 4132ex [00:22, 132.21ex/s] preprocess datasets: 4162ex [00:22, 158.77ex/s] preprocess datasets: 4194ex [00:22, 188.70ex/s] preprocess datasets: 4224ex [00:22, 211.53ex/s] preprocess datasets: 4257ex [00:22, 237.07ex/s] preprocess datasets: 4293ex [00:22, 266.30ex/s] preprocess datasets: 4325ex [00:22, 272.82ex/s] preprocess datasets: 4359ex [00:23, 288.89ex/s] preprocess datasets: 4393ex [00:23, 301.53ex/s] preprocess datasets: 4426ex [00:23, 305.39ex/s] preprocess datasets: 4459ex [00:23, 310.75ex/s] preprocess datasets: 4494ex [00:23, 320.61ex/s] preprocess datasets: 4530ex [00:23, 330.70ex/s] preprocess datasets: 4564ex [00:23, 327.90ex/s] preprocess datasets: 4598ex [00:23, 330.52ex/s] preprocess datasets: 4632ex [00:23, 329.84ex/s] preprocess datasets: 4669ex [00:24, 341.53ex/s] preprocess datasets: 4704ex [00:24, 337.52ex/s] preprocess datasets: 4738ex [00:24, 335.59ex/s] preprocess datasets: 4775ex [00:24, 344.96ex/s] preprocess datasets: 4812ex [00:24, 347.26ex/s] preprocess datasets: 4847ex [00:24, 327.83ex/s] preprocess datasets: 4881ex [00:24, 316.49ex/s] preprocess datasets: 4913ex [00:24, 314.28ex/s] preprocess datasets: 4945ex [00:24, 307.85ex/s] preprocess datasets: 4976ex [00:24, 302.74ex/s] preprocess datasets: 5007ex [00:26, 51.78ex/s] preprocess datasets: 5039ex [00:26, 69.03ex/s] preprocess datasets: 5066ex [00:27, 85.84ex/s] preprocess datasets: 5096ex [00:27, 108.64ex/s] preprocess datasets: 5126ex [00:27, 133.73ex/s] preprocess datasets: 5155ex [00:27, 157.94ex/s] preprocess datasets: 5186ex [00:27, 185.94ex/s] preprocess datasets: 5217ex [00:27, 211.38ex/s] preprocess datasets: 5247ex [00:27, 226.22ex/s] preprocess datasets: 5277ex [00:27, 240.99ex/s] preprocess datasets: 5306ex [00:27, 250.77ex/s] preprocess datasets: 5338ex [00:27, 266.91ex/s] preprocess datasets: 5371ex [00:28, 281.71ex/s] preprocess datasets: 5402ex [00:28, 281.00ex/s] preprocess datasets: 5434ex [00:28, 291.27ex/s] preprocess datasets: 5465ex [00:28, 292.64ex/s] preprocess datasets: 5495ex [00:28, 293.26ex/s] preprocess datasets: 5525ex [00:28, 293.28ex/s] preprocess datasets: 5555ex [00:28, 293.80ex/s] preprocess datasets: 5586ex [00:28, 297.35ex/s] preprocess datasets: 5620ex [00:28, 309.12ex/s] preprocess datasets: 5656ex [00:28, 320.84ex/s] preprocess datasets: 5689ex [00:29, 309.93ex/s] preprocess datasets: 5721ex [00:29, 305.20ex/s] preprocess datasets: 5752ex [00:29, 304.29ex/s] preprocess datasets: 5784ex [00:29, 308.76ex/s] preprocess datasets: 5818ex [00:29, 315.31ex/s] preprocess datasets: 5850ex [00:29, 306.49ex/s] preprocess datasets: 5881ex [00:29, 306.87ex/s] preprocess datasets: 5913ex [00:29, 309.23ex/s] preprocess datasets: 5944ex [00:29, 297.97ex/s] preprocess datasets: 5975ex [00:30, 299.32ex/s] preprocess datasets: 6006ex [00:32, 45.95ex/s] preprocess datasets: 6037ex [00:32, 61.51ex/s] preprocess datasets: 6068ex [00:32, 80.83ex/s] preprocess datasets: 6098ex [00:32, 102.50ex/s] preprocess datasets: 6133ex [00:32, 132.99ex/s] preprocess datasets: 6164ex [00:32, 159.01ex/s] preprocess datasets: 6194ex [00:32, 180.80ex/s] preprocess datasets: 6227ex [00:32, 209.72ex/s] preprocess datasets: 6260ex [00:32, 234.15ex/s] preprocess datasets: 6292ex [00:32, 254.27ex/s] preprocess datasets: 6323ex [00:33, 267.92ex/s] preprocess datasets: 6354ex [00:33, 268.61ex/s] preprocess datasets: 6384ex [00:33, 253.57ex/s] preprocess datasets: 6412ex [00:33, 258.91ex/s] preprocess datasets: 6441ex [00:33, 266.53ex/s] preprocess datasets: 6470ex [00:33, 271.90ex/s] preprocess datasets: 6499ex [00:33, 273.94ex/s] preprocess datasets: 6528ex [00:33, 272.57ex/s] preprocess datasets: 6556ex [00:33, 269.96ex/s] preprocess datasets: 6584ex [00:34, 259.44ex/s] preprocess datasets: 6611ex [00:34, 246.96ex/s] preprocess datasets: 6639ex [00:34, 253.41ex/s] preprocess datasets: 6665ex [00:34, 253.86ex/s] preprocess datasets: 6691ex [00:34, 254.97ex/s] preprocess datasets: 6717ex [00:34, 251.22ex/s] preprocess datasets: 6743ex [00:34, 250.24ex/s] preprocess datasets: 6776ex [00:34, 270.96ex/s] preprocess datasets: 6808ex [00:34, 284.91ex/s] preprocess datasets: 6843ex [00:35, 303.07ex/s] preprocess datasets: 6877ex [00:35, 313.17ex/s] preprocess datasets: 6913ex [00:35, 324.13ex/s] preprocess datasets: 6946ex [00:35, 311.10ex/s] preprocess datasets: 6978ex [00:35, 308.62ex/s] preprocess datasets: 7009ex [00:37, 46.18ex/s] preprocess datasets: 7043ex [00:37, 63.08ex/s] preprocess datasets: 7075ex [00:37, 82.57ex/s] preprocess datasets: 7103ex [00:37, 101.61ex/s] preprocess datasets: 7138ex [00:37, 131.69ex/s] preprocess datasets: 7168ex [00:38, 154.05ex/s] preprocess datasets: 7202ex [00:38, 185.32ex/s] preprocess datasets: 7234ex [00:38, 211.57ex/s] preprocess datasets: 7265ex [00:38, 230.77ex/s] preprocess datasets: 7296ex [00:38, 249.46ex/s] preprocess datasets: 7328ex [00:38, 265.93ex/s] preprocess datasets: 7360ex [00:38, 278.55ex/s] preprocess datasets: 7396ex [00:38, 298.96ex/s] preprocess datasets: 7431ex [00:38, 311.60ex/s] preprocess datasets: 7465ex [00:38, 318.25ex/s] preprocess datasets: 7501ex [00:39, 327.83ex/s] preprocess datasets: 7535ex [00:39, 321.00ex/s] preprocess datasets: 7568ex [00:39, 320.58ex/s] preprocess datasets: 7601ex [00:39, 319.38ex/s] preprocess datasets: 7634ex [00:39, 316.44ex/s] preprocess datasets: 7666ex [00:39, 311.52ex/s] preprocess datasets: 7698ex [00:39, 311.51ex/s] preprocess datasets: 7730ex [00:39, 309.54ex/s] preprocess datasets: 7762ex [00:39, 308.64ex/s] preprocess datasets: 7793ex [00:40, 306.67ex/s] preprocess datasets: 7826ex [00:40, 312.76ex/s] preprocess datasets: 7858ex [00:40, 301.64ex/s] preprocess datasets: 7889ex [00:40, 294.02ex/s] preprocess datasets: 7919ex [00:40, 287.35ex/s] preprocess datasets: 7952ex [00:40, 298.09ex/s] preprocess datasets: 7983ex [00:40, 300.50ex/s] preprocess datasets: 8014ex [00:42, 52.49ex/s] preprocess datasets: 8039ex [00:42, 65.64ex/s] preprocess datasets: 8062ex [00:42, 73.14ex/s] preprocess datasets: 8093ex [00:42, 97.26ex/s] preprocess datasets: 8123ex [00:42, 122.71ex/s] preprocess datasets: 8152ex [00:43, 148.14ex/s] preprocess datasets: 8178ex [00:43, 167.79ex/s] preprocess datasets: 8205ex [00:43, 188.27ex/s] preprocess datasets: 8237ex [00:43, 216.77ex/s] preprocess datasets: 8270ex [00:43, 242.33ex/s] preprocess datasets: 8301ex [00:43, 258.55ex/s] preprocess datasets: 8335ex [00:43, 278.28ex/s] preprocess datasets: 8369ex [00:43, 292.63ex/s] preprocess datasets: 8403ex [00:43, 304.53ex/s] preprocess datasets: 8436ex [00:43, 309.82ex/s] preprocess datasets: 8469ex [00:44, 315.52ex/s] preprocess datasets: 8502ex [00:44, 307.40ex/s] preprocess datasets: 8535ex [00:44, 313.20ex/s] preprocess datasets: 8569ex [00:44, 319.53ex/s] preprocess datasets: 8602ex [00:44, 318.68ex/s] preprocess datasets: 8637ex [00:44, 325.76ex/s] preprocess datasets: 8670ex [00:44, 326.03ex/s] preprocess datasets: 8703ex [00:44, 319.03ex/s] preprocess datasets: 8736ex [00:44, 310.26ex/s] preprocess datasets: 8768ex [00:44, 310.73ex/s] preprocess datasets: 8800ex [00:45, 304.55ex/s] preprocess datasets: 8831ex [00:45, 304.29ex/s] preprocess datasets: 8862ex [00:45, 304.28ex/s] preprocess datasets: 8893ex [00:45, 299.46ex/s] preprocess datasets: 8925ex [00:45, 303.87ex/s] preprocess datasets: 8957ex [00:45, 305.80ex/s] preprocess datasets: 8988ex [00:45, 294.20ex/s] preprocess datasets: 9018ex [00:47, 50.69ex/s] preprocess datasets: 9047ex [00:47, 66.23ex/s] preprocess datasets: 9080ex [00:47, 88.41ex/s] preprocess datasets: 9110ex [00:47, 110.77ex/s] preprocess datasets: 9139ex [00:47, 134.40ex/s] preprocess datasets: 9171ex [00:48, 163.59ex/s] preprocess datasets: 9203ex [00:48, 192.03ex/s] preprocess datasets: 9236ex [00:48, 220.46ex/s] preprocess datasets: 9267ex [00:48, 239.74ex/s] preprocess datasets: 9298ex [00:48, 256.54ex/s] preprocess datasets: 9329ex [00:48, 250.74ex/s] preprocess datasets: 9360ex [00:48, 264.99ex/s] preprocess datasets: 9393ex [00:48, 278.82ex/s] preprocess datasets: 9427ex [00:48, 292.96ex/s] preprocess datasets: 9459ex [00:48, 297.91ex/s] preprocess datasets: 9490ex [00:49, 298.10ex/s] preprocess datasets: 9521ex [00:49, 298.68ex/s] preprocess datasets: 9552ex [00:49, 295.42ex/s] preprocess datasets: 9583ex [00:49, 296.45ex/s] preprocess datasets: 9613ex [00:49, 296.23ex/s] preprocess datasets: 9644ex [00:49, 298.02ex/s] preprocess datasets: 9674ex [00:49, 289.51ex/s] preprocess datasets: 9704ex [00:49, 284.92ex/s] preprocess datasets: 9733ex [00:49, 284.90ex/s] preprocess datasets: 9763ex [00:50, 288.86ex/s] preprocess datasets: 9792ex [00:50, 288.40ex/s] preprocess datasets: 9821ex [00:50, 287.53ex/s] preprocess datasets: 9850ex [00:50, 283.62ex/s] preprocess datasets: 9880ex [00:50, 287.00ex/s] preprocess datasets: 9909ex [00:50, 285.40ex/s] preprocess datasets: 9938ex [00:50, 283.95ex/s] preprocess datasets: 9967ex [00:50, 282.40ex/s] preprocess datasets: 9996ex [00:50, 279.64ex/s] preprocess datasets: 10024ex [00:52, 45.32ex/s] preprocess datasets: 10049ex [00:52, 58.25ex/s] preprocess datasets: 10079ex [00:52, 78.23ex/s] preprocess datasets: 10107ex [00:53, 99.53ex/s] preprocess datasets: 10139ex [00:53, 128.08ex/s] preprocess datasets: 10169ex [00:53, 153.88ex/s] preprocess datasets: 10197ex [00:53, 176.77ex/s] preprocess datasets: 10225ex [00:53, 197.28ex/s] preprocess datasets: 10253ex [00:53, 215.16ex/s] preprocess datasets: 10281ex [00:53, 229.12ex/s] preprocess datasets: 10309ex [00:53, 237.01ex/s] preprocess datasets: 10338ex [00:53, 250.26ex/s] preprocess datasets: 10369ex [00:53, 265.62ex/s] preprocess datasets: 10402ex [00:54, 283.35ex/s] preprocess datasets: 10434ex [00:54, 292.86ex/s] preprocess datasets: 10469ex [00:54, 305.95ex/s] preprocess datasets: 10501ex [00:54, 309.07ex/s] preprocess datasets: 10535ex [00:54, 315.58ex/s] preprocess datasets: 10571ex [00:54, 328.08ex/s] preprocess datasets: 10605ex [00:54, 330.50ex/s] preprocess datasets: 10639ex [00:54, 330.63ex/s] preprocess datasets: 10674ex [00:54, 333.39ex/s] preprocess datasets: 10708ex [00:54, 328.04ex/s] preprocess datasets: 10743ex [00:55, 332.73ex/s] preprocess datasets: 10778ex [00:55, 336.79ex/s] preprocess datasets: 10812ex [00:55, 326.75ex/s] preprocess datasets: 10845ex [00:55, 322.82ex/s] preprocess datasets: 10878ex [00:55, 321.68ex/s] preprocess datasets: 10911ex [00:55, 322.99ex/s] preprocess datasets: 10944ex [00:55, 315.94ex/s] preprocess datasets: 10976ex [00:55, 307.28ex/s] preprocess datasets: 11007ex [00:57, 55.97ex/s] preprocess datasets: 11040ex [00:57, 74.74ex/s] preprocess datasets: 11074ex [00:57, 98.33ex/s] preprocess datasets: 11107ex [00:57, 124.25ex/s] preprocess datasets: 11138ex [00:57, 149.40ex/s] preprocess datasets: 11168ex [00:58, 173.03ex/s] preprocess datasets: 11200ex [00:58, 200.62ex/s] preprocess datasets: 11233ex [00:58, 227.46ex/s] preprocess datasets: 11272ex [00:58, 264.28ex/s] preprocess datasets: 11306ex [00:58, 282.74ex/s] preprocess datasets: 11340ex [00:58, 289.26ex/s] preprocess datasets: 11373ex [00:58, 293.03ex/s] preprocess datasets: 11405ex [00:58, 298.36ex/s] preprocess datasets: 11437ex [00:58, 301.73ex/s] preprocess datasets: 11471ex [00:58, 310.73ex/s] preprocess datasets: 11504ex [00:59, 313.18ex/s] preprocess datasets: 11539ex [00:59, 323.78ex/s] preprocess datasets: 11572ex [00:59, 324.46ex/s] preprocess datasets: 11605ex [00:59, 324.18ex/s] preprocess datasets: 11638ex [00:59, 322.25ex/s] preprocess datasets: 11671ex [00:59, 323.50ex/s] preprocess datasets: 11707ex [00:59, 333.53ex/s] preprocess datasets: 11741ex [00:59, 330.61ex/s] preprocess datasets: 11775ex [00:59, 317.48ex/s] preprocess datasets: 11807ex [00:59, 300.94ex/s] preprocess datasets: 11838ex [01:00, 268.24ex/s] preprocess datasets: 11866ex [01:00, 257.55ex/s] preprocess datasets: 11895ex [01:00, 262.52ex/s] preprocess datasets: 11922ex [01:00, 264.01ex/s] preprocess datasets: 11950ex [01:00, 265.70ex/s] preprocess datasets: 11980ex [01:00, 272.72ex/s] preprocess datasets: 12008ex [01:02, 47.10ex/s] preprocess datasets: 12031ex [01:02, 58.84ex/s] preprocess datasets: 12058ex [01:02, 76.75ex/s] preprocess datasets: 12087ex [01:02, 99.64ex/s] preprocess datasets: 12115ex [01:02, 123.14ex/s] preprocess datasets: 12141ex [01:02, 144.57ex/s] preprocess datasets: 12169ex [01:03, 169.45ex/s] preprocess datasets: 12200ex [01:03, 198.15ex/s] preprocess datasets: 12235ex [01:03, 232.59ex/s] preprocess datasets: 12265ex [01:03, 247.50ex/s] preprocess datasets: 12295ex [01:03, 248.18ex/s] preprocess datasets: 12324ex [01:03, 254.47ex/s] preprocess datasets: 12354ex [01:03, 265.78ex/s] preprocess datasets: 12385ex [01:03, 275.65ex/s] preprocess datasets: 12414ex [01:03, 269.04ex/s] preprocess datasets: 12442ex [01:04, 271.50ex/s] preprocess datasets: 12470ex [01:04, 271.76ex/s] preprocess datasets: 12502ex [01:04, 284.87ex/s] preprocess datasets: 12531ex [01:04, 282.81ex/s] preprocess datasets: 12560ex [01:04, 281.54ex/s] preprocess datasets: 12590ex [01:04, 285.61ex/s] preprocess datasets: 12619ex [01:04, 285.52ex/s] preprocess datasets: 12648ex [01:04, 284.87ex/s] preprocess datasets: 12683ex [01:04, 303.59ex/s] preprocess datasets: 12714ex [01:04, 297.64ex/s] preprocess datasets: 12744ex [01:05, 293.07ex/s] preprocess datasets: 12774ex [01:05, 291.56ex/s] preprocess datasets: 12804ex [01:05, 292.43ex/s] preprocess datasets: 12834ex [01:05, 282.24ex/s] preprocess datasets: 12863ex [01:05, 282.06ex/s] preprocess datasets: 12892ex [01:05, 283.27ex/s] preprocess datasets: 12924ex [01:05, 292.32ex/s] preprocess datasets: 12954ex [01:05, 286.20ex/s] preprocess datasets: 12984ex [01:05, 288.39ex/s] preprocess datasets: 13013ex [01:07, 45.72ex/s] preprocess datasets: 13044ex [01:07, 61.96ex/s] preprocess datasets: 13072ex [01:08, 79.55ex/s] preprocess datasets: 13098ex [01:08, 98.13ex/s] preprocess datasets: 13128ex [01:08, 123.85ex/s] preprocess datasets: 13155ex [01:08, 146.15ex/s] preprocess datasets: 13182ex [01:08, 166.63ex/s] preprocess datasets: 13209ex [01:08, 176.75ex/s] preprocess datasets: 13235ex [01:08, 193.22ex/s] preprocess datasets: 13265ex [01:08, 215.91ex/s] preprocess datasets: 13295ex [01:08, 235.54ex/s] preprocess datasets: 13325ex [01:08, 251.21ex/s] preprocess datasets: 13354ex [01:09, 260.84ex/s] preprocess datasets: 13383ex [01:09, 266.40ex/s] preprocess datasets: 13414ex [01:09, 277.64ex/s] preprocess datasets: 13443ex [01:09, 279.48ex/s] preprocess datasets: 13473ex [01:09, 284.40ex/s] preprocess datasets: 13502ex [01:09, 282.08ex/s] preprocess datasets: 13531ex [01:09, 278.02ex/s] preprocess datasets: 13560ex [01:09, 274.56ex/s] preprocess datasets: 13588ex [01:09, 272.83ex/s] preprocess datasets: 13616ex [01:10, 273.54ex/s] preprocess datasets: 13644ex [01:10, 273.06ex/s] preprocess datasets: 13673ex [01:10, 278.00ex/s] preprocess datasets: 13703ex [01:10, 282.71ex/s] preprocess datasets: 13734ex [01:10, 290.54ex/s] preprocess datasets: 13765ex [01:10, 295.71ex/s] preprocess datasets: 13796ex [01:10, 299.17ex/s] preprocess datasets: 13826ex [01:10, 292.47ex/s] preprocess datasets: 13860ex [01:10, 304.65ex/s] preprocess datasets: 13893ex [01:10, 310.45ex/s] preprocess datasets: 13925ex [01:11, 312.19ex/s] preprocess datasets: 13958ex [01:11, 317.28ex/s] preprocess datasets: 13991ex [01:11, 320.19ex/s] preprocess datasets: 14024ex [01:13, 49.64ex/s] preprocess datasets: 14051ex [01:13, 63.02ex/s] preprocess datasets: 14082ex [01:13, 82.78ex/s] preprocess datasets: 14112ex [01:13, 105.07ex/s] preprocess datasets: 14141ex [01:13, 128.49ex/s] preprocess datasets: 14170ex [01:13, 153.32ex/s] preprocess datasets: 14201ex [01:13, 180.99ex/s] preprocess datasets: 14233ex [01:13, 209.20ex/s] preprocess datasets: 14264ex [01:14, 230.81ex/s] preprocess datasets: 14300ex [01:14, 260.30ex/s] preprocess datasets: 14332ex [01:14, 272.46ex/s] preprocess datasets: 14364ex [01:14, 277.77ex/s] preprocess datasets: 14396ex [01:14, 288.54ex/s] preprocess datasets: 14427ex [01:14, 292.23ex/s] preprocess datasets: 14458ex [01:14, 285.99ex/s] preprocess datasets: 14488ex [01:14, 282.19ex/s] preprocess datasets: 14517ex [01:14, 279.45ex/s] preprocess datasets: 14546ex [01:14, 279.33ex/s] preprocess datasets: 14583ex [01:15, 303.29ex/s] preprocess datasets: 14619ex [01:15, 318.63ex/s] preprocess datasets: 14653ex [01:15, 323.43ex/s] preprocess datasets: 14686ex [01:15, 314.64ex/s] preprocess datasets: 14719ex [01:15, 317.41ex/s] preprocess datasets: 14753ex [01:15, 322.27ex/s] preprocess datasets: 14786ex [01:15, 317.82ex/s] preprocess datasets: 14818ex [01:15, 309.31ex/s] preprocess datasets: 14850ex [01:15, 305.63ex/s] preprocess datasets: 14882ex [01:16, 309.52ex/s] preprocess datasets: 14914ex [01:16, 311.02ex/s] preprocess datasets: 14948ex [01:16, 318.59ex/s] preprocess datasets: 14980ex [01:16, 316.26ex/s] preprocess datasets: 15012ex [01:18, 54.42ex/s] preprocess datasets: 15046ex [01:18, 73.47ex/s] preprocess datasets: 15074ex [01:18, 91.41ex/s] preprocess datasets: 15105ex [01:18, 115.38ex/s] preprocess datasets: 15138ex [01:18, 143.94ex/s] preprocess datasets: 15172ex [01:18, 175.53ex/s] preprocess datasets: 15203ex [01:18, 193.96ex/s] preprocess datasets: 15233ex [01:18, 206.67ex/s] preprocess datasets: 15261ex [01:18, 212.24ex/s] preprocess datasets: 15288ex [01:19, 167.23ex/s] preprocess datasets: 15313ex [01:19, 182.18ex/s] preprocess datasets: 15345ex [01:19, 211.26ex/s] preprocess datasets: 15379ex [01:19, 241.18ex/s] preprocess datasets: 15414ex [01:19, 266.29ex/s] preprocess datasets: 15445ex [01:19, 276.73ex/s] preprocess datasets: 15477ex [01:19, 287.02ex/s] preprocess datasets: 15509ex [01:19, 295.75ex/s] preprocess datasets: 15545ex [01:20, 312.73ex/s] preprocess datasets: 15582ex [01:20, 326.48ex/s] preprocess datasets: 15619ex [01:20, 338.60ex/s] preprocess datasets: 15654ex [01:20, 331.92ex/s] preprocess datasets: 15688ex [01:20, 318.62ex/s] preprocess datasets: 15721ex [01:20, 319.31ex/s] preprocess datasets: 15758ex [01:20, 331.85ex/s] preprocess datasets: 15792ex [01:20, 332.85ex/s] preprocess datasets: 15826ex [01:20, 324.52ex/s] preprocess datasets: 15859ex [01:20, 322.02ex/s] preprocess datasets: 15892ex [01:21, 315.15ex/s] preprocess datasets: 15924ex [01:21, 301.49ex/s] preprocess datasets: 15955ex [01:21, 295.13ex/s] preprocess datasets: 15985ex [01:21, 285.01ex/s] preprocess datasets: 16014ex [01:23, 49.16ex/s] preprocess datasets: 16040ex [01:23, 62.56ex/s] preprocess datasets: 16070ex [01:23, 82.10ex/s] preprocess datasets: 16097ex [01:23, 101.64ex/s] preprocess datasets: 16124ex [01:23, 123.20ex/s] preprocess datasets: 16151ex [01:23, 145.66ex/s] preprocess datasets: 16178ex [01:23, 167.61ex/s] preprocess datasets: 16204ex [01:23, 185.88ex/s] preprocess datasets: 16232ex [01:24, 206.35ex/s] preprocess datasets: 16259ex [01:24, 221.12ex/s] preprocess datasets: 16288ex [01:24, 238.53ex/s] preprocess datasets: 16316ex [01:24, 238.59ex/s] preprocess datasets: 16343ex [01:24, 245.05ex/s] preprocess datasets: 16373ex [01:24, 259.10ex/s] preprocess datasets: 16406ex [01:24, 276.47ex/s] preprocess datasets: 16437ex [01:24, 285.72ex/s] preprocess datasets: 16467ex [01:24, 282.74ex/s] preprocess datasets: 16497ex [01:25, 287.16ex/s] preprocess datasets: 16529ex [01:25, 296.02ex/s] preprocess datasets: 16560ex [01:25, 296.51ex/s] preprocess datasets: 16592ex [01:25, 302.86ex/s] preprocess datasets: 16623ex [01:25, 302.52ex/s] preprocess datasets: 16655ex [01:25, 306.74ex/s] preprocess datasets: 16686ex [01:25, 305.17ex/s] preprocess datasets: 16718ex [01:25, 309.10ex/s] preprocess datasets: 16749ex [01:25, 303.99ex/s] preprocess datasets: 16781ex [01:25, 306.58ex/s] preprocess datasets: 16813ex [01:26, 310.10ex/s] preprocess datasets: 16845ex [01:26, 302.58ex/s] preprocess datasets: 16876ex [01:26, 300.93ex/s] preprocess datasets: 16911ex [01:26, 315.14ex/s] preprocess datasets: 16943ex [01:26, 315.14ex/s] preprocess datasets: 16975ex [01:26, 292.29ex/s] preprocess datasets: 17005ex [01:28, 48.66ex/s] preprocess datasets: 17034ex [01:28, 63.59ex/s] preprocess datasets: 17064ex [01:28, 82.73ex/s] preprocess datasets: 17096ex [01:28, 107.20ex/s] preprocess datasets: 17126ex [01:28, 131.50ex/s] preprocess datasets: 17155ex [01:28, 155.68ex/s] preprocess datasets: 17186ex [01:29, 183.45ex/s] preprocess datasets: 17216ex [01:29, 206.34ex/s] preprocess datasets: 17249ex [01:29, 233.54ex/s] preprocess datasets: 17281ex [01:29, 253.45ex/s] preprocess datasets: 17312ex [01:29, 264.00ex/s] preprocess datasets: 17343ex [01:29, 275.30ex/s] preprocess datasets: 17375ex [01:29, 287.15ex/s] preprocess datasets: 17407ex [01:29, 294.31ex/s] preprocess datasets: 17440ex [01:29, 304.43ex/s] preprocess datasets: 17476ex [01:30, 320.29ex/s] preprocess datasets: 17512ex [01:30, 331.81ex/s] preprocess datasets: 17547ex [01:30, 334.78ex/s] preprocess datasets: 17581ex [01:30, 317.65ex/s] preprocess datasets: 17614ex [01:30, 297.17ex/s] preprocess datasets: 17645ex [01:30, 283.71ex/s] preprocess datasets: 17674ex [01:30, 272.41ex/s] preprocess datasets: 17702ex [01:30, 269.32ex/s] preprocess datasets: 17730ex [01:30, 265.58ex/s] preprocess datasets: 17759ex [01:31, 269.42ex/s] preprocess datasets: 17788ex [01:31, 275.09ex/s] preprocess datasets: 17816ex [01:31, 275.23ex/s] preprocess datasets: 17847ex [01:31, 284.55ex/s] preprocess datasets: 17877ex [01:31, 288.18ex/s] preprocess datasets: 17910ex [01:31, 298.60ex/s] preprocess datasets: 17942ex [01:31, 303.31ex/s] preprocess datasets: 17975ex [01:31, 309.90ex/s] preprocess datasets: 18007ex [01:33, 51.68ex/s] preprocess datasets: 18033ex [01:33, 65.15ex/s] preprocess datasets: 18057ex [01:33, 79.89ex/s] preprocess datasets: 18082ex [01:33, 98.00ex/s] preprocess datasets: 18109ex [01:33, 120.19ex/s] preprocess datasets: 18139ex [01:34, 147.70ex/s] preprocess datasets: 18165ex [01:34, 166.85ex/s] preprocess datasets: 18191ex [01:34, 184.93ex/s] preprocess datasets: 18218ex [01:34, 202.36ex/s] preprocess datasets: 18245ex [01:34, 217.13ex/s] preprocess datasets: 18281ex [01:34, 253.49ex/s] preprocess datasets: 18324ex [01:34, 300.72ex/s] preprocess datasets: 18359ex [01:34, 312.48ex/s] preprocess datasets: 18394ex [01:34, 320.36ex/s] preprocess datasets: 18428ex [01:34, 318.83ex/s] preprocess datasets: 18461ex [01:35, 298.73ex/s] preprocess datasets: 18492ex [01:35, 293.26ex/s] preprocess datasets: 18522ex [01:35, 278.66ex/s] preprocess datasets: 18552ex [01:35, 281.59ex/s] preprocess datasets: 18581ex [01:35, 276.73ex/s] preprocess datasets: 18609ex [01:35, 270.26ex/s] preprocess datasets: 18637ex [01:35, 265.17ex/s] preprocess datasets: 18664ex [01:35, 256.66ex/s] preprocess datasets: 18692ex [01:35, 261.69ex/s] preprocess datasets: 18719ex [01:36, 260.40ex/s] preprocess datasets: 18746ex [01:36, 261.57ex/s] preprocess datasets: 18773ex [01:36, 257.82ex/s] preprocess datasets: 18799ex [01:36, 254.85ex/s] preprocess datasets: 18828ex [01:36, 260.96ex/s] preprocess datasets: 18855ex [01:36, 260.98ex/s] preprocess datasets: 18883ex [01:36, 265.77ex/s] preprocess datasets: 18910ex [01:36, 256.27ex/s] preprocess datasets: 18937ex [01:36, 259.33ex/s] preprocess datasets: 18964ex [01:37, 261.09ex/s] preprocess datasets: 18993ex [01:37, 268.40ex/s] preprocess datasets: 19020ex [01:39, 41.16ex/s] preprocess datasets: 19050ex [01:39, 56.70ex/s] preprocess datasets: 19080ex [01:39, 75.93ex/s] preprocess datasets: 19111ex [01:39, 99.54ex/s] preprocess datasets: 19141ex [01:39, 124.67ex/s] preprocess datasets: 19174ex [01:39, 155.81ex/s] preprocess datasets: 19204ex [01:39, 180.80ex/s] preprocess datasets: 19234ex [01:39, 201.48ex/s] preprocess datasets: 19264ex [01:39, 222.44ex/s] preprocess datasets: 19295ex [01:40, 242.07ex/s] preprocess datasets: 19327ex [01:40, 259.34ex/s] preprocess datasets: 19357ex [01:40, 255.26ex/s] preprocess datasets: 19387ex [01:40, 266.17ex/s] preprocess datasets: 19416ex [01:40, 261.21ex/s] preprocess datasets: 19449ex [01:40, 279.18ex/s] preprocess datasets: 19484ex [01:40, 296.64ex/s] preprocess datasets: 19515ex [01:40, 275.35ex/s] preprocess datasets: 19546ex [01:40, 284.52ex/s] preprocess datasets: 19576ex [01:41, 287.28ex/s] preprocess datasets: 19610ex [01:41, 299.60ex/s] preprocess datasets: 19644ex [01:41, 310.30ex/s] preprocess datasets: 19676ex [01:41, 310.03ex/s] preprocess datasets: 19708ex [01:41, 304.07ex/s] preprocess datasets: 19739ex [01:41, 301.14ex/s] preprocess datasets: 19770ex [01:41, 297.09ex/s] preprocess datasets: 19800ex [01:41, 279.97ex/s] preprocess datasets: 19831ex [01:41, 288.19ex/s] preprocess datasets: 19861ex [01:41, 286.77ex/s] preprocess datasets: 19890ex [01:42, 286.92ex/s] preprocess datasets: 19920ex [01:42, 290.31ex/s] preprocess datasets: 19951ex [01:42, 293.92ex/s] preprocess datasets: 19981ex [01:42, 295.64ex/s] preprocess datasets: 20011ex [01:44, 47.70ex/s] preprocess datasets: 20041ex [01:44, 63.51ex/s] preprocess datasets: 20072ex [01:44, 83.87ex/s] preprocess datasets: 20102ex [01:44, 106.38ex/s] preprocess datasets: 20134ex [01:44, 133.89ex/s] preprocess datasets: 20165ex [01:44, 161.23ex/s] preprocess datasets: 20195ex [01:44, 185.99ex/s] preprocess datasets: 20227ex [01:44, 212.29ex/s] preprocess datasets: 20257ex [01:45, 231.20ex/s] preprocess datasets: 20287ex [01:45, 244.32ex/s] preprocess datasets: 20318ex [01:45, 261.04ex/s] preprocess datasets: 20349ex [01:45, 271.94ex/s] preprocess datasets: 20379ex [01:45, 279.48ex/s] preprocess datasets: 20409ex [01:45, 284.95ex/s] preprocess datasets: 20439ex [01:45, 288.62ex/s] preprocess datasets: 20469ex [01:45, 288.42ex/s] preprocess datasets: 20500ex [01:45, 291.90ex/s] preprocess datasets: 20531ex [01:46, 296.08ex/s] preprocess datasets: 20564ex [01:46, 304.48ex/s] preprocess datasets: 20595ex [01:46, 305.94ex/s] preprocess datasets: 20629ex [01:46, 312.52ex/s] preprocess datasets: 20662ex [01:46, 317.04ex/s] preprocess datasets: 20694ex [01:46, 309.67ex/s] preprocess datasets: 20727ex [01:46, 315.17ex/s] preprocess datasets: 20761ex [01:46, 319.17ex/s] preprocess datasets: 20796ex [01:46, 325.56ex/s] preprocess datasets: 20829ex [01:46, 320.66ex/s] preprocess datasets: 20862ex [01:47, 315.76ex/s] preprocess datasets: 20896ex [01:47, 321.95ex/s] preprocess datasets: 20929ex [01:47, 322.03ex/s] preprocess datasets: 20962ex [01:47, 318.80ex/s] preprocess datasets: 20994ex [01:47, 318.04ex/s] preprocess datasets: 21026ex [01:49, 53.44ex/s] preprocess datasets: 21060ex [01:49, 72.13ex/s] preprocess datasets: 21092ex [01:49, 93.17ex/s] preprocess datasets: 21125ex [01:49, 118.92ex/s] preprocess datasets: 21156ex [01:49, 143.87ex/s] preprocess datasets: 21187ex [01:49, 169.80ex/s] preprocess datasets: 21218ex [01:49, 194.78ex/s] preprocess datasets: 21248ex [01:49, 215.16ex/s] preprocess datasets: 21278ex [01:50, 231.15ex/s] preprocess datasets: 21308ex [01:50, 242.31ex/s] preprocess datasets: 21337ex [01:50, 253.36ex/s] preprocess datasets: 21366ex [01:50, 258.00ex/s] preprocess datasets: 21395ex [01:50, 265.98ex/s] preprocess datasets: 21426ex [01:50, 276.44ex/s] preprocess datasets: 21458ex [01:50, 285.19ex/s] preprocess datasets: 21488ex [01:50, 285.75ex/s] preprocess datasets: 21519ex [01:50, 290.83ex/s] preprocess datasets: 21554ex [01:51, 305.68ex/s] preprocess datasets: 21586ex [01:51, 307.38ex/s] preprocess datasets: 21617ex [01:51, 306.34ex/s] preprocess datasets: 21648ex [01:51, 281.49ex/s] preprocess datasets: 21679ex [01:51, 288.23ex/s] preprocess datasets: 21709ex [01:51, 285.05ex/s] preprocess datasets: 21741ex [01:51, 293.75ex/s] preprocess datasets: 21773ex [01:51, 300.94ex/s] preprocess datasets: 21805ex [01:51, 304.94ex/s] preprocess datasets: 21836ex [01:51, 301.58ex/s] preprocess datasets: 21869ex [01:52, 307.54ex/s] preprocess datasets: 21900ex [01:52, 307.65ex/s] preprocess datasets: 21932ex [01:52, 309.77ex/s] preprocess datasets: 21964ex [01:52, 308.80ex/s] preprocess datasets: 21997ex [01:52, 313.99ex/s] preprocess datasets: 22029ex [01:54, 51.76ex/s] preprocess datasets: 22059ex [01:54, 67.67ex/s] preprocess datasets: 22092ex [01:54, 89.71ex/s] preprocess datasets: 22126ex [01:54, 116.28ex/s] preprocess datasets: 22156ex [01:54, 140.21ex/s] preprocess datasets: 22185ex [01:54, 164.02ex/s] preprocess datasets: 22214ex [01:54, 186.88ex/s] preprocess datasets: 22243ex [01:55, 205.15ex/s] preprocess datasets: 22263ex [01:55, 193.45ex/s] | |
| preprocess datasets: 0ex [00:00, ?ex/s] preprocess datasets: 16ex [00:00, 157.36ex/s] preprocess datasets: 46ex [00:00, 233.76ex/s] preprocess datasets: 76ex [00:00, 260.10ex/s] preprocess datasets: 102ex [00:00, 259.55ex/s] preprocess datasets: 128ex [00:00, 255.09ex/s] preprocess datasets: 159ex [00:00, 273.13ex/s] preprocess datasets: 187ex [00:00, 266.33ex/s] preprocess datasets: 214ex [00:00, 259.11ex/s] preprocess datasets: 242ex [00:00, 263.55ex/s] preprocess datasets: 272ex [00:01, 272.98ex/s] preprocess datasets: 301ex [00:01, 274.92ex/s] preprocess datasets: 329ex [00:01, 269.00ex/s] preprocess datasets: 357ex [00:01, 269.94ex/s] preprocess datasets: 388ex [00:01, 280.09ex/s] preprocess datasets: 418ex [00:01, 283.82ex/s] preprocess datasets: 447ex [00:01, 280.42ex/s] preprocess datasets: 457ex [00:01, 267.52ex/s] | |
| 0%| | 0/23 [00:00<?, ?ba/s] 100%|██████████| 23/23 [00:00<00:00, 796.50ba/s] | |
| 0%| | 0/1 [00:00<?, ?ba/s] 100%|██████████| 1/1 [00:00<00:00, 743.01ba/s] | |
| Configuration saved in ./preprocessor_config.json | |
| tokenizer config file saved in ./tokenizer_config.json | |
| Special tokens file saved in ./special_tokens_map.json | |
| added tokens file saved in ./added_tokens.json | |
| Configuration saved in ./config.json | |
| loading feature extractor configuration file ./preprocessor_config.json | |
| loading configuration file ./config.json | |
| Model config Wav2Vec2Config { | |
| "_name_or_path": "./", | |
| "activation_dropout": 0.1, | |
| "adapter_kernel_size": 3, | |
| "adapter_stride": 2, | |
| "add_adapter": false, | |
| "apply_spec_augment": true, | |
| "architectures": [ | |
| "Wav2Vec2ForPreTraining" | |
| ], | |
| "attention_dropout": 0.0, | |
| "bos_token_id": 1, | |
| "classifier_proj_size": 256, | |
| "codevector_dim": 768, | |
| "contrastive_logits_temperature": 0.1, | |
| "conv_bias": true, | |
| "conv_dim": [ | |
| 512, | |
| 512, | |
| 512, | |
| 512, | |
| 512, | |
| 512, | |
| 512 | |
| ], | |
| "conv_kernel": [ | |
| 10, | |
| 3, | |
| 3, | |
| 3, | |
| 3, | |
| 2, | |
| 2 | |
| ], | |
| "conv_stride": [ | |
| 5, | |
| 2, | |
| 2, | |
| 2, | |
| 2, | |
| 2, | |
| 2 | |
| ], | |
| "ctc_loss_reduction": "mean", | |
| "ctc_zero_infinity": false, | |
| "diversity_loss_weight": 0.1, | |
| "do_stable_layer_norm": true, | |
| "eos_token_id": 2, | |
| "feat_extract_activation": "gelu", | |
| "feat_extract_dropout": 0.0, | |
| "feat_extract_norm": "layer", | |
| "feat_proj_dropout": 0.0, | |
| "feat_quantizer_dropout": 0.0, | |
| "final_dropout": 0.0, | |
| "hidden_act": "gelu", | |
| "hidden_dropout": 0.0, | |
| "hidden_size": 1024, | |
| "initializer_range": 0.02, | |
| "intermediate_size": 4096, | |
| "layer_norm_eps": 1e-05, | |
| "layerdrop": 0.0, | |
| "mask_feature_length": 64, | |
| "mask_feature_min_masks": 0, | |
| "mask_feature_prob": 0.25, | |
| "mask_time_length": 10, | |
| "mask_time_min_masks": 2, | |
| "mask_time_prob": 0.75, | |
| "model_type": "wav2vec2", | |
| "num_adapter_layers": 3, | |
| "num_attention_heads": 16, | |
| "num_codevector_groups": 2, | |
| "num_codevectors_per_group": 320, | |
| "num_conv_pos_embedding_groups": 16, | |
| "num_conv_pos_embeddings": 128, | |
| "num_feat_extract_layers": 7, | |
| "num_hidden_layers": 24, | |
| "num_negatives": 100, | |
| "output_hidden_size": 1024, | |
| "pad_token_id": 1204, | |
| "proj_codevector_dim": 768, | |
| "tdnn_dilation": [ | |
| 1, | |
| 2, | |
| 3, | |
| 1, | |
| 1 | |
| ], | |
| "tdnn_dim": [ | |
| 512, | |
| 512, | |
| 512, | |
| 512, | |
| 1500 | |
| ], | |
| "tdnn_kernel": [ | |
| 5, | |
| 3, | |
| 3, | |
| 1, | |
| 1 | |
| ], | |
| "torch_dtype": "float32", | |
| "transformers_version": "4.17.0.dev0", | |
| "use_weighted_layer_sum": false, | |
| "vocab_size": 1207, | |
| "xvector_output_dim": 512 | |
| } | |
| loading feature extractor configuration file ./preprocessor_config.json | |
| Feature extractor Wav2Vec2FeatureExtractor { | |
| "do_normalize": true, | |
| "feature_extractor_type": "Wav2Vec2FeatureExtractor", | |
| "feature_size": 1, | |
| "padding_side": "right", | |
| "padding_value": 0, | |
| "return_attention_mask": true, | |
| "sampling_rate": 16000 | |
| } | |
| Didn't find file ./tokenizer.json. We won't load it. | |
| loading file ./vocab.json | |
| loading file ./tokenizer_config.json | |
| loading file ./added_tokens.json | |
| loading file ./special_tokens_map.json | |
| loading file None | |
| Adding <s> to the vocabulary | |
| Adding </s> to the vocabulary | |
| /workspace/wav2vec2-xls-r-300m-korean/./ is already a clone of https://huggingface.co/w11wo/wav2vec2-xls-r-300m-korean. Make sure you pull the latest changes with `repo.git_pull()`. | |
| 01/31/2022 07:18:18 - WARNING - huggingface_hub.repository - /workspace/wav2vec2-xls-r-300m-korean/./ is already a clone of https://huggingface.co/w11wo/wav2vec2-xls-r-300m-korean. Make sure you pull the latest changes with `repo.git_pull()`. | |
| Using amp half precision backend | |
| The following columns in the training set don't have a corresponding argument in `Wav2Vec2ForCTC.forward` and have been ignored: input_length. | |
| /opt/conda/lib/python3.8/site-packages/transformers/optimization.py:306: FutureWarning: This implementation of AdamW is deprecated and will be removed in a future version. Use thePyTorch implementation torch.optim.AdamW instead, or set `no_deprecation_warning=True` to disable this warning | |
| warnings.warn( | |
| ***** Running training ***** | |
| Num examples = 22262 | |
| Num Epochs = 50 | |
| Instantaneous batch size per device = 8 | |
| Total train batch size (w. parallel, distributed & accumulation) = 32 | |
| Gradient Accumulation steps = 4 | |
| Total optimization steps = 34750 | |
| 0%| | 0/34750 [00:00<?, ?it/s] 0%| | 1/34750 [00:06<64:28:32, 6.68s/it] 0%| | 2/34750 [00:12<57:43:53, 5.98s/it] 0%| | 3/34750 [00:17<54:31:03, 5.65s/it] 0%| | 4/34750 [00:22<50:51:50, 5.27s/it] 0%| | 5/34750 [00:26<48:33:10, 5.03s/it] 0%| | 6/34750 [00:31<46:50:38, 4.85s/it] 0%| | 7/34750 [00:35<45:36:23, 4.73s/it] 0%| | 8/34750 [00:40<44:29:00, 4.61s/it] 0%| | 9/34750 [00:44<43:10:17, 4.47s/it] 0%| | 10/34750 [00:48<42:06:37, 4.36s/it] 0%| | 11/34750 [00:52<40:57:19, 4.24s/it] 0%| | 12/34750 [00:56<39:38:33, 4.11s/it] 0%| | 13/34750 [00:59<38:31:48, 3.99s/it] 0%| | 14/34750 [01:03<37:54:45, 3.93s/it] 0%| | 15/34750 [01:07<36:35:46, 3.79s/it] 0%| | 16/34750 [01:10<35:45:25, 3.71s/it] 0%| | 17/34750 [01:13<34:45:16, 3.60s/it] 0%| | 18/34750 [01:17<33:59:39, 3.52s/it] 0%| | 19/34750 [01:20<33:05:56, 3.43s/it] 0%| | 20/34750 [01:23<32:33:40, 3.38s/it] 0%| | 21/34750 [01:26<32:01:32, 3.32s/it] 0%| | 22/34750 [01:30<31:21:02, 3.25s/it] 0%| | 23/34750 [01:33<30:52:11, 3.20s/it] 0%| | 24/34750 [01:36<30:24:22, 3.15s/it] 0%| | 25/34750 [01:39<29:53:04, 3.10s/it] 0%| | 26/34750 [01:42<29:25:40, 3.05s/it] 0%| | 27/34750 [01:44<28:34:56, 2.96s/it] 0%| | 28/34750 [01:47<28:11:40, 2.92s/it] 0%| | 29/34750 [01:50<27:54:42, 2.89s/it] 0%| | 30/34750 [01:53<27:27:22, 2.85s/it] 0%| | 31/34750 [01:55<27:01:28, 2.80s/it] 0%| | 32/34750 [01:58<26:40:58, 2.77s/it] 0%| | 33/34750 [02:01<26:24:14, 2.74s/it] 0%| | 34/34750 [02:03<25:52:04, 2.68s/it] 0%| | 35/34750 [02:06<25:43:25, 2.67s/it] 0%| | 36/34750 [02:08<25:11:08, 2.61s/it] 0%| | 37/34750 [02:11<24:28:28, 2.54s/it] 0%| | 38/34750 [02:13<23:51:25, 2.47s/it] 0%| | 39/34750 [02:15<23:19:33, 2.42s/it] 0%| | 40/34750 [02:18<22:52:11, 2.37s/it] 0%| | 41/34750 [02:20<22:39:10, 2.35s/it] 0%| | 42/34750 [02:22<22:09:25, 2.30s/it] 0%| | 43/34750 [02:24<21:47:00, 2.26s/it] 0%| | 44/34750 [02:26<21:18:01, 2.21s/it] 0%| | 45/34750 [02:28<20:48:32, 2.16s/it] 0%| | 46/34750 [02:31<20:29:08, 2.13s/it] 0%| | 47/34750 [02:32<20:01:46, 2.08s/it] 0%| | 48/34750 [02:34<19:24:47, 2.01s/it] 0%| | 49/34750 [02:36<18:42:30, 1.94s/it] 0%| | 50/34750 [02:38<17:57:24, 1.86s/it] 0%| | 51/34750 [02:44<31:34:21, 3.28s/it] 0%| | 52/34750 [02:50<38:06:08, 3.95s/it] 0%| | 53/34750 [02:55<41:11:56, 4.27s/it] 0%| | 54/34750 [03:00<42:58:47, 4.46s/it] 0%| | 55/34750 [03:04<43:32:12, 4.52s/it] 0%| | 56/34750 [03:09<43:38:21, 4.53s/it] 0%| | 57/34750 [03:13<43:18:06, 4.49s/it] 0%| | 58/34750 [03:18<42:30:15, 4.41s/it] 0%| | 59/34750 [03:22<42:02:18, 4.36s/it] 0%| | 60/34750 [03:26<41:31:48, 4.31s/it] 0%| | 61/34750 [03:30<40:32:29, 4.21s/it] 0%| | 62/34750 [03:34<39:22:08, 4.09s/it] 0%| | 63/34750 [03:38<38:18:34, 3.98s/it] 0%| | 64/34750 [03:41<37:37:25, 3.90s/it] 0%| | 65/34750 [03:45<36:45:09, 3.81s/it] 0%| | 66/34750 [03:48<35:44:42, 3.71s/it] 0%| | 67/34750 [03:52<35:21:38, 3.67s/it] 0%| | 68/34750 [03:55<34:38:18, 3.60s/it] 0%| | 69/34750 [03:59<33:35:03, 3.49s/it] 0%| | 70/34750 [04:02<32:57:42, 3.42s/it] 0%| | 71/34750 [04:05<32:30:58, 3.38s/it] 0%| | 72/34750 [04:08<31:58:21, 3.32s/it] 0%| | 73/34750 [04:12<31:39:22, 3.29s/it] 0%| | 74/34750 [04:15<30:59:41, 3.22s/it] 0%| | 75/34750 [04:18<30:22:31, 3.15s/it] 0%| | 76/34750 [04:21<30:16:16, 3.14s/it] 0%| | 77/34750 [04:24<30:00:28, 3.12s/it] 0%| | 78/34750 [04:27<29:35:28, 3.07s/it] 0%| | 79/34750 [04:30<28:52:03, 3.00s/it] 0%| | 80/34750 [04:32<28:15:57, 2.94s/it] 0%| | 81/34750 [04:35<27:39:57, 2.87s/it] 0%| | 82/34750 [04:38<27:02:17, 2.81s/it] 0%| | 83/34750 [04:40<26:42:09, 2.77s/it] 0%| | 84/34750 [04:43<26:15:39, 2.73s/it] 0%| | 85/34750 [04:46<26:03:43, 2.71s/it] 0%| | 86/34750 [04:48<25:34:47, 2.66s/it] 0%| | 87/34750 [04:51<25:14:44, 2.62s/it] 0%| | 88/34750 [04:53<24:52:15, 2.58s/it] 0%| | 89/34750 [04:56<24:13:33, 2.52s/it] 0%| | 90/34750 [04:58<23:45:50, 2.47s/it] 0%| | 91/34750 [05:00<23:15:35, 2.42s/it] 0%| | 92/34750 [05:03<22:43:29, 2.36s/it] 0%| | 93/34750 [05:05<22:28:51, 2.34s/it] 0%| | 94/34750 [05:07<21:54:02, 2.28s/it] 0%| | 95/34750 [05:09<21:18:57, 2.21s/it] 0%| | 96/34750 [05:11<20:44:18, 2.15s/it] 0%| | 97/34750 [05:13<20:04:09, 2.08s/it] 0%| | 98/34750 [05:15<19:41:42, 2.05s/it] 0%| | 99/34750 [05:17<19:05:17, 1.98s/it] 0%| | 100/34750 [05:18<18:21:38, 1.91s/it] 0%| | 100/34750 [05:18<18:21:38, 1.91s/it] 0%| | 101/34750 [05:25<31:59:06, 3.32s/it] 0%| | 102/34750 [05:31<38:44:13, 4.02s/it] 0%| | 103/34750 [05:36<42:04:31, 4.37s/it] 0%| | 104/34750 [05:41<43:20:27, 4.50s/it] 0%| | 105/34750 [05:45<43:33:06, 4.53s/it] 0%| | 106/34750 [05:50<43:01:31, 4.47s/it] 0%| | 107/34750 [05:54<42:35:58, 4.43s/it] 0%| | 108/34750 [05:58<41:36:32, 4.32s/it] 0%| | 109/34750 [06:02<40:49:12, 4.24s/it] 0%| | 110/34750 [06:06<40:24:00, 4.20s/it] 0%| | 111/34750 [06:10<39:21:11, 4.09s/it] 0%| | 112/34750 [06:14<38:20:20, 3.98s/it] 0%| | 113/34750 [06:18<37:45:38, 3.92s/it] 0%| | 114/34750 [06:21<36:57:18, 3.84s/it] 0%| | 115/34750 [06:25<36:23:40, 3.78s/it] 0%| | 116/34750 [06:28<35:34:12, 3.70s/it] 0%| | 117/34750 [06:32<34:43:35, 3.61s/it] 0%| | 118/34750 [06:35<33:56:27, 3.53s/it] 0%| | 119/34750 [06:38<33:21:27, 3.47s/it] 0%| | 120/34750 [06:42<32:59:05, 3.43s/it] 0%| | 121/34750 [06:45<32:17:52, 3.36s/it] 0%| | 122/34750 [06:48<31:38:10, 3.29s/it] 0%| | 123/34750 [06:51<31:05:15, 3.23s/it] 0%| | 124/34750 [06:54<30:46:22, 3.20s/it] 0%| | 125/34750 [06:57<30:10:54, 3.14s/it] 0%| | 126/34750 [07:00<29:41:42, 3.09s/it] 0%| | 127/34750 [07:03<29:03:34, 3.02s/it] 0%| | 128/34750 [07:06<28:35:44, 2.97s/it] 0%| | 129/34750 [07:09<28:00:19, 2.91s/it] 0%| | 130/34750 [07:12<27:21:27, 2.84s/it] 0%| | 131/34750 [07:14<27:10:16, 2.83s/it] 0%| | 132/34750 [07:17<26:33:47, 2.76s/it] 0%| | 133/34750 [07:20<26:14:29, 2.73s/it] 0%| | 134/34750 [07:22<25:45:14, 2.68s/it] 0%| | 135/34750 [07:25<25:17:13, 2.63s/it] 0%| | 136/34750 [07:27<24:57:13, 2.60s/it] 0%| | 137/34750 [07:30<24:24:51, 2.54s/it] 0%| | 138/34750 [07:32<23:51:55, 2.48s/it] 0%| | 139/34750 [07:34<23:21:09, 2.43s/it] 0%| | 140/34750 [07:36<22:52:59, 2.38s/it] 0%| | 141/34750 [07:39<22:43:48, 2.36s/it] 0%| | 142/34750 [07:41<22:20:24, 2.32s/it] 0%| | 143/34750 [07:43<22:04:04, 2.30s/it] 0%| | 144/34750 [07:45<21:37:56, 2.25s/it] 0%| | 145/34750 [07:47<21:03:48, 2.19s/it] 0%| | 146/34750 [07:50<20:40:12, 2.15s/it] 0%| | 147/34750 [07:51<20:03:46, 2.09s/it] 0%| | 148/34750 [07:53<19:25:14, 2.02s/it] 0%| | 149/34750 [07:55<18:55:40, 1.97s/it] 0%| | 150/34750 [07:57<18:20:39, 1.91s/it] 0%| | 151/34750 [08:03<31:24:03, 3.27s/it] 0%| | 152/34750 [08:09<37:53:01, 3.94s/it] 0%| | 153/34750 [08:14<41:53:08, 4.36s/it] 0%| | 154/34750 [08:19<43:48:48, 4.56s/it] 0%| | 155/34750 [08:24<43:58:26, 4.58s/it] 0%| | 156/34750 [08:28<43:45:25, 4.55s/it] 0%| | 157/34750 [08:33<43:43:02, 4.55s/it] 0%| | 158/34750 [08:37<42:58:24, 4.47s/it] 0%| | 159/34750 [08:41<41:59:46, 4.37s/it] 0%| | 160/34750 [08:45<40:59:58, 4.27s/it] 0%| | 161/34750 [08:49<40:07:34, 4.18s/it] 0%| | 162/34750 [08:53<39:31:01, 4.11s/it] 0%| | 163/34750 [08:57<38:50:29, 4.04s/it] 0%| | 164/34750 [09:01<38:04:36, 3.96s/it] 0%| | 165/34750 [09:05<37:16:49, 3.88s/it] 0%| | 166/34750 [09:08<36:26:52, 3.79s/it] 0%| | 167/34750 [09:12<35:48:44, 3.73s/it] 0%| | 168/34750 [09:15<35:16:30, 3.67s/it] 0%| | 169/34750 [09:19<34:42:11, 3.61s/it] 0%| | 170/34750 [09:22<33:58:16, 3.54s/it] 0%| | 171/34750 [09:25<33:07:26, 3.45s/it] 0%| | 172/34750 [09:29<32:20:46, 3.37s/it] 0%| | 173/34750 [09:32<31:43:56, 3.30s/it] 1%| | 174/34750 [09:35<31:16:09, 3.26s/it] 1%| | 175/34750 [09:38<31:01:53, 3.23s/it] 1%| | 176/34750 [09:41<30:33:05, 3.18s/it] 1%| | 177/34750 [09:44<30:02:14, 3.13s/it] 1%| | 178/34750 [09:47<29:31:44, 3.07s/it] 1%| | 179/34750 [09:50<28:51:20, 3.00s/it] 1%| | 180/34750 [09:53<28:07:59, 2.93s/it] 1%| | 181/34750 [09:55<27:42:48, 2.89s/it] 1%| | 182/34750 [09:58<27:05:20, 2.82s/it] 1%| | 183/34750 [10:01<26:42:02, 2.78s/it] 1%| | 184/34750 [10:03<26:09:40, 2.72s/it] 1%| | 185/34750 [10:06<25:42:04, 2.68s/it] 1%| | 186/34750 [10:08<25:13:14, 2.63s/it] 1%| | 187/34750 [10:11<24:58:54, 2.60s/it] 1%| | 188/34750 [10:13<24:31:39, 2.55s/it] 1%| | 189/34750 [10:16<23:54:11, 2.49s/it] 1%| | 190/34750 [10:18<23:19:20, 2.43s/it] 1%| | 191/34750 [10:20<22:53:19, 2.38s/it] 1%| | 192/34750 [10:23<22:30:07, 2.34s/it] 1%| | 193/34750 [10:25<21:58:47, 2.29s/it] 1%| | 194/34750 [10:27<21:25:10, 2.23s/it] 1%| | 195/34750 [10:29<20:52:07, 2.17s/it] 1%| | 196/34750 [10:31<20:21:29, 2.12s/it] 1%| | 197/34750 [10:33<19:45:12, 2.06s/it] 1%| | 198/34750 [10:35<19:10:57, 2.00s/it] 1%| | 199/34750 [10:36<18:35:35, 1.94s/it] 1%| | 200/34750 [10:38<17:58:57, 1.87s/it] 1%| | 200/34750 [10:38<17:58:57, 1.87s/it] 1%| | 201/34750 [10:44<30:29:43, 3.18s/it] 1%| | 202/34750 [10:50<36:43:22, 3.83s/it] 1%| | 203/34750 [10:55<40:17:17, 4.20s/it] 1%| | 204/34750 [11:00<41:57:33, 4.37s/it] 1%| | 205/34750 [11:04<42:29:54, 4.43s/it] 1%| | 206/34750 [11:09<42:44:42, 4.45s/it] 1%| | 207/34750 [11:13<41:56:02, 4.37s/it] 1%| | 208/34750 [11:17<41:20:03, 4.31s/it] 1%| | 209/34750 [11:21<40:36:04, 4.23s/it] 1%| | 210/34750 [11:25<40:15:07, 4.20s/it] 1%| | 211/34750 [11:29<39:13:51, 4.09s/it] 1%| | 212/34750 [11:33<38:18:15, 3.99s/it] 1%| | 213/34750 [11:37<37:31:08, 3.91s/it] 1%| | 214/34750 [11:40<36:50:20, 3.84s/it] 1%| | 215/34750 [11:44<36:03:03, 3.76s/it] 1%| | 216/34750 [11:47<35:19:22, 3.68s/it] 1%| | 217/34750 [11:51<34:49:41, 3.63s/it] 1%| | 218/34750 [11:54<33:58:09, 3.54s/it] 1%| | 219/34750 [11:57<33:17:16, 3.47s/it] 1%| | 220/34750 [12:01<32:42:24, 3.41s/it] 1%| | 221/34750 [12:04<32:12:04, 3.36s/it] 1%| | 222/34750 [12:07<31:21:23, 3.27s/it] 1%| | 223/34750 [12:10<30:51:33, 3.22s/it] 1%| | 224/34750 [12:13<30:13:54, 3.15s/it] 1%| | 225/34750 [12:16<29:45:11, 3.10s/it] 1%| | 226/34750 [12:19<29:23:35, 3.06s/it] 1%| | 227/34750 [12:22<28:42:32, 2.99s/it] 1%| | 228/34750 [12:25<28:22:04, 2.96s/it] 1%| | 229/34750 [12:28<27:48:51, 2.90s/it] 1%| | 230/34750 [12:30<27:11:50, 2.84s/it] 1%| | 231/34750 [12:33<26:35:09, 2.77s/it] 1%| | 232/34750 [12:35<26:10:51, 2.73s/it] 1%| | 233/34750 [12:38<25:52:41, 2.70s/it] 1%| | 234/34750 [12:41<25:20:57, 2.64s/it] 1%| | 235/34750 [12:43<24:56:17, 2.60s/it] 1%| | 236/34750 [12:45<24:12:05, 2.52s/it] 1%| | 237/34750 [12:48<23:36:45, 2.46s/it] 1%| | 238/34750 [12:50<23:15:05, 2.43s/it] 1%| | 239/34750 [12:52<22:55:05, 2.39s/it] 1%| | 240/34750 [12:55<22:24:01, 2.34s/it] 1%| | 241/34750 [12:57<22:06:03, 2.31s/it] 1%| | 242/34750 [12:59<21:38:36, 2.26s/it] 1%| | 243/34750 [13:01<21:15:14, 2.22s/it] 1%| | 244/34750 [13:03<20:47:51, 2.17s/it] 1%| | 245/34750 [13:05<20:23:43, 2.13s/it] 1%| | 246/34750 [13:07<20:17:09, 2.12s/it] 1%| | 247/34750 [13:09<19:45:30, 2.06s/it] 1%| | 248/34750 [13:11<19:07:56, 2.00s/it] 1%| | 249/34750 [13:13<18:36:53, 1.94s/it] 1%| | 250/34750 [13:15<17:51:35, 1.86s/it] 1%| | 251/34750 [13:21<31:21:56, 3.27s/it] 1%| | 252/34750 [13:27<37:56:29, 3.96s/it] 1%| | 253/34750 [13:32<41:27:01, 4.33s/it] 1%| | 254/34750 [13:37<43:20:41, 4.52s/it] 1%| | 255/34750 [13:42<43:46:29, 4.57s/it] 1%| | 256/34750 [13:46<44:07:24, 4.60s/it] 1%| | 257/34750 [13:51<43:48:40, 4.57s/it] 1%| | 258/34750 [13:55<42:57:47, 4.48s/it] 1%| | 259/34750 [13:59<42:16:34, 4.41s/it] 1%| | 260/34750 [14:03<41:36:00, 4.34s/it] 1%| | 261/34750 [14:07<40:22:55, 4.22s/it] 1%| | 262/34750 [14:11<39:34:28, 4.13s/it] 1%| | 263/34750 [14:15<38:38:45, 4.03s/it] 1%| | 264/34750 [14:19<37:37:21, 3.93s/it] 1%| | 265/34750 [14:23<37:05:51, 3.87s/it] 1%| | 266/34750 [14:26<36:12:42, 3.78s/it] 1%| | 267/34750 [14:30<35:15:32, 3.68s/it] 1%| | 268/34750 [14:33<34:42:08, 3.62s/it] 1%| | 269/34750 [14:36<34:05:26, 3.56s/it] 1%| | 270/34750 [14:40<33:17:54, 3.48s/it] 1%| | 271/34750 [14:43<32:24:37, 3.38s/it] 1%| | 272/34750 [14:46<31:57:35, 3.34s/it] 1%| | 273/34750 [14:49<31:33:17, 3.29s/it] 1%| | 274/34750 [14:52<31:13:36, 3.26s/it] 1%| | 275/34750 [14:56<30:33:40, 3.19s/it] 1%| | 276/34750 [14:58<29:57:52, 3.13s/it] 1%| | 277/34750 [15:01<29:24:24, 3.07s/it] 1%| | 278/34750 [15:04<28:49:51, 3.01s/it] 1%| | 279/34750 [15:07<28:08:27, 2.94s/it] 1%| | 280/34750 [15:10<27:22:33, 2.86s/it] 1%| | 281/34750 [15:12<26:57:28, 2.82s/it] 1%| | 282/34750 [15:15<26:27:44, 2.76s/it] 1%| | 283/34750 [15:18<26:13:36, 2.74s/it] 1%| | 284/34750 [15:21<26:13:15, 2.74s/it] 1%| | 285/34750 [15:23<25:57:40, 2.71s/it] 1%| | 286/34750 [15:26<25:28:50, 2.66s/it] 1%| | 287/34750 [15:28<25:04:44, 2.62s/it] 1%| | 288/34750 [15:31<24:26:40, 2.55s/it] 1%| | 289/34750 [15:33<23:41:08, 2.47s/it] 1%| | 290/34750 [15:35<23:22:38, 2.44s/it] 1%| | 291/34750 [15:38<22:57:12, 2.40s/it] 1%| | 292/34750 [15:40<22:17:49, 2.33s/it] 1%| | 293/34750 [15:42<21:41:20, 2.27s/it] 1%| | 294/34750 [15:44<21:08:58, 2.21s/it] 1%| | 295/34750 [15:46<20:50:26, 2.18s/it] 1%| | 296/34750 [15:48<20:32:20, 2.15s/it] 1%| | 297/34750 [15:50<19:59:15, 2.09s/it] 1%| | 298/34750 [15:52<19:26:06, 2.03s/it] 1%| | 299/34750 [15:54<18:49:19, 1.97s/it] 1%| | 300/34750 [15:56<18:10:12, 1.90s/it] 1%| | 300/34750 [15:56<18:10:12, 1.90s/it] 1%| | 301/34750 [16:02<31:58:03, 3.34s/it] 1%| | 302/34750 [16:08<37:55:08, 3.96s/it] 1%| | 303/34750 [16:13<41:36:50, 4.35s/it] 1%| | 304/34750 [16:18<43:17:31, 4.52s/it] 1%| | 305/34750 [16:23<43:51:54, 4.58s/it] 1%| | 306/34750 [16:27<43:56:28, 4.59s/it] 1%| | 307/34750 [16:32<43:43:04, 4.57s/it] 1%| | 308/34750 [16:36<42:48:58, 4.48s/it] 1%| | 309/34750 [16:40<42:16:02, 4.42s/it] 1%| | 310/34750 [16:44<41:16:33, 4.31s/it] 1%| | 311/34750 [16:48<40:43:30, 4.26s/it] 1%| | 312/34750 [16:52<39:52:16, 4.17s/it] 1%| | 313/34750 [16:56<38:22:24, 4.01s/it] 1%| | 314/34750 [17:00<37:28:22, 3.92s/it] 1%| | 315/34750 [17:03<36:46:54, 3.85s/it] 1%| | 316/34750 [17:07<35:58:05, 3.76s/it] 1%| | 317/34750 [17:10<35:05:57, 3.67s/it] 1%| | 318/34750 [17:14<34:07:17, 3.57s/it] 1%| | 319/34750 [17:17<33:31:36, 3.51s/it] 1%| | 320/34750 [17:20<32:47:49, 3.43s/it] 1%| | 321/34750 [17:24<32:01:42, 3.35s/it] 1%| | 322/34750 [17:27<31:36:22, 3.30s/it] 1%| | 323/34750 [17:30<31:07:44, 3.26s/it] 1%| | 324/34750 [17:33<30:53:20, 3.23s/it] 1%| | 325/34750 [17:36<30:26:15, 3.18s/it] 1%| | 326/34750 [17:39<29:47:46, 3.12s/it] 1%| | 327/34750 [17:42<29:12:55, 3.06s/it] 1%| | 328/34750 [17:45<28:47:06, 3.01s/it] 1%| | 329/34750 [17:48<28:08:18, 2.94s/it] 1%| | 330/34750 [17:50<27:36:09, 2.89s/it] 1%| | 331/34750 [17:53<27:21:46, 2.86s/it] 1%| | 332/34750 [17:56<27:03:08, 2.83s/it] 1%| | 333/34750 [17:59<26:20:26, 2.76s/it] 1%| | 334/34750 [18:01<26:12:57, 2.74s/it] 1%| | 335/34750 [18:04<25:41:28, 2.69s/it] 1%| | 336/34750 [18:06<25:12:54, 2.64s/it] 1%| | 337/34750 [18:09<24:41:53, 2.58s/it] 1%| | 338/34750 [18:11<24:12:43, 2.53s/it] 1%| | 339/34750 [18:14<23:30:50, 2.46s/it] 1%| | 340/34750 [18:16<22:57:39, 2.40s/it] 1%| | 341/34750 [18:18<22:20:00, 2.34s/it] 1%| | 342/34750 [18:20<22:25:17, 2.35s/it] 1%| | 343/34750 [18:23<22:01:56, 2.31s/it] 1%| | 344/34750 [18:25<21:44:05, 2.27s/it] 1%| | 345/34750 [18:27<21:18:47, 2.23s/it] 1%| | 346/34750 [18:29<20:40:52, 2.16s/it] 1%| | 347/34750 [18:31<20:05:18, 2.10s/it] 1%| | 348/34750 [18:33<19:18:53, 2.02s/it] 1%| | 349/34750 [18:34<18:30:11, 1.94s/it] 1%| | 350/34750 [18:36<17:49:48, 1.87s/it] 1%| | 351/34750 [18:43<30:43:41, 3.22s/it] 1%| | 352/34750 [18:48<36:25:36, 3.81s/it] 1%| | 353/34750 [18:53<40:38:35, 4.25s/it] 1%| | 354/34750 [18:58<42:21:14, 4.43s/it] 1%| | 355/34750 [19:03<43:07:44, 4.51s/it] 1%| | 356/34750 [19:07<42:26:41, 4.44s/it] 1%| | 357/34750 [19:11<41:53:53, 4.39s/it] 1%| | 358/34750 [19:15<40:39:51, 4.26s/it] 1%| | 359/34750 [19:19<40:16:11, 4.22s/it] 1%| | 360/34750 [19:23<39:41:45, 4.16s/it] 1%| | 361/34750 [19:27<38:47:40, 4.06s/it] 1%| | 362/34750 [19:31<38:03:09, 3.98s/it] 1%| | 363/34750 [19:35<37:17:42, 3.90s/it] 1%| | 364/34750 [19:38<36:50:26, 3.86s/it] 1%| | 365/34750 [19:42<36:07:43, 3.78s/it] 1%| | 366/34750 [19:45<35:02:58, 3.67s/it] 1%| | 367/34750 [19:49<34:07:02, 3.57s/it] 1%| | 368/34750 [19:52<33:13:38, 3.48s/it] 1%| | 369/34750 [19:55<32:49:53, 3.44s/it] 1%| | 370/34750 [19:58<32:19:00, 3.38s/it] 1%| | 371/34750 [20:02<31:58:00, 3.35s/it] 1%| | 372/34750 [20:05<31:12:15, 3.27s/it] 1%| | 373/34750 [20:08<30:34:34, 3.20s/it] 1%| | 374/34750 [20:11<30:28:31, 3.19s/it] 1%| | 375/34750 [20:14<29:47:15, 3.12s/it] 1%| | 376/34750 [20:17<29:13:07, 3.06s/it] 1%| | 377/34750 [20:20<28:44:15, 3.01s/it] 1%| | 378/34750 [20:23<28:26:34, 2.98s/it] 1%| | 379/34750 [20:26<27:56:33, 2.93s/it] 1%| | 380/34750 [20:28<27:25:39, 2.87s/it] 1%| | 381/34750 [20:31<26:59:30, 2.83s/it] 1%| | 382/34750 [20:34<26:29:51, 2.78s/it] 1%| | 383/34750 [20:36<25:56:46, 2.72s/it] 1%| | 384/34750 [20:39<25:35:53, 2.68s/it] 1%| | 385/34750 [20:41<25:02:32, 2.62s/it] 1%| | 386/34750 [20:44<24:39:09, 2.58s/it] 1%| | 387/34750 [20:46<24:21:30, 2.55s/it] 1%| | 388/34750 [20:49<23:38:31, 2.48s/it] 1%| | 389/34750 [20:51<23:10:07, 2.43s/it] 1%| | 390/34750 [20:53<22:38:55, 2.37s/it] 1%| | 391/34750 [20:55<22:09:02, 2.32s/it] 1%| | 392/34750 [20:58<21:49:26, 2.29s/it] 1%| | 393/34750 [21:00<21:26:35, 2.25s/it] 1%| | 394/34750 [21:02<21:03:47, 2.21s/it] 1%| | 395/34750 [21:04<20:38:57, 2.16s/it] 1%| | 396/34750 [21:06<20:07:32, 2.11s/it] 1%| | 397/34750 [21:08<19:41:03, 2.06s/it] 1%| | 398/34750 [21:10<19:14:02, 2.02s/it] 1%| | 399/34750 [21:12<18:36:22, 1.95s/it] 1%| | 400/34750 [21:13<17:49:36, 1.87s/it] 1%| | 400/34750 [21:13<17:49:36, 1.87s/it] 1%| | 401/34750 [21:20<31:30:35, 3.30s/it] 1%| | 402/34750 [21:26<38:21:07, 4.02s/it] 1%| | 403/34750 [21:31<41:14:36, 4.32s/it] 1%| | 404/34750 [21:35<42:39:12, 4.47s/it] 1%| | 405/34750 [21:40<43:39:49, 4.58s/it] 1%| | 406/34750 [21:45<44:18:50, 4.65s/it] 1%| | 407/34750 [21:49<43:34:28, 4.57s/it] 1%| | 408/34750 [21:54<42:43:07, 4.48s/it] 1%| | 409/34750 [21:58<42:01:38, 4.41s/it] 1%| | 410/34750 [22:02<41:12:36, 4.32s/it] 1%| | 411/34750 [22:06<40:08:54, 4.21s/it] 1%| | 412/34750 [22:10<39:03:22, 4.09s/it] 1%| | 413/34750 [22:14<38:34:32, 4.04s/it] 1%| | 414/34750 [22:17<37:40:02, 3.95s/it] 1%| | 415/34750 [22:21<36:37:15, 3.84s/it] 1%| | 416/34750 [22:25<36:12:41, 3.80s/it] 1%| | 417/34750 [22:28<35:24:02, 3.71s/it] 1%| | 418/34750 [22:32<34:40:10, 3.64s/it] 1%| | 419/34750 [22:35<33:57:25, 3.56s/it] 1%| | 420/34750 [22:38<33:08:40, 3.48s/it] 1%| | 421/34750 [22:42<32:18:45, 3.39s/it] 1%| | 422/34750 [22:45<31:30:05, 3.30s/it] 1%| | 423/34750 [22:48<30:52:25, 3.24s/it] 1%| | 424/34750 [22:51<30:20:07, 3.18s/it] 1%| | 425/34750 [22:54<30:16:08, 3.17s/it] 1%| | 426/34750 [22:57<29:37:23, 3.11s/it] 1%| | 427/34750 [23:00<29:02:17, 3.05s/it] 1%| | 428/34750 [23:03<28:32:26, 2.99s/it] 1%| | 429/34750 [23:05<27:55:36, 2.93s/it] 1%| | 430/34750 [23:08<27:22:38, 2.87s/it] 1%| | 431/34750 [23:11<26:42:52, 2.80s/it] 1%| | 432/34750 [23:13<26:09:53, 2.74s/it] 1%| | 433/34750 [23:16<25:33:50, 2.68s/it] 1%| | 434/34750 [23:19<25:26:14, 2.67s/it] 1%|▏ | 435/34750 [23:21<25:08:01, 2.64s/it] 1%|▏ | 436/34750 [23:24<24:28:11, 2.57s/it] 1%|▏ | 437/34750 [23:26<23:45:04, 2.49s/it] 1%|▏ | 438/34750 [23:28<23:09:23, 2.43s/it] 1%|▏ | 439/34750 [23:30<22:35:50, 2.37s/it] 1%|▏ | 440/34750 [23:33<22:09:21, 2.32s/it] 1%|▏ | 441/34750 [23:35<21:32:40, 2.26s/it] 1%|▏ | 442/34750 [23:37<21:02:35, 2.21s/it] 1%|▏ | 443/34750 [23:39<20:37:00, 2.16s/it] 1%|▏ | 444/34750 [23:41<20:17:59, 2.13s/it] 1%|▏ | 445/34750 [23:43<20:03:47, 2.11s/it] 1%|▏ | 446/34750 [23:45<19:49:33, 2.08s/it] 1%|▏ | 447/34750 [23:47<19:19:48, 2.03s/it] 1%|▏ | 448/34750 [23:49<18:48:10, 1.97s/it] 1%|▏ | 449/34750 [23:51<18:28:39, 1.94s/it] 1%|▏ | 450/34750 [23:52<17:45:13, 1.86s/it] 1%|▏ | 451/34750 [23:59<30:08:37, 3.16s/it] 1%|▏ | 452/34750 [24:04<37:08:51, 3.90s/it] 1%|▏ | 453/34750 [24:09<40:16:04, 4.23s/it] 1%|▏ | 454/34750 [24:14<41:18:56, 4.34s/it] 1%|▏ | 455/34750 [24:18<42:06:45, 4.42s/it] 1%|▏ | 456/34750 [24:23<41:51:37, 4.39s/it] 1%|▏ | 457/34750 [24:27<41:49:04, 4.39s/it] 1%|▏ | 458/34750 [24:31<41:03:14, 4.31s/it] 1%|▏ | 459/34750 [24:35<40:29:08, 4.25s/it] 1%|▏ | 460/34750 [24:39<39:39:10, 4.16s/it] 1%|▏ | 461/34750 [24:43<38:56:37, 4.09s/it] 1%|▏ | 462/34750 [24:47<38:30:33, 4.04s/it] 1%|▏ | 463/34750 [24:51<37:55:04, 3.98s/it] 1%|▏ | 464/34750 [24:55<37:01:56, 3.89s/it] 1%|▏ | 465/34750 [24:58<36:01:26, 3.78s/it] 1%|▏ | 466/34750 [25:02<35:06:25, 3.69s/it] 1%|▏ | 467/34750 [25:05<34:18:13, 3.60s/it] 1%|▏ | 468/34750 [25:08<33:47:41, 3.55s/it] 1%|▏ | 469/34750 [25:12<32:59:07, 3.46s/it] 1%|▏ | 470/34750 [25:15<32:19:51, 3.40s/it] 1%|▏ | 471/34750 [25:18<31:52:25, 3.35s/it] 1%|▏ | 472/34750 [25:21<31:32:56, 3.31s/it] 1%|▏ | 473/34750 [25:24<30:51:50, 3.24s/it] 1%|▏ | 474/34750 [25:28<30:17:54, 3.18s/it] 1%|▏ | 475/34750 [25:31<29:52:40, 3.14s/it] 1%|▏ | 476/34750 [25:34<29:21:56, 3.08s/it] 1%|▏ | 477/34750 [25:37<29:08:35, 3.06s/it] 1%|▏ | 478/34750 [25:39<28:25:03, 2.99s/it] 1%|▏ | 479/34750 [25:42<28:15:33, 2.97s/it] 1%|▏ | 480/34750 [25:45<27:32:19, 2.89s/it] 1%|▏ | 481/34750 [25:48<27:02:24, 2.84s/it] 1%|▏ | 482/34750 [25:50<26:38:29, 2.80s/it] 1%|▏ | 483/34750 [25:53<26:09:21, 2.75s/it] 1%|▏ | 484/34750 [25:56<26:07:06, 2.74s/it] 1%|▏ | 485/34750 [25:58<25:46:30, 2.71s/it] 1%|▏ | 486/34750 [26:01<25:11:05, 2.65s/it] 1%|▏ | 487/34750 [26:03<24:41:17, 2.59s/it] 1%|▏ | 488/34750 [26:06<24:11:10, 2.54s/it] 1%|▏ | 489/34750 [26:08<23:45:21, 2.50s/it] 1%|▏ | 490/34750 [26:10<23:12:34, 2.44s/it] 1%|▏ | 491/34750 [26:13<22:40:29, 2.38s/it] 1%|▏ | 492/34750 [26:15<22:19:29, 2.35s/it] 1%|▏ | 493/34750 [26:17<22:03:05, 2.32s/it] 1%|▏ | 494/34750 [26:19<21:32:01, 2.26s/it] 1%|▏ | 495/34750 [26:21<21:00:30, 2.21s/it] 1%|▏ | 496/34750 [26:23<20:25:39, 2.15s/it] 1%|▏ | 497/34750 [26:25<19:55:06, 2.09s/it] 1%|▏ | 498/34750 [26:27<19:13:21, 2.02s/it] 1%|▏ | 499/34750 [26:29<18:38:20, 1.96s/it] 1%|▏ | 500/34750 [26:31<17:50:56, 1.88s/it] 1%|▏ | 500/34750 [26:31<17:50:56, 1.88s/it]The following columns in the evaluation set don't have a corresponding argument in `Wav2Vec2ForCTC.forward` and have been ignored: input_length. | |
| ***** Running Evaluation ***** | |
| Num examples = 456 | |
| Batch size = 8 | |
| {'loss': 47.2908, 'learning_rate': 3.675e-06, 'epoch': 0.14} | |
| {'loss': 33.9125, 'learning_rate': 7.425e-06, 'epoch': 0.29} | |
| {'loss': 26.6068, 'learning_rate': 1.1174999999999999e-05, 'epoch': 0.43} | |
| {'loss': 23.2775, 'learning_rate': 1.4925e-05, 'epoch': 0.57} | |
| {'loss': 19.7138, 'learning_rate': 1.8675e-05, 'epoch': 0.72} | |
| 0%| | 0/57 [00:00<?, ?it/s][A | |
| 4%|▎ | 2/57 [00:00<00:19, 2.82it/s][A | |
| 5%|▌ | 3/57 [00:01<00:25, 2.12it/s][A | |
| 7%|▋ | 4/57 [00:02<00:28, 1.83it/s][A | |
| 9%|▉ | 5/57 [00:02<00:28, 1.85it/s][A | |
| 11%|█ | 6/57 [00:03<00:28, 1.78it/s][A | |
| 12%|█▏ | 7/57 [00:03<00:28, 1.76it/s][A | |
| 14%|█▍ | 8/57 [00:04<00:28, 1.72it/s][A | |
| 16%|█▌ | 9/57 [00:04<00:27, 1.72it/s][A | |
| 18%|█▊ | 10/57 [00:05<00:26, 1.75it/s][A | |
| 19%|█▉ | 11/57 [00:06<00:27, 1.68it/s][A | |
| 21%|██ | 12/57 [00:06<00:29, 1.53it/s][A | |
| 23%|██▎ | 13/57 [00:07<00:31, 1.42it/s][A | |
| 25%|██▍ | 14/57 [00:08<00:29, 1.44it/s][A | |
| 26%|██▋ | 15/57 [00:09<00:31, 1.34it/s][A | |
| 28%|██▊ | 16/57 [00:09<00:28, 1.43it/s][A | |
| 30%|██▉ | 17/57 [00:10<00:26, 1.50it/s][A | |
| 32%|███▏ | 18/57 [00:11<00:24, 1.58it/s][A | |
| 33%|███▎ | 19/57 [00:11<00:23, 1.65it/s][A | |
| 35%|███▌ | 20/57 [00:12<00:22, 1.64it/s][A | |
| 37%|███▋ | 21/57 [00:12<00:21, 1.65it/s][A | |
| 39%|███▊ | 22/57 [00:13<00:23, 1.52it/s][A | |
| 40%|████ | 23/57 [00:14<00:24, 1.40it/s][A | |
| 42%|████▏ | 24/57 [00:15<00:23, 1.42it/s][A | |
| 44%|████▍ | 25/57 [00:15<00:21, 1.47it/s][A | |
| 46%|████▌ | 26/57 [00:16<00:19, 1.55it/s][A | |
| 47%|████▋ | 27/57 [00:16<00:18, 1.65it/s][A | |
| 49%|████▉ | 28/57 [00:17<00:18, 1.59it/s][A | |
| 51%|█████ | 29/57 [00:18<00:17, 1.57it/s][A | |
| 53%|█████▎ | 30/57 [00:18<00:15, 1.70it/s][A | |
| 54%|█████▍ | 31/57 [00:19<00:14, 1.83it/s][A | |
| 56%|█████▌ | 32/57 [00:19<00:14, 1.78it/s][A | |
| 58%|█████▊ | 33/57 [00:20<00:14, 1.66it/s][A | |
| 60%|█████▉ | 34/57 [00:20<00:14, 1.63it/s][A | |
| 61%|██████▏ | 35/57 [00:21<00:14, 1.56it/s][A | |
| 63%|██████▎ | 36/57 [00:22<00:13, 1.57it/s][A | |
| 65%|██████▍ | 37/57 [00:22<00:13, 1.53it/s][A | |
| 67%|██████▋ | 38/57 [00:23<00:12, 1.47it/s][A | |
| 68%|██████▊ | 39/57 [00:24<00:12, 1.46it/s][A | |
| 70%|███████ | 40/57 [00:25<00:11, 1.43it/s][A | |
| 72%|███████▏ | 41/57 [00:25<00:11, 1.37it/s][A | |
| 74%|███████▎ | 42/57 [00:26<00:11, 1.35it/s][A | |
| 75%|███████▌ | 43/57 [00:27<00:10, 1.39it/s][A | |
| 77%|███████▋ | 44/57 [00:28<00:09, 1.36it/s][A | |
| 79%|███████▉ | 45/57 [00:28<00:07, 1.54it/s][A | |
| 81%|████████ | 46/57 [00:29<00:06, 1.58it/s][A | |
| 82%|████████▏ | 47/57 [00:29<00:06, 1.55it/s][A | |
| 84%|████████▍ | 48/57 [00:30<00:05, 1.63it/s][A | |
| 86%|████████▌ | 49/57 [00:31<00:04, 1.67it/s][A | |
| 88%|████████▊ | 50/57 [00:31<00:04, 1.67it/s][A | |
| 89%|████████▉ | 51/57 [00:32<00:03, 1.66it/s][A | |
| 91%|█████████ | 52/57 [00:32<00:02, 1.69it/s][A | |
| 93%|█████████▎| 53/57 [00:33<00:02, 1.80it/s][A | |
| 95%|█████████▍| 54/57 [00:33<00:01, 1.77it/s][A | |
| 96%|█████████▋| 55/57 [00:34<00:01, 1.61it/s][A | |
| 98%|█████████▊| 56/57 [00:35<00:00, 1.56it/s][A | |
| 100%|██████████| 57/57 [00:36<00:00, 1.47it/s][A | |
| [A 1%|▏ | 500/34750 [27:12<17:50:56, 1.88s/it] | |
| 100%|██████████| 57/57 [00:40<00:00, 1.47it/s][A | |
| [ASaving model checkpoint to ./checkpoint-500 | |
| Configuration saved in ./checkpoint-500/config.json | |
| Model weights saved in ./checkpoint-500/pytorch_model.bin | |
| Configuration saved in ./checkpoint-500/preprocessor_config.json | |
| Configuration saved in ./preprocessor_config.json | |