nohup: ignoring input 10/20/2021 21:47:33 - WARNING - __main__ - Process rank: -1, device: cuda:0, n_gpu: 1distributed training: False, 16-bits training: False 10/20/2021 21:47:33 - INFO - __main__ - Training/evaluation parameters TrainingArguments( _n_gpu=1, adafactor=False, adam_beta1=0.9, adam_beta2=0.999, adam_epsilon=1e-08, dataloader_drop_last=False, dataloader_num_workers=0, dataloader_pin_memory=True, ddp_find_unused_parameters=None, debug=[], deepspeed=None, disable_tqdm=False, do_eval=True, do_predict=False, do_train=True, eval_accumulation_steps=None, eval_steps=None, evaluation_strategy=IntervalStrategy.NO, fp16=False, fp16_backend=auto, fp16_full_eval=False, fp16_opt_level=O1, gradient_accumulation_steps=1, greater_is_better=None, group_by_length=False, ignore_data_skip=False, label_names=None, label_smoothing_factor=0.0, learning_rate=3e-05, length_column_name=length, load_best_model_at_end=False, local_rank=-1, log_level=-1, log_level_replica=-1, log_on_each_node=True, logging_dir=bert-based-uncased-squad/runs/Oct20_21-47-33_rtxws2, logging_first_step=False, logging_steps=1, logging_strategy=IntervalStrategy.STEPS, lr_scheduler_type=SchedulerType.LINEAR, max_grad_norm=1.0, max_steps=-1, metric_for_best_model=None, mp_parameters=, no_cuda=False, num_train_epochs=2.0, output_dir=bert-based-uncased-squad, overwrite_output_dir=True, past_index=-1, per_device_eval_batch_size=16, per_device_train_batch_size=16, prediction_loss_only=False, push_to_hub=False, push_to_hub_model_id=bert-based-uncased-squad, push_to_hub_organization=None, push_to_hub_token=, remove_unused_columns=True, report_to=['tensorboard'], resume_from_checkpoint=None, run_name=bert-based-uncased-squad, save_on_each_node=False, save_steps=10000, save_strategy=IntervalStrategy.STEPS, save_total_limit=None, seed=42, sharded_ddp=[], skip_memory_metrics=True, tpu_metrics_debug=False, tpu_num_cores=None, use_legacy_prediction_loop=False, warmup_ratio=0.0, warmup_steps=0, weight_decay=0.0, ) 10/20/2021 21:47:34 - INFO - datasets.load - Found main folder for dataset https://raw.githubusercontent.com/huggingface/datasets/1.12.1/datasets/squad/squad.py at /home/vchua/.cache/huggingface/modules/datasets_modules/datasets/squad 10/20/2021 21:47:34 - INFO - datasets.load - Found specific version folder for dataset https://raw.githubusercontent.com/huggingface/datasets/1.12.1/datasets/squad/squad.py at /home/vchua/.cache/huggingface/modules/datasets_modules/datasets/squad/d6ec3ceb99ca480ce37cdd35555d6cb2511d223b9150cce08a837ef62ffea453 10/20/2021 21:47:34 - INFO - datasets.load - Found script file from https://raw.githubusercontent.com/huggingface/datasets/1.12.1/datasets/squad/squad.py to /home/vchua/.cache/huggingface/modules/datasets_modules/datasets/squad/d6ec3ceb99ca480ce37cdd35555d6cb2511d223b9150cce08a837ef62ffea453/squad.py 10/20/2021 21:47:34 - INFO - datasets.load - Found dataset infos file from https://raw.githubusercontent.com/huggingface/datasets/1.12.1/datasets/squad/dataset_infos.json to /home/vchua/.cache/huggingface/modules/datasets_modules/datasets/squad/d6ec3ceb99ca480ce37cdd35555d6cb2511d223b9150cce08a837ef62ffea453/dataset_infos.json 10/20/2021 21:47:34 - INFO - datasets.load - Found metadata file for dataset https://raw.githubusercontent.com/huggingface/datasets/1.12.1/datasets/squad/squad.py at /home/vchua/.cache/huggingface/modules/datasets_modules/datasets/squad/d6ec3ceb99ca480ce37cdd35555d6cb2511d223b9150cce08a837ef62ffea453/squad.json 10/20/2021 21:47:34 - INFO - datasets.builder - No config specified, defaulting to first: squad/plain_text 10/20/2021 21:47:34 - INFO - datasets.info - Loading Dataset Infos from /home/vchua/.cache/huggingface/modules/datasets_modules/datasets/squad/d6ec3ceb99ca480ce37cdd35555d6cb2511d223b9150cce08a837ef62ffea453 10/20/2021 21:47:34 - INFO - datasets.builder - Overwrite dataset info from restored data version. 10/20/2021 21:47:34 - INFO - datasets.info - Loading Dataset info from /home/vchua/.cache/huggingface/datasets/squad/plain_text/1.0.0/d6ec3ceb99ca480ce37cdd35555d6cb2511d223b9150cce08a837ef62ffea453 10/20/2021 21:47:34 - WARNING - datasets.builder - Reusing dataset squad (/home/vchua/.cache/huggingface/datasets/squad/plain_text/1.0.0/d6ec3ceb99ca480ce37cdd35555d6cb2511d223b9150cce08a837ef62ffea453) 10/20/2021 21:47:34 - INFO - datasets.info - Loading Dataset info from /home/vchua/.cache/huggingface/datasets/squad/plain_text/1.0.0/d6ec3ceb99ca480ce37cdd35555d6cb2511d223b9150cce08a837ef62ffea453 0%| | 0/2 [00:00> loading configuration file https://huggingface.co/bert-base-uncased/resolve/main/config.json from cache at /home/vchua/.cache/huggingface/transformers/3c61d016573b14f7f008c02c4e51a366c67ab274726fe2910691e2a761acf43e.37395cee442ab11005bcd270f3c34464dc1704b715b5d7d52b1a461abe3b9e4e [INFO|configuration_utils.py:598] 2021-10-20 21:47:35,191 >> Model config BertConfig { "architectures": [ "BertForMaskedLM" ], "attention_probs_dropout_prob": 0.1, "classifier_dropout": null, "gradient_checkpointing": false, "hidden_act": "gelu", "hidden_dropout_prob": 0.1, "hidden_size": 768, "initializer_range": 0.02, "intermediate_size": 3072, "layer_norm_eps": 1e-12, "max_position_embeddings": 512, "model_type": "bert", "num_attention_heads": 12, "num_hidden_layers": 12, "pad_token_id": 0, "position_embedding_type": "absolute", "transformers_version": "4.10.3", "type_vocab_size": 2, "use_cache": true, "vocab_size": 30522 } [INFO|configuration_utils.py:561] 2021-10-20 21:47:35,866 >> loading configuration file https://huggingface.co/bert-base-uncased/resolve/main/config.json from cache at /home/vchua/.cache/huggingface/transformers/3c61d016573b14f7f008c02c4e51a366c67ab274726fe2910691e2a761acf43e.37395cee442ab11005bcd270f3c34464dc1704b715b5d7d52b1a461abe3b9e4e [INFO|configuration_utils.py:598] 2021-10-20 21:47:35,867 >> Model config BertConfig { "architectures": [ "BertForMaskedLM" ], "attention_probs_dropout_prob": 0.1, "classifier_dropout": null, "gradient_checkpointing": false, "hidden_act": "gelu", "hidden_dropout_prob": 0.1, "hidden_size": 768, "initializer_range": 0.02, "intermediate_size": 3072, "layer_norm_eps": 1e-12, "max_position_embeddings": 512, "model_type": "bert", "num_attention_heads": 12, "num_hidden_layers": 12, "pad_token_id": 0, "position_embedding_type": "absolute", "transformers_version": "4.10.3", "type_vocab_size": 2, "use_cache": true, "vocab_size": 30522 } [INFO|tokenization_utils_base.py:1739] 2021-10-20 21:47:37,899 >> loading file https://huggingface.co/bert-base-uncased/resolve/main/vocab.txt from cache at /home/vchua/.cache/huggingface/transformers/45c3f7a79a80e1cf0a489e5c62b43f173c15db47864303a55d623bb3c96f72a5.d789d64ebfe299b0e416afc4a169632f903f693095b4629a7ea271d5a0cf2c99 [INFO|tokenization_utils_base.py:1739] 2021-10-20 21:47:37,900 >> loading file https://huggingface.co/bert-base-uncased/resolve/main/tokenizer.json from cache at /home/vchua/.cache/huggingface/transformers/534479488c54aeaf9c3406f647aa2ec13648c06771ffe269edabebd4c412da1d.7f2721073f19841be16f41b0a70b600ca6b880c8f3df6f3535cbc704371bdfa4 [INFO|tokenization_utils_base.py:1739] 2021-10-20 21:47:37,900 >> loading file https://huggingface.co/bert-base-uncased/resolve/main/added_tokens.json from cache at None [INFO|tokenization_utils_base.py:1739] 2021-10-20 21:47:37,900 >> loading file https://huggingface.co/bert-base-uncased/resolve/main/special_tokens_map.json from cache at None [INFO|tokenization_utils_base.py:1739] 2021-10-20 21:47:37,900 >> loading file https://huggingface.co/bert-base-uncased/resolve/main/tokenizer_config.json from cache at /home/vchua/.cache/huggingface/transformers/c1d7f0a763fb63861cc08553866f1fc3e5a6f4f07621be277452d26d71303b7e.20430bd8e10ef77a7d2977accefe796051e01bc2fc4aa146bc862997a1a15e79 [INFO|configuration_utils.py:561] 2021-10-20 21:47:38,239 >> loading configuration file https://huggingface.co/bert-base-uncased/resolve/main/config.json from cache at /home/vchua/.cache/huggingface/transformers/3c61d016573b14f7f008c02c4e51a366c67ab274726fe2910691e2a761acf43e.37395cee442ab11005bcd270f3c34464dc1704b715b5d7d52b1a461abe3b9e4e [INFO|configuration_utils.py:598] 2021-10-20 21:47:38,240 >> Model config BertConfig { "architectures": [ "BertForMaskedLM" ], "attention_probs_dropout_prob": 0.1, "classifier_dropout": null, "gradient_checkpointing": false, "hidden_act": "gelu", "hidden_dropout_prob": 0.1, "hidden_size": 768, "initializer_range": 0.02, "intermediate_size": 3072, "layer_norm_eps": 1e-12, "max_position_embeddings": 512, "model_type": "bert", "num_attention_heads": 12, "num_hidden_layers": 12, "pad_token_id": 0, "position_embedding_type": "absolute", "transformers_version": "4.10.3", "type_vocab_size": 2, "use_cache": true, "vocab_size": 30522 } [INFO|modeling_utils.py:1279] 2021-10-20 21:47:38,667 >> loading weights file https://huggingface.co/bert-base-uncased/resolve/main/pytorch_model.bin from cache at /home/vchua/.cache/huggingface/transformers/a8041bf617d7f94ea26d15e218abd04afc2004805632abc0ed2066aa16d50d04.faf6ea826ae9c5867d12b22257f9877e6b8367890837bd60f7c54a29633f7f2f [WARNING|modeling_utils.py:1515] 2021-10-20 21:47:39,732 >> Some weights of the model checkpoint at bert-base-uncased were not used when initializing BertForQuestionAnswering: ['cls.predictions.transform.dense.bias', 'cls.predictions.transform.LayerNorm.bias', 'cls.predictions.decoder.weight', 'cls.predictions.transform.dense.weight', 'cls.predictions.transform.LayerNorm.weight', 'cls.seq_relationship.weight', 'cls.predictions.bias', 'cls.seq_relationship.bias'] - This IS expected if you are initializing BertForQuestionAnswering from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model). - This IS NOT expected if you are initializing BertForQuestionAnswering from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model). [WARNING|modeling_utils.py:1526] 2021-10-20 21:47:39,732 >> Some weights of BertForQuestionAnswering were not initialized from the model checkpoint at bert-base-uncased and are newly initialized: ['qa_outputs.weight', 'qa_outputs.bias'] You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference. Running tokenizer on train dataset: 0%| | 0/88 [00:00> ***** Running training ***** [INFO|trainer.py:1169] 2021-10-20 21:48:15,912 >> Num examples = 88524 [INFO|trainer.py:1170] 2021-10-20 21:48:15,912 >> Num Epochs = 2 [INFO|trainer.py:1171] 2021-10-20 21:48:15,912 >> Instantaneous batch size per device = 16 [INFO|trainer.py:1172] 2021-10-20 21:48:15,912 >> Total train batch size (w. parallel, distributed & accumulation) = 16 [INFO|trainer.py:1173] 2021-10-20 21:48:15,912 >> Gradient Accumulation steps = 1 [INFO|trainer.py:1174] 2021-10-20 21:48:15,912 >> Total optimization steps = 11066 0%| | 0/11066 [00:00> Saving model checkpoint to bert-based-uncased-squad/checkpoint-10000 [INFO|configuration_utils.py:391] 2021-10-20 22:24:54,481 >> Configuration saved in bert-based-uncased-squad/checkpoint-10000/config.json [INFO|modeling_utils.py:1001] 2021-10-20 22:24:54,983 >> Model weights saved in bert-based-uncased-squad/checkpoint-10000/pytorch_model.bin [INFO|tokenization_utils_base.py:2020] 2021-10-20 22:24:54,983 >> tokenizer config file saved in bert-based-uncased-squad/checkpoint-10000/tokenizer_config.json [INFO|tokenization_utils_base.py:2026] 2021-10-20 22:24:54,984 >> Special tokens file saved in bert-based-uncased-squad/checkpoint-10000/special_tokens_map.json 90%|█████████ | 10001/11066 [36:40<12:30, 1.42it/s] 90%|█████████ | 10001/11066 [36:40<12:30, 1.42it/s] 90%|█████████ | 10002/11066 [36:40<09:54, 1.79it/s] 90%|█████████ | 10002/11066 [36:40<09:54, 1.79it/s] 90%|█████████ | 10003/11066 [36:40<08:03, 2.20it/s] 90%|█████████ | 10003/11066 [36:40<08:03, 2.20it/s] 90%|█████████ | 10004/11066 [36:41<06:47, 2.61it/s] 90%|█████████ | 10004/11066 [36:41<06:47, 2.61it/s] 90%|█████████ | 10005/11066 [36:41<05:52, 3.01it/s] 90%|█████████ | 10005/11066 [36:41<05:52, 3.01it/s] 90%|█████████ | 10006/11066 [36:41<05:16, 3.35it/s] 90%|█████████ | 10006/11066 [36:41<05:16, 3.35it/s] 90%|█████████ | 10007/11066 [36:41<04:52, 3.62it/s] 90%|█████████ | 10007/11066 [36:41<04:52, 3.62it/s] 90%|█████████ | 10008/11066 [36:41<04:33, 3.87it/s] 90%|█████████ | 10008/11066 [36:41<04:33, 3.87it/s] 90%|█████████ | 10009/11066 [36:42<04:21, 4.04it/s] 90%|█████████ | 10009/11066 [36:42<04:21, 4.04it/s] 90%|█████████ | 10010/11066 [36:42<04:13, 4.17it/s] 90%|█████████ | 10010/11066 [36:42<04:13, 4.17it/s] 90%|█████████ | 10011/11066 [36:42<04:05, 4.29it/s] 90%|█████████ | 10011/11066 [36:42<04:05, 4.29it/s] 90%|█████████ | 10012/11066 [36:42<04:01, 4.37it/s] 90%|█████████ | 10012/11066 [36:42<04:01, 4.37it/s] 90%|█████████ | 10013/11066 [36:43<03:59, 4.39it/s] 90%|█████████ | 10013/11066 [36:43<03:59, 4.39it/s] 90%|█████████ | 10014/11066 [36:43<04:01, 4.36it/s] 90%|█████████ | 10014/11066 [36:43<04:01, 4.36it/s] 91%|█████████ | 10015/11066 [36:43<04:00, 4.37it/s] 91%|█████████ | 10015/11066 [36:43<04:00, 4.37it/s] 91%|█████████ | 10016/11066 [36:43<03:57, 4.42it/s] 91%|█████████ | 10016/11066 [36:43<03:57, 4.42it/s] 91%|█████████ | 10017/11066 [36:43<04:00, 4.36it/s] 91%|█████████ | 10017/11066 [36:43<04:00, 4.36it/s] 91%|█████████ | 10018/11066 [36:44<03:59, 4.38it/s] 91%|█████████ | 10018/11066 [36:44<03:59, 4.38it/s] 91%|█████████ | 10019/11066 [36:44<03:55, 4.45it/s] 91%|█████████ | 10019/11066 [36:44<03:55, 4.45it/s] 91%|█████████ | 10020/11066 [36:44<03:55, 4.44it/s] 91%|█████████ | 10020/11066 [36:44<03:55, 4.44it/s] 91%|█████████ | 10021/11066 [36:44<03:55, 4.44it/s] 91%|█████████ | 10021/11066 [36:44<03:55, 4.44it/s] 91%|█████████ | 10022/11066 [36:45<03:59, 4.36it/s] 91%|█████████ | 10022/11066 [36:45<03:59, 4.36it/s] 91%|█████████ | 10023/11066 [36:45<03:59, 4.35it/s] 91%|█████████ | 10023/11066 [36:45<03:59, 4.35it/s] 91%|█████████ | 10024/11066 [36:45<03:58, 4.37it/s] 91%|█████████ | 10024/11066 [36:45<03:58, 4.37it/s] 91%|█████████ | 10025/11066 [36:45<03:57, 4.39it/s] 91%|█████████ | 10025/11066 [36:45<03:57, 4.39it/s] 91%|█████████ | 10026/11066 [36:45<03:52, 4.48it/s] 91%|█████████ | 10026/11066 [36:45<03:52, 4.48it/s] 91%|█████████ | 10027/11066 [36:46<03:52, 4.46it/s] 91%|█████████ | 10027/11066 [36:46<03:52, 4.46it/s] 91%|█████████ | 10028/11066 [36:46<03:48, 4.55it/s] 91%|█████████ | 10028/11066 [36:46<03:48, 4.55it/s] 91%|█████████ | 10029/11066 [36:46<03:50, 4.49it/s] 91%|█████████ | 10029/11066 [36:46<03:50, 4.49it/s] 91%|█████████ | 10030/11066 [36:46<03:51, 4.48it/s] 91%|█████████ | 10030/11066 [36:46<03:51, 4.48it/s] 91%|█████████ | 10031/11066 [36:47<03:54, 4.41it/s] 91%|█████████ | 10031/11066 [36:47<03:54, 4.41it/s] 91%|█████████ | 10032/11066 [36:47<03:52, 4.44it/s] 91%|█████████ | 10032/11066 [36:47<03:52, 4.44it/s] 91%|█████████ | 10033/11066 [36:47<03:51, 4.46it/s] {'loss': 1.2233, 'learning_rate': 3.1068136634737033e-06, 'epoch': 1.79} {'loss': 0.4786, 'learning_rate': 3.1041026567865535e-06, 'epoch': 1.79} {'loss': 1.0258, 'learning_rate': 3.1013916500994036e-06, 'epoch': 1.79} {'loss': 0.3603, 'learning_rate': 3.0986806434122537e-06, 'epoch': 1.79} {'loss': 0.8764, 'learning_rate': 3.095969636725104e-06, 'epoch': 1.79} {'loss': 1.071, 'learning_rate': 3.093258630037954e-06, 'epoch': 1.79} {'loss': 1.3105, 'learning_rate': 3.0905476233508046e-06, 'epoch': 1.79} {'loss': 0.5938, 'learning_rate': 3.0878366166636547e-06, 'epoch': 1.79} {'loss': 0.8896, 'learning_rate': 3.085125609976505e-06, 'epoch': 1.79} {'loss': 0.4319, 'learning_rate': 3.082414603289355e-06, 'epoch': 1.79} {'loss': 0.7746, 'learning_rate': 3.079703596602205e-06, 'epoch': 1.79} {'loss': 0.5577, 'learning_rate': 3.0769925899150552e-06, 'epoch': 1.79} {'loss': 0.8535, 'learning_rate': 3.0742815832279054e-06, 'epoch': 1.8} {'loss': 0.4326, 'learning_rate': 3.0715705765407555e-06, 'epoch': 1.8} {'loss': 0.3985, 'learning_rate': 3.0688595698536056e-06, 'epoch': 1.8} {'loss': 0.9847, 'learning_rate': 3.0661485631664558e-06, 'epoch': 1.8} {'loss': 1.1321, 'learning_rate': 3.0634375564793063e-06, 'epoch': 1.8} {'loss': 0.7124, 'learning_rate': 3.0607265497921565e-06, 'epoch': 1.8} {'loss': 0.7556, 'learning_rate': 3.0580155431050066e-06, 'epoch': 1.8} {'loss': 0.6134, 'learning_rate': 3.0553045364178567e-06, 'epoch': 1.8} {'loss': 0.8479, 'learning_rate': 3.052593529730707e-06, 'epoch': 1.8} {'loss': 0.5303, 'learning_rate': 3.049882523043557e-06, 'epoch': 1.8} {'loss': 1.388, 'learning_rate': 3.047171516356407e-06, 'epoch': 1.8} {'loss': 0.5986, 'learning_rate': 3.0444605096692573e-06, 'epoch': 1.8} {'loss': 0.3123, 'learning_rate': 3.0417495029821074e-06, 'epoch': 1.8} {'loss': 0.9021, 'learning_rate': 3.0390384962949575e-06, 'epoch': 1.8} {'loss': 0.4803, 'learning_rate': 3.036327489607808e-06, 'epoch': 1.8} {'loss': 0.5428, 'learning_rate': 3.0336164829206582e-06, 'epoch': 1.8} {'loss': 0.5711, 'learning_rate': 3.0309054762335084e-06, 'epoch': 1.8} {'loss': 0.3289, 'learning_rate': 3.0281944695463585e-06, 'epoch': 1.8} {'loss': 0.737, 'learning_rate': 3.0254834628592086e-06, 'epoch': 1.8} {'loss': 0.9093, 'learning_rate': 3.0227724561720588e-06, 'epoch': 1.8} {'loss': 1.4915, 'learning_rate': 3.020061449484909e-06, 'epoch': 1.8} {'loss': 0.7855, 'learning_rate': 3.017350442797759e-06, 'epoch': 1.8} {'loss': 0.5284, 'learning_rate': 3.014639436110609e-06, 'epoch': 1.8} {'loss': 0.6052, 'learning_rate': 3.0119284294234593e-06, 'epoch': 1.8} {'loss': 1.1309, 'learning_rate': 3.0092174227363095e-06, 'epoch': 1.8} {'loss': 0.5737, 'learning_rate': 3.00650641604916e-06, 'epoch': 1.8} {'loss': 0.6817, 'learning_rate': 3.00379540936201e-06, 'epoch': 1.8} {'loss': 0.6194, 'learning_rate': 3.0010844026748603e-06, 'epoch': 1.8} {'loss': 0.381, 'learning_rate': 2.9983733959877104e-06, 'epoch': 1.8} {'loss': 1.6147, 'learning_rate': 2.9956623893005605e-06, 'epoch': 1.8} {'loss': 0.6841, 'learning_rate': 2.9929513826134107e-06, 'epoch': 1.8} {'loss': 0.6506, 'learning_rate': 2.990240375926261e-06, 'epoch': 1.8} {'loss': 0.5511, 'learning_rate': 2.987529369239111e-06, 'epoch': 1.8} {'loss': 0.6983, 'learning_rate': 2.984818362551961e-06, 'epoch': 1.8} {'loss': 0.9454, 'learning_rate': 2.9821073558648112e-06, 'epoch': 1.8} {'loss': 0.6412, 'learning_rate': 2.9793963491776618e-06, 'epoch': 1.8} {'loss': 0.6684, 'learning_rate': 2.976685342490512e-06, 'epoch': 1.8} {'loss': 0.7774, 'learning_rate': 2.973974335803362e-06, 'epoch': 1.8} {'loss': 0.3701, 'learning_rate': 2.971263329116212e-06, 'epoch': 1.8} {'loss': 0.5967, 'learning_rate': 2.9685523224290623e-06, 'epoch': 1.8} {'loss': 0.7521, 'learning_rate': 2.9658413157419124e-06, 'epoch': 1.8} {'loss': 0.3783, 'learning_rate': 2.963130309054762e-06, 'epoch': 1.8} {'loss': 0.7262, 'learning_rate': 2.9604193023676123e-06, 'epoch': 1.8} {'loss': 0.3602, 'learning_rate': 2.9577082956804624e-06, 'epoch': 1.8} {'loss': 1.8659, 'learning_rate': 2.9549972889933126e-06, 'epoch': 1.8} {'loss': 0.7844, 'learning_rate': 2.9522862823061627e-06, 'epoch': 1.8} {'loss': 0.8235, 'learning_rate': 2.9495752756190133e-06, 'epoch': 1.8} {'loss': 0.5405, 'learning_rate': 2.9468642689318634e-06, 'epoch': 1.8} {'loss': 0.6533, 'learning_rate': 2.9441532622447135e-06, 'epoch': 1.8} {'loss': 0.7635, 'learning_rate': 2.9414422555575637e-06, 'epoch': 1.8} {'loss': 0.9399, 'learning_rate': 2.938731248870414e-06, 'epoch': 1.8} {'loss': 0.7491, 'learning_rate': 2.936020242183264e-06, 'epoch': 1.8} {'loss': 0.8449, 'learning_rate': 2.933309235496114e-06, 'epoch': 1.8} {'loss': 0.6107, 'learning_rate': 2.930598228808964e-06, 'epoch': 1.8} {'loss': 0.9974, 'learning_rate': 2.9278872221218143e-06, 'epoch': 1.8} {'loss': 1.059, 'learning_rate': 2.9251762154346645e-06, 'epoch': 1.8} {'loss': 0.3379, 'learning_rate': 2.922465208747515e-06, 'epoch': 1.81} {'loss': 1.103, 'learning_rate': 2.919754202060365e-06, 'epoch': 1.81} {'loss': 0.4525, 'learning_rate': 2.9170431953732153e-06, 'epoch': 1.81} {'loss': 0.5262, 'learning_rate': 2.9143321886860654e-06, 'epoch': 1.81} {'loss': 1.4366, 'learning_rate': 2.9116211819989156e-06, 'epoch': 1.81} {'loss': 0.4769, 'learning_rate': 2.9089101753117657e-06, 'epoch': 1.81} {'loss': 0.9024, 'learning_rate': 2.906199168624616e-06, 'epoch': 1.81} {'loss': 0.3784, 'learning_rate': 2.903488161937466e-06, 'epoch': 1.81} {'loss': 0.9575, 'learning_rate': 2.900777155250316e-06, 'epoch': 1.81} {'loss': 0.5496, 'learning_rate': 2.8980661485631662e-06, 'epoch': 1.81} {'loss': 0.7908, 'learning_rate': 2.8953551418760168e-06, 'epoch': 1.81} {'loss': 0.6308, 'learning_rate': 2.892644135188867e-06, 'epoch': 1.81} {'loss': 0.5062, 'learning_rate': 2.889933128501717e-06, 'epoch': 1.81} {'loss': 0.755, 'learning_rate': 2.887222121814567e-06, 'epoch': 1.81} {'loss': 0.8384, 'learning_rate': 2.8845111151274173e-06, 'epoch': 1.81} {'loss': 0.5119, 'learning_rate': 2.8818001084402675e-06, 'epoch': 1.81} {'loss': 0.4633, 'learning_rate': 2.8790891017531176e-06, 'epoch': 1.81} {'loss': 0.6086, 'learning_rate': 2.8763780950659677e-06, 'epoch': 1.81} {'loss': 0.5182, 'learning_rate': 2.873667088378818e-06, 'epoch': 1.81} {'loss': 1.4092, 'learning_rate': 2.870956081691668e-06, 'epoch': 1.81} {'loss': 0.773, 'learning_rate': 2.868245075004518e-06, 'epoch': 1.81} {'loss': 0.6108, 'learning_rate': 2.8655340683173687e-06, 'epoch': 1.81} {'loss': 0.5841, 'learning_rate': 2.862823061630219e-06, 'epoch': 1.81} {'loss': 0.5781, 'learning_rate': 2.860112054943069e-06, 'epoch': 1.81} {'loss': 0.9404, 'learning_rate': 2.857401048255919e-06, 'epoch': 1.81} {'loss': 0.614, 'learning_rate': 2.8546900415687692e-06, 'epoch': 1.81} {'loss': 0.6607, 'learning_rate': 2.8519790348816194e-06, 'epoch': 1.81} {'loss': 0.5134, 'learning_rate': 2.8492680281944695e-06, 'epoch': 1.81} {'loss': 0.7918, 'learning_rate': 2.8465570215073196e-06, 'epoch': 1.81} {'loss': 0.4677, 'learning_rate': 2.8438460148201698e-06, 'epoch': 1.81} {'loss': 0.4002, 'learning_rate': 2.84113500813302e-06, 'epoch': 1.81} {'loss': 0.3726, 'learning_rate': 2.8384240014458705e-06, 'epoch': 1.81} {'loss': 0.3862, 'learning_rate': 2.8357129947587206e-06, 'epoch': 1.81} {'loss': 0.4107, 'learning_rate': 2.8330019880715707e-06, 'epoch': 1.81} {'loss': 0.513, 'learning_rate': 2.830290981384421e-06, 'epoch': 1.81} {'loss': 0.686, 'learning_rate': 2.827579974697271e-06, 'epoch': 1.81} {'loss': 0.4302, 'learning_rate': 2.824868968010121e-06, 'epoch': 1.81} {'loss': 0.9332, 'learning_rate': 2.8221579613229713e-06, 'epoch': 1.81} {'loss': 0.7861, 'learning_rate': 2.8194469546358214e-06, 'epoch': 1.81} {'loss': 0.6194, 'learning_rate': 2.8167359479486715e-06, 'epoch': 1.81} {'loss': 0.6695, 'learning_rate': 2.8140249412615217e-06, 'epoch': 1.81} {'loss': 0.3674, 'learning_rate': 2.811313934574372e-06, 'epoch': 1.81} {'loss': 0.5039, 'learning_rate': 2.8086029278872224e-06, 'epoch': 1.81} {'loss': 0.4844, 'learning_rate': 2.8058919212000725e-06, 'epoch': 1.81} {'loss': 0.9962, 'learning_rate': 2.8031809145129226e-06, 'epoch': 1.81} 91%|█████████ | 10033/11066 [36:47<03:51, 4.46it/s] 91%|█████████ | 10034/11066 [36:47<03:51, 4.45it/s] 91%|█████████ | 10034/11066 [36:47<03:51, 4.45it/s] 91%|█████████ | 10035/11066 [36:47<03:51, 4.45it/s] 91%|█████████ | 10035/11066 [36:47<03:51, 4.45it/s] 91%|█████████ | 10036/11066 [36:48<03:52, 4.43it/s] 91%|█████████ | 10036/11066 [36:48<03:52, 4.43it/s] 91%|█████████ | 10037/11066 [36:48<03:54, 4.39it/s] 91%|█████████ | 10037/11066 [36:48<03:54, 4.39it/s] 91%|█████████ | 10038/11066 [36:48<03:55, 4.37it/s] 91%|█████████ | 10038/11066 [36:48<03:55, 4.37it/s] 91%|█████████ | 10039/11066 [36:48<03:53, 4.40it/s] 91%|█████████ | 10039/11066 [36:48<03:53, 4.40it/s] 91%|█████████ | 10040/11066 [36:49<03:51, 4.43it/s] 91%|█████████ | 10040/11066 [36:49<03:51, 4.43it/s] 91%|█████████ | 10041/11066 [36:49<03:50, 4.45it/s] 91%|█████████ | 10041/11066 [36:49<03:50, 4.45it/s] 91%|█████████ | 10042/11066 [36:49<03:46, 4.52it/s] 91%|█████████ | 10042/11066 [36:49<03:46, 4.52it/s] 91%|█████████ | 10043/11066 [36:49<03:44, 4.57it/s] 91%|█████████ | 10043/11066 [36:49<03:44, 4.57it/s] 91%|█████████ | 10044/11066 [36:49<03:44, 4.56it/s] 91%|█████████ | 10044/11066 [36:49<03:44, 4.56it/s] 91%|█████████ | 10045/11066 [36:50<03:42, 4.59it/s] 91%|█████████ | 10045/11066 [36:50<03:42, 4.59it/s] 91%|█████████ | 10046/11066 [36:50<03:43, 4.56it/s] 91%|█████████ | 10046/11066 [36:50<03:43, 4.56it/s] 91%|█████████ | 10047/11066 [36:50<03:41, 4.60it/s] 91%|█████████ | 10047/11066 [36:50<03:41, 4.60it/s] 91%|█████████ | 10048/11066 [36:50<03:41, 4.60it/s] 91%|█████████ | 10048/11066 [36:50<03:41, 4.60it/s] 91%|█████████ | 10049/11066 [36:51<03:38, 4.65it/s] 91%|█████████ | 10049/11066 [36:51<03:38, 4.65it/s] 91%|█████████ | 10050/11066 [36:51<03:40, 4.60it/s] 91%|█████████ | 10050/11066 [36:51<03:40, 4.60it/s] 91%|█████████ | 10051/11066 [36:51<03:40, 4.61it/s] 91%|█████████ | 10051/11066 [36:51<03:40, 4.61it/s] 91%|█████████ | 10052/11066 [36:51<03:42, 4.55it/s] 91%|█████████ | 10052/11066 [36:51<03:42, 4.55it/s] 91%|█████████ | 10053/11066 [36:51<03:43, 4.53it/s] 91%|█████████ | 10053/11066 [36:51<03:43, 4.53it/s] 91%|█████████ | 10054/11066 [36:52<03:41, 4.57it/s] 91%|█████████ | 10054/11066 [36:52<03:41, 4.57it/s] 91%|█████████ | 10055/11066 [36:52<03:43, 4.53it/s] 91%|█████████ | 10055/11066 [36:52<03:43, 4.53it/s] 91%|█████████ | 10056/11066 [36:52<03:44, 4.50it/s] 91%|█████████ | 10056/11066 [36:52<03:44, 4.50it/s] 91%|█████████ | 10057/11066 [36:52<03:44, 4.50it/s] 91%|█████████ | 10057/11066 [36:52<03:44, 4.50it/s] 91%|█████████ | 10058/11066 [36:53<03:44, 4.50it/s] 91%|█████████ | 10058/11066 [36:53<03:44, 4.50it/s] 91%|█████████ | 10059/11066 [36:53<03:42, 4.53it/s] 91%|█████████ | 10059/11066 [36:53<03:42, 4.53it/s] 91%|█████████ | 10060/11066 [36:53<03:40, 4.56it/s] 91%|█████████ | 10060/11066 [36:53<03:40, 4.56it/s] 91%|█████████ | 10061/11066 [36:53<03:39, 4.58it/s] 91%|█████████ | 10061/11066 [36:53<03:39, 4.58it/s] 91%|█████████ | 10062/11066 [36:53<03:40, 4.56it/s] 91%|█████████ | 10062/11066 [36:53<03:40, 4.56it/s] 91%|█████████ | 10063/11066 [36:54<03:38, 4.59it/s] 91%|█████████ | 10063/11066 [36:54<03:38, 4.59it/s] 91%|█████████ | 10064/11066 [36:54<03:40, 4.55it/s] 91%|█████████ | 10064/11066 [36:54<03:40, 4.55it/s] 91%|█████████ | 10065/11066 [36:54<03:39, 4.56it/s] 91%|█████████ | 10065/11066 [36:54<03:39, 4.56it/s] 91%|█████████ | 10066/11066 [36:54<03:41, 4.52it/s] 91%|█████████ | 10066/11066 [36:54<03:41, 4.52it/s] 91%|█████████ | 10067/11066 [36:55<03:38, 4.57it/s] 91%|█████████ | 10067/11066 [36:55<03:38, 4.57it/s] 91%|█████████ | 10068/11066 [36:55<03:39, 4.54it/s] 91%|█████████ | 10068/11066 [36:55<03:39, 4.54it/s] 91%|█████████ | 10069/11066 [36:55<03:40, 4.52it/s] 91%|█████████ | 10069/11066 [36:55<03:40, 4.52it/s] 91%|█████████ | 10070/11066 [36:55<03:40, 4.52it/s] 91%|█████████ | 10070/11066 [36:55<03:40, 4.52it/s] 91%|█████████ | 10071/11066 [36:55<03:40, 4.51it/s] 91%|█████████ | 10071/11066 [36:55<03:40, 4.51it/s] 91%|█████████ | 10072/11066 [36:56<03:39, 4.53it/s] 91%|█████████ | 10072/11066 [36:56<03:39, 4.53it/s] 91%|█████████ | 10073/11066 [36:56<03:40, 4.50it/s] 91%|█████████ | 10073/11066 [36:56<03:40, 4.50it/s] 91%|█████████ | 10074/11066 [36:56<03:38, 4.53it/s] 91%|█████████ | 10074/11066 [36:56<03:38, 4.53it/s] 91%|█████████ | 10075/11066 [36:56<03:40, 4.50it/s] 91%|█████████ | 10075/11066 [36:56<03:40, 4.50it/s] 91%|█████████ | 10076/11066 [36:57<03:40, 4.49it/s] 91%|█████████ | 10076/11066 [36:57<03:40, 4.49it/s] 91%|█████████ | 10077/11066 [36:57<03:40, 4.49it/s] 91%|█████████ | 10077/11066 [36:57<03:40, 4.49it/s] 91%|█████████ | 10078/11066 [36:57<03:39, 4.49it/s] 91%|█████████ | 10078/11066 [36:57<03:39, 4.49it/s] 91%|█████████ | 10079/11066 [36:57<03:37, 4.53it/s] 91%|█████████ | 10079/11066 [36:57<03:37, 4.53it/s] 91%|█████████ | 10080/11066 [36:57<03:37, 4.54it/s] 91%|█████████ | 10080/11066 [36:57<03:37, 4.54it/s] 91%|█████████ | 10081/11066 [36:58<03:36, 4.55it/s] 91%|█████████ | 10081/11066 [36:58<03:36, 4.55it/s] 91%|█████████ | 10082/11066 [36:58<03:37, 4.52it/s] 91%|█████████ | 10082/11066 [36:58<03:37, 4.52it/s] 91%|█████████ | 10083/11066 [36:58<03:36, 4.55it/s] 91%|█████████ | 10083/11066 [36:58<03:36, 4.55it/s] 91%|█████████ | 10084/11066 [36:58<03:34, 4.57it/s] 91%|█████████ | 10084/11066 [36:58<03:34, 4.57it/s] 91%|█████████ | 10085/11066 [36:59<03:35, 4.54it/s] 91%|█████████ | 10085/11066 [36:59<03:35, 4.54it/s] 91%|█████████ | 10086/11066 [36:59<03:36, 4.53it/s] 91%|█████████ | 10086/11066 [36:59<03:36, 4.53it/s] 91%|█████████ | 10087/11066 [36:59<03:36, 4.52it/s] 91%|█████████ | 10087/11066 [36:59<03:36, 4.52it/s] 91%|█████████ | 10088/11066 [36:59<03:36, 4.52it/s] 91%|█████████ | 10088/11066 [36:59<03:36, 4.52it/s] 91%|█████████ | 10089/11066 [36:59<03:34, 4.55it/s] 91%|█████████ | 10089/11066 [36:59<03:34, 4.55it/s] 91%|█████████ | 10090/11066 [37:00<03:36, 4.51it/s] 91%|█████████ | 10090/11066 [37:00<03:36, 4.51it/s] 91%|█████████ | 10091/11066 [37:00<03:34, 4.54it/s] 91%|█████████ | 10091/11066 [37:00<03:34, 4.54it/s] 91%|█████████ | 10092/11066 [37:00<03:34, 4.55it/s] 91%|█████████ | 10092/11066 [37:00<03:34, 4.55it/s] 91%|█████████ | 10093/11066 [37:00<03:33, 4.56it/s] 91%|█████████ | 10093/11066 [37:00<03:33, 4.56it/s] 91%|█████████ | 10094/11066 [37:01<03:34, 4.53it/s] 91%|█████████ | 10094/11066 [37:01<03:34, 4.53it/s] 91%|█████████ | 10095/11066 [37:01<03:35, 4.51it/s] 91%|█████████ | 10095/11066 [37:01<03:35, 4.51it/s] 91%|█████████ | 10096/11066 [37:01<03:35, 4.50it/s] 91%|█████████ | 10096/11066 [37:01<03:35, 4.50it/s] 91%|█████████ | 10097/11066 [37:01<03:32, 4.56it/s] 91%|█████████ | 10097/11066 [37:01<03:32, 4.56it/s] 91%|█████████▏| 10098/11066 [37:01<03:30, 4.60it/s] 91%|█████████▏| 10098/11066 [37:01<03:30, 4.60it/s] 91%|█████████▏| 10099/11066 [37:02<03:31, 4.57it/s] 91%|█████████▏| 10099/11066 [37:02<03:31, 4.57it/s] 91%|█████████▏| 10100/11066 [37:02<03:29, 4.61it/s] 91%|█████████▏| 10100/11066 [37:02<03:29, 4.61it/s] 91%|█████████▏| 10101/11066 [37:02<03:28, 4.63it/s] 91%|█████████▏| 10101/11066 [37:02<03:28, 4.63it/s] 91%|█████████▏| 10102/11066 [37:02<03:26, 4.67it/s] 91%|█████████▏| 10102/11066 [37:02<03:26, 4.67it/s] 91%|█████████▏| 10103/11066 [37:02<03:24, 4.70it/s] 91%|█████████▏| 10103/11066 [37:02<03:24, 4.70it/s] 91%|█████████▏| 10104/11066 [37:03<03:24, 4.70it/s] 91%|█████████▏| 10104/11066 [37:03<03:24, 4.70it/s] 91%|█████████▏| 10105/11066 [37:03<03:24, 4.70it/s] 91%|█████████▏| 10105/11066 [37:03<03:24, 4.70it/s] 91%|█████████▏| 10106/11066 [37:03<03:24, 4.70it/s] 91%|█████████▏| 10106/11066 [37:03<03:24, 4.70it/s] 91%|█████████▏| 10107/11066 [37:03<03:22, 4.73it/s] 91%|█████████▏| 10107/11066 [37:03<03:22, 4.73it/s] 91%|█████████▏| 10108/11066 [37:04<03:25, 4.66it/s] 91%|█████████▏| 10108/11066 [37:04<03:25, 4.66it/s] 91%|█████████▏| 10109/11066 [37:04<03:24, 4.68it/s] 91%|█████████▏| 10109/11066 [37:04<03:24, 4.68it/s] 91%|█████████▏| 10110/11066 [37:04<03:27, 4.61it/s] 91%|█████████▏| 10110/11066 [37:04<03:27, 4.61it/s] 91%|█████████▏| 10111/11066 [37:04<03:28, 4.58it/s] 91%|█████████▏| 10111/11066 [37:04<03:28, 4.58it/s] 91%|█████████▏| 10112/11066 [37:04<03:27, 4.60it/s] 91%|█████████▏| 10112/11066 [37:04<03:27, 4.60it/s] 91%|█████████▏| 10113/11066 [37:05<03:26, 4.63it/s] 91%|█████████▏| 10113/11066 [37:05<03:26, 4.63it/s] 91%|█████████▏| 10114/11066 [37:05<03:25, 4.64it/s] 91%|█████████▏| 10114/11066 [37:05<03:25, 4.64it/s] 91%|█████████▏| 10115/11066 [37:05<03:24, 4.66it/s] 91%|█████████▏| 10115/11066 [37:05<03:24, 4.66it/s] 91%|█████████▏| 10116/11066 [37:05<03:26, 4.60it/s] 91%|█████████▏| 10116/11066 [37:05<03:26, 4.60it/s] 91%|█████████▏| 10117/11066 [37:05<03:26, 4.60it/s] 91%|█████████▏| 10117/11066 [37:05<03:26, 4.60it/s] 91%|█████████▏| 10118/11066 [37:06<03:24, 4.63it/s] 91%|█████████▏| 10118/11066 [37:06<03:24, 4.63it/s] 91%|█████████▏| 10119/11066 [37:06<03:24, 4.63it/s] 91%|█████████▏| 10119/11066 [37:06<03:24, 4.63it/s] 91%|█████████▏| 10120/11066 [37:06<03:24, 4.62it/s] 91%|█████████▏| 10120/11066 [37:06<03:24, 4.62it/s] 91%|█████████▏| 10121/11066 [37:06<03:25, 4.60it/s] 91%|█████████▏| 10121/11066 [37:06<03:25, 4.60it/s] 91%|█████████▏| 10122/11066 [37:07<03:25, 4.60it/s] 91%|█████████▏| 10122/11066 [37:07<03:25, 4.60it/s] 91%|█████████▏| 10123/11066 [37:07<03:27, 4.55it/s] 91%|█████████▏| 10123/11066 [37:07<03:27, 4.55it/s] 91%|█████████▏| 10124/11066 [37:07<03:28, 4.53it/s] 91%|█████████▏| 10124/11066 [37:07<03:28, 4.53it/s] 91%|█████████▏| 10125/11066 [37:07<03:30, 4.48it/s] 91%|█████████▏| 10125/11066 [37:07<03:30, 4.48it/s] 92%|█████████▏| 10126/11066 [37:07<03:32, 4.43it/s] 92%|█████████▏| 10126/11066 [37:07<03:32, 4.43it/s] 92%|█████████▏| 10127/11066 [37:08<03:30, 4.45it/s] 92%|█████████▏| 10127/11066 [37:08<03:30, 4.45it/s] 92%|█████████▏| 10128/11066 [37:08<03:28, 4.50it/s] 92%|█████████▏| 10128/11066 [37:08<03:28, 4.50it/s] 92%|█████████▏| 10129/11066 [37:08<03:27, 4.52it/s] 92%|█████████▏| 10129/11066 [37:08<03:27, 4.52it/s] 92%|█████████▏| 10130/11066 [37:08<03:25, 4.55it/s] 92%|█████████▏| 10130/11066 [37:08<03:25, 4.55it/s] 92%|█████████▏| 10131/11066 [37:09<03:23, 4.58it/s] 92%|█████████▏| 10131/11066 [37:09<03:23, 4.58it/s] 92%|█████████▏| 10132/11066 [37:09<03:25, 4.55it/s] 92%|█████████▏| 10132/11066 [37:09<03:25, 4.55it/s] 92%|█████████▏| 10133/11066 [37:09<03:25, 4.53it/s] 92%|█████████▏| 10133/11066 [37:09<03:25, 4.53it/s] 92%|█████████▏| 10134/11066 [37:09<03:26, 4.52it/s] 92%|█████████▏| 10134/11066 [37:09<03:26, 4.52it/s] 92%|█████████▏| 10135/11066 [37:09<03:25, 4.52it/s] 92%|█████████▏| 10135/11066 [37:09<03:25, 4.52it/s] 92%|█████████▏| 10136/11066 [37:10<03:26, 4.51it/s] 92%|█████████▏| 10136/11066 [37:10<03:26, 4.51it/s] 92%|█████████▏| 10137/11066 [37:10<03:26, 4.50it/s] 92%|█████████▏| 10137/11066 [37:10<03:26, 4.50it/s] 92%|█████████▏| 10138/11066 [37:10<03:23, 4.56it/s] 92%|█████████▏| 10138/11066 [37:10<03:23, 4.56it/s] 92%|█████████▏| 10139/11066 [37:10<03:21, 4.60it/s] 92%|█████████▏| 10139/11066 [37:10<03:21, 4.60it/s] 92%|█████████▏| 10140/11066 [37:11<03:18, 4.66it/s] 92%|█████████▏| 10140/11066 [37:11<03:18, 4.66it/s] 92%|█████████▏| 10141/11066 [37:11<03:20, 4.60it/s] 92%|█████████▏| 10141/11066 [37:11<03:20, 4.60it/s] 92%|█████████▏| 10142/11066 [37:11<03:20, 4.60it/s] 92%|█████████▏| 10142/11066 [37:11<03:20, 4.60it/s] 92%|█████████▏| 10143/11066 [37:11<03:23, 4.54it/s] 92%|█████████▏| 10143/11066 [37:11<03:23, 4.54it/s] 92%|█████████▏| 10144/11066 [37:11<03:24, 4.50it/s] 92%|█████████▏| 10144/11066 [37:11<03:24, 4.50it/s] 92%|█████████▏| 10145/11066 [37:12<03:25, 4.48it/s] 92%|█████████▏| 10145/11066 [37:12<03:25, 4.48it/s] 92%|█████████▏| 10146/11066 [37:12<03:23, 4.52it/s] {'loss': 0.8146, 'learning_rate': 2.8004699078257728e-06, 'epoch': 1.81} {'loss': 0.48, 'learning_rate': 2.797758901138623e-06, 'epoch': 1.81} {'loss': 1.0203, 'learning_rate': 2.795047894451473e-06, 'epoch': 1.81} {'loss': 0.6507, 'learning_rate': 2.792336887764323e-06, 'epoch': 1.81} {'loss': 0.6475, 'learning_rate': 2.7896258810771733e-06, 'epoch': 1.81} {'loss': 0.3103, 'learning_rate': 2.7869148743900234e-06, 'epoch': 1.81} {'loss': 1.0561, 'learning_rate': 2.7842038677028736e-06, 'epoch': 1.81} {'loss': 0.3481, 'learning_rate': 2.781492861015724e-06, 'epoch': 1.81} {'loss': 0.6997, 'learning_rate': 2.7787818543285743e-06, 'epoch': 1.81} {'loss': 1.0446, 'learning_rate': 2.7760708476414244e-06, 'epoch': 1.81} {'loss': 1.1141, 'learning_rate': 2.7733598409542745e-06, 'epoch': 1.82} {'loss': 0.1958, 'learning_rate': 2.7706488342671247e-06, 'epoch': 1.82} {'loss': 0.6018, 'learning_rate': 2.767937827579975e-06, 'epoch': 1.82} {'loss': 0.244, 'learning_rate': 2.765226820892825e-06, 'epoch': 1.82} {'loss': 0.5705, 'learning_rate': 2.762515814205675e-06, 'epoch': 1.82} {'loss': 0.5253, 'learning_rate': 2.759804807518525e-06, 'epoch': 1.82} {'loss': 1.0956, 'learning_rate': 2.7570938008313753e-06, 'epoch': 1.82} {'loss': 0.8115, 'learning_rate': 2.7543827941442255e-06, 'epoch': 1.82} {'loss': 1.2263, 'learning_rate': 2.751671787457076e-06, 'epoch': 1.82} {'loss': 0.5767, 'learning_rate': 2.748960780769926e-06, 'epoch': 1.82} {'loss': 0.3492, 'learning_rate': 2.7462497740827763e-06, 'epoch': 1.82} {'loss': 0.4542, 'learning_rate': 2.7435387673956264e-06, 'epoch': 1.82} {'loss': 0.1409, 'learning_rate': 2.7408277607084766e-06, 'epoch': 1.82} {'loss': 0.2844, 'learning_rate': 2.7381167540213267e-06, 'epoch': 1.82} {'loss': 0.4808, 'learning_rate': 2.735405747334177e-06, 'epoch': 1.82} {'loss': 0.3602, 'learning_rate': 2.732694740647027e-06, 'epoch': 1.82} {'loss': 1.0641, 'learning_rate': 2.729983733959877e-06, 'epoch': 1.82} {'loss': 1.067, 'learning_rate': 2.7272727272727272e-06, 'epoch': 1.82} {'loss': 1.0052, 'learning_rate': 2.7245617205855778e-06, 'epoch': 1.82} {'loss': 0.4045, 'learning_rate': 2.721850713898428e-06, 'epoch': 1.82} {'loss': 0.6802, 'learning_rate': 2.719139707211278e-06, 'epoch': 1.82} {'loss': 0.7177, 'learning_rate': 2.716428700524128e-06, 'epoch': 1.82} {'loss': 0.7057, 'learning_rate': 2.7137176938369783e-06, 'epoch': 1.82} {'loss': 0.4504, 'learning_rate': 2.7110066871498285e-06, 'epoch': 1.82} {'loss': 1.2565, 'learning_rate': 2.7082956804626786e-06, 'epoch': 1.82} {'loss': 0.9051, 'learning_rate': 2.7055846737755287e-06, 'epoch': 1.82} {'loss': 0.6989, 'learning_rate': 2.702873667088379e-06, 'epoch': 1.82} {'loss': 0.9877, 'learning_rate': 2.700162660401229e-06, 'epoch': 1.82} {'loss': 0.851, 'learning_rate': 2.6974516537140796e-06, 'epoch': 1.82} {'loss': 0.6756, 'learning_rate': 2.6947406470269297e-06, 'epoch': 1.82} {'loss': 0.4935, 'learning_rate': 2.69202964033978e-06, 'epoch': 1.82} {'loss': 0.5466, 'learning_rate': 2.68931863365263e-06, 'epoch': 1.82} {'loss': 0.4573, 'learning_rate': 2.68660762696548e-06, 'epoch': 1.82} {'loss': 0.7219, 'learning_rate': 2.6838966202783302e-06, 'epoch': 1.82} {'loss': 0.9674, 'learning_rate': 2.6811856135911804e-06, 'epoch': 1.82} {'loss': 0.6887, 'learning_rate': 2.6784746069040305e-06, 'epoch': 1.82} {'loss': 0.7309, 'learning_rate': 2.6757636002168806e-06, 'epoch': 1.82} {'loss': 0.6239, 'learning_rate': 2.6730525935297308e-06, 'epoch': 1.82} {'loss': 0.6339, 'learning_rate': 2.670341586842581e-06, 'epoch': 1.82} {'loss': 0.6514, 'learning_rate': 2.6676305801554315e-06, 'epoch': 1.82} {'loss': 0.9033, 'learning_rate': 2.6649195734682816e-06, 'epoch': 1.82} {'loss': 0.8428, 'learning_rate': 2.6622085667811317e-06, 'epoch': 1.82} {'loss': 0.853, 'learning_rate': 2.659497560093982e-06, 'epoch': 1.82} {'loss': 0.5933, 'learning_rate': 2.656786553406832e-06, 'epoch': 1.82} {'loss': 0.4804, 'learning_rate': 2.654075546719682e-06, 'epoch': 1.82} {'loss': 1.5426, 'learning_rate': 2.6513645400325323e-06, 'epoch': 1.82} {'loss': 0.4933, 'learning_rate': 2.6486535333453824e-06, 'epoch': 1.82} {'loss': 0.4915, 'learning_rate': 2.6459425266582325e-06, 'epoch': 1.82} {'loss': 0.9157, 'learning_rate': 2.6432315199710827e-06, 'epoch': 1.82} {'loss': 0.4462, 'learning_rate': 2.6405205132839332e-06, 'epoch': 1.82} {'loss': 0.5005, 'learning_rate': 2.6378095065967834e-06, 'epoch': 1.82} {'loss': 0.7214, 'learning_rate': 2.6350984999096335e-06, 'epoch': 1.82} {'loss': 0.428, 'learning_rate': 2.6323874932224836e-06, 'epoch': 1.82} {'loss': 0.5308, 'learning_rate': 2.6296764865353338e-06, 'epoch': 1.82} {'loss': 0.2224, 'learning_rate': 2.626965479848184e-06, 'epoch': 1.82} {'loss': 1.0586, 'learning_rate': 2.624254473161034e-06, 'epoch': 1.83} {'loss': 0.4583, 'learning_rate': 2.621543466473884e-06, 'epoch': 1.83} {'loss': 0.4739, 'learning_rate': 2.6188324597867343e-06, 'epoch': 1.83} {'loss': 1.1552, 'learning_rate': 2.616121453099584e-06, 'epoch': 1.83} {'loss': 0.7765, 'learning_rate': 2.613410446412434e-06, 'epoch': 1.83} {'loss': 0.9269, 'learning_rate': 2.6106994397252847e-06, 'epoch': 1.83} {'loss': 0.4049, 'learning_rate': 2.607988433038135e-06, 'epoch': 1.83} {'loss': 0.6263, 'learning_rate': 2.605277426350985e-06, 'epoch': 1.83} {'loss': 0.6983, 'learning_rate': 2.602566419663835e-06, 'epoch': 1.83} {'loss': 0.7949, 'learning_rate': 2.5998554129766852e-06, 'epoch': 1.83} {'loss': 0.6087, 'learning_rate': 2.5971444062895354e-06, 'epoch': 1.83} {'loss': 0.4151, 'learning_rate': 2.5944333996023855e-06, 'epoch': 1.83} {'loss': 0.4637, 'learning_rate': 2.5917223929152356e-06, 'epoch': 1.83} {'loss': 0.8294, 'learning_rate': 2.5890113862280858e-06, 'epoch': 1.83} {'loss': 0.5237, 'learning_rate': 2.586300379540936e-06, 'epoch': 1.83} {'loss': 0.7152, 'learning_rate': 2.5835893728537865e-06, 'epoch': 1.83} {'loss': 0.2683, 'learning_rate': 2.5808783661666366e-06, 'epoch': 1.83} {'loss': 0.4688, 'learning_rate': 2.5781673594794867e-06, 'epoch': 1.83} {'loss': 0.9487, 'learning_rate': 2.575456352792337e-06, 'epoch': 1.83} {'loss': 0.7854, 'learning_rate': 2.572745346105187e-06, 'epoch': 1.83} {'loss': 0.5271, 'learning_rate': 2.570034339418037e-06, 'epoch': 1.83} {'loss': 0.3126, 'learning_rate': 2.5673233327308873e-06, 'epoch': 1.83} {'loss': 0.8192, 'learning_rate': 2.5646123260437374e-06, 'epoch': 1.83} {'loss': 1.3328, 'learning_rate': 2.5619013193565875e-06, 'epoch': 1.83} {'loss': 0.6665, 'learning_rate': 2.5591903126694377e-06, 'epoch': 1.83} {'loss': 0.5691, 'learning_rate': 2.5564793059822882e-06, 'epoch': 1.83} {'loss': 1.0675, 'learning_rate': 2.5537682992951384e-06, 'epoch': 1.83} {'loss': 0.4912, 'learning_rate': 2.5510572926079885e-06, 'epoch': 1.83} {'loss': 0.7314, 'learning_rate': 2.5483462859208386e-06, 'epoch': 1.83} {'loss': 0.9095, 'learning_rate': 2.5456352792336888e-06, 'epoch': 1.83} {'loss': 0.5296, 'learning_rate': 2.542924272546539e-06, 'epoch': 1.83} {'loss': 0.4498, 'learning_rate': 2.540213265859389e-06, 'epoch': 1.83} {'loss': 0.542, 'learning_rate': 2.537502259172239e-06, 'epoch': 1.83} {'loss': 0.5898, 'learning_rate': 2.5347912524850893e-06, 'epoch': 1.83} {'loss': 0.4028, 'learning_rate': 2.5320802457979394e-06, 'epoch': 1.83} {'loss': 1.0224, 'learning_rate': 2.5293692391107896e-06, 'epoch': 1.83} {'loss': 0.884, 'learning_rate': 2.52665823242364e-06, 'epoch': 1.83} {'loss': 0.634, 'learning_rate': 2.5239472257364903e-06, 'epoch': 1.83} {'loss': 1.1597, 'learning_rate': 2.5212362190493404e-06, 'epoch': 1.83} {'loss': 0.52, 'learning_rate': 2.5185252123621905e-06, 'epoch': 1.83} {'loss': 0.4592, 'learning_rate': 2.5158142056750407e-06, 'epoch': 1.83} {'loss': 0.3364, 'learning_rate': 2.513103198987891e-06, 'epoch': 1.83} {'loss': 0.4622, 'learning_rate': 2.510392192300741e-06, 'epoch': 1.83} {'loss': 0.3739, 'learning_rate': 2.507681185613591e-06, 'epoch': 1.83} {'loss': 1.4028, 'learning_rate': 2.504970178926441e-06, 'epoch': 1.83} {'loss': 0.3801, 'learning_rate': 2.5022591722392913e-06, 'epoch': 1.83} {'loss': 0.6635, 'learning_rate': 2.499548165552142e-06, 'epoch': 1.83} {'loss': 0.3824, 'learning_rate': 2.496837158864992e-06, 'epoch': 1.83} 92%|█████████▏| 10146/11066 [37:12<03:23, 4.52it/s] 92%|█████████▏| 10147/11066 [37:12<03:20, 4.59it/s] 92%|█████████▏| 10147/11066 [37:12<03:20, 4.59it/s] 92%|█████████▏| 10148/11066 [37:12<03:18, 4.62it/s] 92%|█████████▏| 10148/11066 [37:12<03:18, 4.62it/s] 92%|█████████▏| 10149/11066 [37:12<03:17, 4.65it/s] 92%|█████████▏| 10149/11066 [37:12<03:17, 4.65it/s] 92%|█████████▏| 10150/11066 [37:13<03:15, 4.70it/s] 92%|█████████▏| 10150/11066 [37:13<03:15, 4.70it/s] 92%|█████████▏| 10151/11066 [37:13<03:18, 4.62it/s] 92%|█████████▏| 10151/11066 [37:13<03:18, 4.62it/s] 92%|█████████▏| 10152/11066 [37:13<03:17, 4.62it/s] 92%|█████████▏| 10152/11066 [37:13<03:17, 4.62it/s] 92%|█████████▏| 10153/11066 [37:13<03:18, 4.59it/s] 92%|█████████▏| 10153/11066 [37:13<03:18, 4.59it/s] 92%|█████████▏| 10154/11066 [37:14<03:20, 4.55it/s] 92%|█████████▏| 10154/11066 [37:14<03:20, 4.55it/s] 92%|█████████▏| 10155/11066 [37:14<03:21, 4.52it/s] 92%|█████████▏| 10155/11066 [37:14<03:21, 4.52it/s] 92%|█████████▏| 10156/11066 [37:14<03:21, 4.51it/s] 92%|█████████▏| 10156/11066 [37:14<03:21, 4.51it/s] 92%|█████████▏| 10157/11066 [37:14<03:20, 4.54it/s] 92%|█████████▏| 10157/11066 [37:14<03:20, 4.54it/s] 92%|█████████▏| 10158/11066 [37:14<03:18, 4.56it/s] 92%|█████████▏| 10158/11066 [37:14<03:18, 4.56it/s] 92%|█████████▏| 10159/11066 [37:15<03:18, 4.58it/s] 92%|█████████▏| 10159/11066 [37:15<03:18, 4.58it/s] 92%|█████████▏| 10160/11066 [37:15<03:17, 4.58it/s] 92%|█████████▏| 10160/11066 [37:15<03:17, 4.58it/s] 92%|█████████▏| 10161/11066 [37:15<03:15, 4.62it/s] 92%|█████████▏| 10161/11066 [37:15<03:15, 4.62it/s] 92%|█████████▏| 10162/11066 [37:15<03:17, 4.59it/s] 92%|█████████▏| 10162/11066 [37:15<03:17, 4.59it/s] 92%|█████████▏| 10163/11066 [37:16<03:18, 4.55it/s] 92%|█████████▏| 10163/11066 [37:16<03:18, 4.55it/s] 92%|█████████▏| 10164/11066 [37:16<03:16, 4.60it/s] 92%|█████████▏| 10164/11066 [37:16<03:16, 4.60it/s] 92%|█████████▏| 10165/11066 [37:16<03:17, 4.57it/s] 92%|█████████▏| 10165/11066 [37:16<03:17, 4.57it/s] 92%|█████████▏| 10166/11066 [37:16<03:17, 4.55it/s] 92%|█████████▏| 10166/11066 [37:16<03:17, 4.55it/s] 92%|█████████▏| 10167/11066 [37:16<03:18, 4.53it/s] 92%|█████████▏| 10167/11066 [37:16<03:18, 4.53it/s] 92%|█████████▏| 10168/11066 [37:17<03:18, 4.53it/s] 92%|█████████▏| 10168/11066 [37:17<03:18, 4.53it/s] 92%|█████████▏| 10169/11066 [37:17<03:18, 4.52it/s] 92%|█████████▏| 10169/11066 [37:17<03:18, 4.52it/s] 92%|█████████▏| 10170/11066 [37:17<03:16, 4.55it/s] 92%|█████████▏| 10170/11066 [37:17<03:16, 4.55it/s] 92%|█████████▏| 10171/11066 [37:17<03:18, 4.52it/s] 92%|█████████▏| 10171/11066 [37:17<03:18, 4.52it/s] 92%|█████████▏| 10172/11066 [37:18<03:18, 4.51it/s] 92%|█████████▏| 10172/11066 [37:18<03:18, 4.51it/s] 92%|█████████▏| 10173/11066 [37:18<03:15, 4.56it/s] 92%|█████████▏| 10173/11066 [37:18<03:15, 4.56it/s] 92%|█████████▏| 10174/11066 [37:18<03:16, 4.54it/s] 92%|█████████▏| 10174/11066 [37:18<03:16, 4.54it/s] 92%|█████████▏| 10175/11066 [37:18<03:13, 4.59it/s] 92%|█████████▏| 10175/11066 [37:18<03:13, 4.59it/s] 92%|█████████▏| 10176/11066 [37:18<03:14, 4.57it/s] 92%|█████████▏| 10176/11066 [37:18<03:14, 4.57it/s] 92%|█████████▏| 10177/11066 [37:19<03:12, 4.61it/s] 92%|█████████▏| 10177/11066 [37:19<03:12, 4.61it/s] 92%|█████████▏| 10178/11066 [37:19<03:10, 4.66it/s] 92%|█████████▏| 10178/11066 [37:19<03:10, 4.66it/s] 92%|█████████▏| 10179/11066 [37:19<03:13, 4.59it/s] 92%|█████████▏| 10179/11066 [37:19<03:13, 4.59it/s] 92%|█████████▏| 10180/11066 [37:19<03:12, 4.60it/s] 92%|█████████▏| 10180/11066 [37:19<03:12, 4.60it/s] 92%|█████████▏| 10181/11066 [37:19<03:11, 4.62it/s] 92%|█████████▏| 10181/11066 [37:19<03:11, 4.62it/s] 92%|█████████▏| 10182/11066 [37:20<03:11, 4.61it/s] 92%|█████████▏| 10182/11066 [37:20<03:11, 4.61it/s] 92%|█████████▏| 10183/11066 [37:20<03:10, 4.63it/s] 92%|█████████▏| 10183/11066 [37:20<03:10, 4.63it/s] 92%|█████████▏| 10184/11066 [37:20<03:11, 4.61it/s] 92%|█████████▏| 10184/11066 [37:20<03:11, 4.61it/s] 92%|█████████▏| 10185/11066 [37:20<03:09, 4.64it/s] 92%|█████████▏| 10185/11066 [37:20<03:09, 4.64it/s] 92%|█████████▏| 10186/11066 [37:21<03:08, 4.66it/s] 92%|█████████▏| 10186/11066 [37:21<03:08, 4.66it/s] 92%|█████████▏| 10187/11066 [37:21<03:09, 4.63it/s] 92%|█████████▏| 10187/11066 [37:21<03:09, 4.63it/s] 92%|█████████▏| 10188/11066 [37:21<03:10, 4.60it/s] 92%|█████████▏| 10188/11066 [37:21<03:10, 4.60it/s] 92%|█████████▏| 10189/11066 [37:21<03:11, 4.57it/s] 92%|█████████▏| 10189/11066 [37:21<03:11, 4.57it/s] 92%|█████████▏| 10190/11066 [37:21<03:12, 4.55it/s] 92%|█████████▏| 10190/11066 [37:21<03:12, 4.55it/s] 92%|█████████▏| 10191/11066 [37:22<03:12, 4.54it/s] 92%|█████████▏| 10191/11066 [37:22<03:12, 4.54it/s] 92%|█████████▏| 10192/11066 [37:22<03:10, 4.59it/s] 92%|█████████▏| 10192/11066 [37:22<03:10, 4.59it/s] 92%|█████████▏| 10193/11066 [37:22<03:09, 4.60it/s] 92%|█████████▏| 10193/11066 [37:22<03:09, 4.60it/s] 92%|█████████▏| 10194/11066 [37:22<03:09, 4.59it/s] 92%|█████████▏| 10194/11066 [37:22<03:09, 4.59it/s] 92%|█████████▏| 10195/11066 [37:23<03:08, 4.63it/s] 92%|█████████▏| 10195/11066 [37:23<03:08, 4.63it/s] 92%|█████████▏| 10196/11066 [37:23<03:09, 4.58it/s] 92%|█████████▏| 10196/11066 [37:23<03:09, 4.58it/s] 92%|█████████▏| 10197/11066 [37:23<03:10, 4.57it/s] 92%|█████████▏| 10197/11066 [37:23<03:10, 4.57it/s] 92%|█████████▏| 10198/11066 [37:23<03:09, 4.59it/s] 92%|█████████▏| 10198/11066 [37:23<03:09, 4.59it/s] 92%|█████████▏| 10199/11066 [37:23<03:08, 4.61it/s] 92%|█████████▏| 10199/11066 [37:23<03:08, 4.61it/s] 92%|█████████▏| 10200/11066 [37:24<03:08, 4.60it/s] 92%|█████████▏| 10200/11066 [37:24<03:08, 4.60it/s] 92%|█████████▏| 10201/11066 [37:24<03:06, 4.63it/s] 92%|█████████▏| 10201/11066 [37:24<03:06, 4.63it/s] 92%|█████████▏| 10202/11066 [37:24<03:05, 4.65it/s] 92%|█████████▏| 10202/11066 [37:24<03:05, 4.65it/s] 92%|█████████▏| 10203/11066 [37:24<03:05, 4.65it/s] 92%|█████████▏| 10203/11066 [37:24<03:05, 4.65it/s] 92%|█████████▏| 10204/11066 [37:24<03:06, 4.63it/s] 92%|█████████▏| 10204/11066 [37:24<03:06, 4.63it/s] 92%|█████████▏| 10205/11066 [37:25<03:05, 4.64it/s] 92%|█████████▏| 10205/11066 [37:25<03:05, 4.64it/s] 92%|█████████▏| 10206/11066 [37:25<03:08, 4.57it/s] 92%|█████████▏| 10206/11066 [37:25<03:08, 4.57it/s] 92%|█████████▏| 10207/11066 [37:25<03:07, 4.58it/s] 92%|█████████▏| 10207/11066 [37:25<03:07, 4.58it/s] 92%|█████████▏| 10208/11066 [37:25<03:12, 4.45it/s] 92%|█████████▏| 10208/11066 [37:25<03:12, 4.45it/s] 92%|█████████▏| 10209/11066 [37:26<03:12, 4.45it/s] 92%|█████████▏| 10209/11066 [37:26<03:12, 4.45it/s] 92%|█████████▏| 10210/11066 [37:26<03:12, 4.44it/s] 92%|█████████▏| 10210/11066 [37:26<03:12, 4.44it/s] 92%|█████████▏| 10211/11066 [37:26<03:12, 4.44it/s] 92%|█████████▏| 10211/11066 [37:26<03:12, 4.44it/s] 92%|█████████▏| 10212/11066 [37:26<03:11, 4.46it/s] 92%|█████████▏| 10212/11066 [37:26<03:11, 4.46it/s] 92%|█████████▏| 10213/11066 [37:26<03:09, 4.50it/s] 92%|█████████▏| 10213/11066 [37:26<03:09, 4.50it/s] 92%|█████████▏| 10214/11066 [37:27<03:10, 4.48it/s] 92%|█████████▏| 10214/11066 [37:27<03:10, 4.48it/s] 92%|█████████▏| 10215/11066 [37:27<03:10, 4.48it/s] 92%|█████████▏| 10215/11066 [37:27<03:10, 4.48it/s] 92%|█████████▏| 10216/11066 [37:27<03:08, 4.52it/s] 92%|█████████▏| 10216/11066 [37:27<03:08, 4.52it/s] 92%|█████████▏| 10217/11066 [37:27<03:06, 4.56it/s] 92%|█████████▏| 10217/11066 [37:27<03:06, 4.56it/s] 92%|█████████▏| 10218/11066 [37:28<03:05, 4.57it/s] 92%|█████████▏| 10218/11066 [37:28<03:05, 4.57it/s] 92%|█████████▏| 10219/11066 [37:28<03:03, 4.63it/s] 92%|█████████▏| 10219/11066 [37:28<03:03, 4.63it/s] 92%|█████████▏| 10220/11066 [37:28<03:04, 4.58it/s] 92%|█████████▏| 10220/11066 [37:28<03:04, 4.58it/s] 92%|█████████▏| 10221/11066 [37:28<03:04, 4.59it/s] 92%|█████████▏| 10221/11066 [37:28<03:04, 4.59it/s] 92%|█████████▏| 10222/11066 [37:28<03:05, 4.55it/s] 92%|█████████▏| 10222/11066 [37:28<03:05, 4.55it/s] 92%|█████████▏| 10223/11066 [37:29<03:04, 4.56it/s] 92%|█████████▏| 10223/11066 [37:29<03:04, 4.56it/s] 92%|█████████▏| 10224/11066 [37:29<03:05, 4.53it/s] 92%|█████████▏| 10224/11066 [37:29<03:05, 4.53it/s] 92%|█████████▏| 10225/11066 [37:29<03:05, 4.54it/s] 92%|█████████▏| 10225/11066 [37:29<03:05, 4.54it/s] 92%|█████████▏| 10226/11066 [37:29<03:03, 4.57it/s] 92%|█████████▏| 10226/11066 [37:29<03:03, 4.57it/s] 92%|█████████▏| 10227/11066 [37:30<03:02, 4.59it/s] 92%|█████████▏| 10227/11066 [37:30<03:02, 4.59it/s] 92%|█████████▏| 10228/11066 [37:30<03:03, 4.58it/s] 92%|█████████▏| 10228/11066 [37:30<03:03, 4.58it/s] 92%|█████████▏| 10229/11066 [37:30<03:02, 4.58it/s] 92%|█████████▏| 10229/11066 [37:30<03:02, 4.58it/s] 92%|█████████▏| 10230/11066 [37:30<03:01, 4.61it/s] 92%|█████████▏| 10230/11066 [37:30<03:01, 4.61it/s] 92%|█████████▏| 10231/11066 [37:30<03:01, 4.60it/s] 92%|█████████▏| 10231/11066 [37:30<03:01, 4.60it/s] 92%|█████████▏| 10232/11066 [37:31<03:01, 4.61it/s] 92%|█████████▏| 10232/11066 [37:31<03:01, 4.61it/s] 92%|█████████▏| 10233/11066 [37:31<02:59, 4.64it/s] 92%|█████████▏| 10233/11066 [37:31<02:59, 4.64it/s] 92%|█████████▏| 10234/11066 [37:31<03:00, 4.60it/s] 92%|█████████▏| 10234/11066 [37:31<03:00, 4.60it/s] 92%|█████████▏| 10235/11066 [37:31<03:01, 4.58it/s] 92%|█████████▏| 10235/11066 [37:31<03:01, 4.58it/s] 92%|█████████▏| 10236/11066 [37:32<02:59, 4.62it/s] 92%|█████████▏| 10236/11066 [37:32<02:59, 4.62it/s] 93%|█████████▎| 10237/11066 [37:32<02:59, 4.62it/s] 93%|█████████▎| 10237/11066 [37:32<02:59, 4.62it/s] 93%|█████████▎| 10238/11066 [37:32<02:57, 4.66it/s] 93%|█████████▎| 10238/11066 [37:32<02:57, 4.66it/s] 93%|█████████▎| 10239/11066 [37:32<02:58, 4.63it/s] 93%|█████████▎| 10239/11066 [37:32<02:58, 4.63it/s] 93%|█████████▎| 10240/11066 [37:32<02:57, 4.65it/s] 93%|█████████▎| 10240/11066 [37:32<02:57, 4.65it/s] 93%|█████████▎| 10241/11066 [37:33<02:57, 4.66it/s] 93%|█████████▎| 10241/11066 [37:33<02:57, 4.66it/s] 93%|█████████▎| 10242/11066 [37:33<02:58, 4.63it/s] 93%|█████████▎| 10242/11066 [37:33<02:58, 4.63it/s] 93%|█████████▎| 10243/11066 [37:33<02:56, 4.65it/s] 93%|█████████▎| 10243/11066 [37:33<02:56, 4.65it/s] 93%|█████████▎| 10244/11066 [37:33<02:58, 4.60it/s] 93%|█████████▎| 10244/11066 [37:33<02:58, 4.60it/s] 93%|█████████▎| 10245/11066 [37:33<02:58, 4.59it/s] 93%|█████████▎| 10245/11066 [37:33<02:58, 4.59it/s] 93%|█████████▎| 10246/11066 [37:34<02:58, 4.60it/s] 93%|█████████▎| 10246/11066 [37:34<02:58, 4.60it/s] 93%|█████████▎| 10247/11066 [37:34<03:00, 4.55it/s] 93%|█████████▎| 10247/11066 [37:34<03:00, 4.55it/s] 93%|█████████▎| 10248/11066 [37:34<03:03, 4.46it/s] 93%|█████████▎| 10248/11066 [37:34<03:03, 4.46it/s] 93%|█████████▎| 10249/11066 [37:34<03:03, 4.46it/s] 93%|█████████▎| 10249/11066 [37:34<03:03, 4.46it/s] 93%|█████████▎| 10250/11066 [37:35<03:01, 4.50it/s] 93%|█████████▎| 10250/11066 [37:35<03:01, 4.50it/s] 93%|█████████▎| 10251/11066 [37:35<03:01, 4.49it/s] 93%|█████████▎| 10251/11066 [37:35<03:01, 4.49it/s] 93%|█████████▎| 10252/11066 [37:35<03:01, 4.49it/s] 93%|█████████▎| 10252/11066 [37:35<03:01, 4.49it/s] 93%|█████████▎| 10253/11066 [37:35<03:00, 4.49it/s] 93%|█████████▎| 10253/11066 [37:35<03:00, 4.49it/s] 93%|█████████▎| 10254/11066 [37:35<02:59, 4.53it/s] 93%|█████████▎| 10254/11066 [37:35<02:59, 4.53it/s] 93%|█████████▎| 10255/11066 [37:36<02:57, 4.57it/s] 93%|█████████▎| 10255/11066 [37:36<02:57, 4.57it/s] 93%|█████████▎| 10256/11066 [37:36<02:57, 4.57it/s] 93%|█████████▎| 10256/11066 [37:36<02:57, 4.57it/s] 93%|█████████▎| 10257/11066 [37:36<02:56, 4.58it/s] 93%|█████████▎| 10257/11066 [37:36<02:56, 4.58it/s] 93%|█████████▎| 10258/11066 [37:36<02:57, 4.55it/s] 93%|█████████▎| 10258/11066 [37:36<02:57, 4.55it/s] 93%|█████████▎| 10259/11066 [37:37<02:58, 4.53it/s] {'loss': 0.5158, 'learning_rate': 2.494126152177842e-06, 'epoch': 1.83} {'loss': 0.2677, 'learning_rate': 2.4914151454906923e-06, 'epoch': 1.83} {'loss': 1.0068, 'learning_rate': 2.4887041388035424e-06, 'epoch': 1.83} {'loss': 0.583, 'learning_rate': 2.4859931321163926e-06, 'epoch': 1.83} {'loss': 0.3757, 'learning_rate': 2.4832821254292427e-06, 'epoch': 1.83} {'loss': 0.3284, 'learning_rate': 2.480571118742093e-06, 'epoch': 1.83} {'loss': 0.4737, 'learning_rate': 2.477860112054943e-06, 'epoch': 1.83} {'loss': 0.536, 'learning_rate': 2.475149105367793e-06, 'epoch': 1.83} {'loss': 0.8751, 'learning_rate': 2.4724380986806432e-06, 'epoch': 1.84} {'loss': 0.3968, 'learning_rate': 2.469727091993494e-06, 'epoch': 1.84} {'loss': 0.4115, 'learning_rate': 2.467016085306344e-06, 'epoch': 1.84} {'loss': 0.4183, 'learning_rate': 2.464305078619194e-06, 'epoch': 1.84} {'loss': 0.6838, 'learning_rate': 2.461594071932044e-06, 'epoch': 1.84} {'loss': 0.6603, 'learning_rate': 2.4588830652448943e-06, 'epoch': 1.84} {'loss': 1.2613, 'learning_rate': 2.4561720585577445e-06, 'epoch': 1.84} {'loss': 0.7936, 'learning_rate': 2.4534610518705946e-06, 'epoch': 1.84} {'loss': 0.7797, 'learning_rate': 2.4507500451834447e-06, 'epoch': 1.84} {'loss': 0.8824, 'learning_rate': 2.448039038496295e-06, 'epoch': 1.84} {'loss': 0.3982, 'learning_rate': 2.445328031809145e-06, 'epoch': 1.84} {'loss': 0.4417, 'learning_rate': 2.4426170251219956e-06, 'epoch': 1.84} {'loss': 1.0556, 'learning_rate': 2.4399060184348457e-06, 'epoch': 1.84} {'loss': 0.6784, 'learning_rate': 2.437195011747696e-06, 'epoch': 1.84} {'loss': 0.7968, 'learning_rate': 2.434484005060546e-06, 'epoch': 1.84} {'loss': 0.6599, 'learning_rate': 2.431772998373396e-06, 'epoch': 1.84} {'loss': 0.6369, 'learning_rate': 2.4290619916862462e-06, 'epoch': 1.84} {'loss': 0.7848, 'learning_rate': 2.4263509849990964e-06, 'epoch': 1.84} {'loss': 0.3059, 'learning_rate': 2.4236399783119465e-06, 'epoch': 1.84} {'loss': 0.8157, 'learning_rate': 2.4209289716247966e-06, 'epoch': 1.84} {'loss': 0.4453, 'learning_rate': 2.4182179649376468e-06, 'epoch': 1.84} {'loss': 0.6609, 'learning_rate': 2.415506958250497e-06, 'epoch': 1.84} {'loss': 1.077, 'learning_rate': 2.4127959515633475e-06, 'epoch': 1.84} {'loss': 1.32, 'learning_rate': 2.4100849448761976e-06, 'epoch': 1.84} {'loss': 0.5393, 'learning_rate': 2.4073739381890477e-06, 'epoch': 1.84} {'loss': 0.3613, 'learning_rate': 2.404662931501898e-06, 'epoch': 1.84} {'loss': 0.5274, 'learning_rate': 2.401951924814748e-06, 'epoch': 1.84} {'loss': 0.4968, 'learning_rate': 2.399240918127598e-06, 'epoch': 1.84} {'loss': 0.8655, 'learning_rate': 2.3965299114404483e-06, 'epoch': 1.84} {'loss': 0.5843, 'learning_rate': 2.3938189047532984e-06, 'epoch': 1.84} {'loss': 1.7945, 'learning_rate': 2.3911078980661485e-06, 'epoch': 1.84} {'loss': 0.5788, 'learning_rate': 2.3883968913789987e-06, 'epoch': 1.84} {'loss': 1.0592, 'learning_rate': 2.3856858846918492e-06, 'epoch': 1.84} {'loss': 0.8104, 'learning_rate': 2.3829748780046994e-06, 'epoch': 1.84} {'loss': 0.4367, 'learning_rate': 2.3802638713175495e-06, 'epoch': 1.84} {'loss': 0.5262, 'learning_rate': 2.3775528646303996e-06, 'epoch': 1.84} {'loss': 0.6155, 'learning_rate': 2.3748418579432498e-06, 'epoch': 1.84} {'loss': 0.4759, 'learning_rate': 2.3721308512561e-06, 'epoch': 1.84} {'loss': 0.8325, 'learning_rate': 2.36941984456895e-06, 'epoch': 1.84} {'loss': 0.8629, 'learning_rate': 2.3667088378818e-06, 'epoch': 1.84} {'loss': 0.2424, 'learning_rate': 2.3639978311946503e-06, 'epoch': 1.84} {'loss': 0.3772, 'learning_rate': 2.3612868245075004e-06, 'epoch': 1.84} {'loss': 1.3057, 'learning_rate': 2.358575817820351e-06, 'epoch': 1.84} {'loss': 0.6996, 'learning_rate': 2.355864811133201e-06, 'epoch': 1.84} {'loss': 0.4544, 'learning_rate': 2.3531538044460513e-06, 'epoch': 1.84} {'loss': 0.7745, 'learning_rate': 2.3504427977589014e-06, 'epoch': 1.84} {'loss': 0.9951, 'learning_rate': 2.3477317910717515e-06, 'epoch': 1.84} {'loss': 0.4146, 'learning_rate': 2.3450207843846017e-06, 'epoch': 1.84} {'loss': 1.0268, 'learning_rate': 2.342309777697452e-06, 'epoch': 1.84} {'loss': 0.3592, 'learning_rate': 2.339598771010302e-06, 'epoch': 1.84} {'loss': 0.8202, 'learning_rate': 2.336887764323152e-06, 'epoch': 1.84} {'loss': 0.5084, 'learning_rate': 2.334176757636002e-06, 'epoch': 1.84} {'loss': 0.9406, 'learning_rate': 2.3314657509488523e-06, 'epoch': 1.84} {'loss': 0.4275, 'learning_rate': 2.328754744261703e-06, 'epoch': 1.84} {'loss': 1.1973, 'learning_rate': 2.326043737574553e-06, 'epoch': 1.84} {'loss': 0.6664, 'learning_rate': 2.323332730887403e-06, 'epoch': 1.85} {'loss': 0.3191, 'learning_rate': 2.3206217242002533e-06, 'epoch': 1.85} {'loss': 0.6007, 'learning_rate': 2.3179107175131034e-06, 'epoch': 1.85} {'loss': 0.5316, 'learning_rate': 2.3151997108259536e-06, 'epoch': 1.85} {'loss': 0.5509, 'learning_rate': 2.3124887041388037e-06, 'epoch': 1.85} {'loss': 0.7059, 'learning_rate': 2.309777697451654e-06, 'epoch': 1.85} {'loss': 0.8001, 'learning_rate': 2.307066690764504e-06, 'epoch': 1.85} {'loss': 0.3329, 'learning_rate': 2.304355684077354e-06, 'epoch': 1.85} {'loss': 0.784, 'learning_rate': 2.3016446773902047e-06, 'epoch': 1.85} {'loss': 0.6883, 'learning_rate': 2.298933670703055e-06, 'epoch': 1.85} {'loss': 0.5989, 'learning_rate': 2.296222664015905e-06, 'epoch': 1.85} {'loss': 0.5002, 'learning_rate': 2.293511657328755e-06, 'epoch': 1.85} {'loss': 1.1605, 'learning_rate': 2.290800650641605e-06, 'epoch': 1.85} {'loss': 0.5619, 'learning_rate': 2.2880896439544553e-06, 'epoch': 1.85} {'loss': 0.4224, 'learning_rate': 2.2853786372673055e-06, 'epoch': 1.85} {'loss': 0.731, 'learning_rate': 2.2826676305801556e-06, 'epoch': 1.85} {'loss': 0.5458, 'learning_rate': 2.2799566238930057e-06, 'epoch': 1.85} {'loss': 0.7749, 'learning_rate': 2.277245617205856e-06, 'epoch': 1.85} {'loss': 0.9102, 'learning_rate': 2.274534610518706e-06, 'epoch': 1.85} {'loss': 0.7312, 'learning_rate': 2.2718236038315566e-06, 'epoch': 1.85} {'loss': 1.3478, 'learning_rate': 2.2691125971444067e-06, 'epoch': 1.85} {'loss': 0.5408, 'learning_rate': 2.2664015904572564e-06, 'epoch': 1.85} {'loss': 0.8135, 'learning_rate': 2.2636905837701065e-06, 'epoch': 1.85} {'loss': 0.4361, 'learning_rate': 2.2609795770829567e-06, 'epoch': 1.85} {'loss': 0.49, 'learning_rate': 2.258268570395807e-06, 'epoch': 1.85} {'loss': 1.2824, 'learning_rate': 2.255557563708657e-06, 'epoch': 1.85} {'loss': 0.4797, 'learning_rate': 2.252846557021507e-06, 'epoch': 1.85} {'loss': 0.9736, 'learning_rate': 2.250135550334357e-06, 'epoch': 1.85} {'loss': 0.4713, 'learning_rate': 2.2474245436472073e-06, 'epoch': 1.85} {'loss': 1.0805, 'learning_rate': 2.244713536960058e-06, 'epoch': 1.85} {'loss': 1.7266, 'learning_rate': 2.242002530272908e-06, 'epoch': 1.85} {'loss': 0.2307, 'learning_rate': 2.239291523585758e-06, 'epoch': 1.85} {'loss': 0.3809, 'learning_rate': 2.2365805168986083e-06, 'epoch': 1.85} {'loss': 0.4033, 'learning_rate': 2.2338695102114584e-06, 'epoch': 1.85} {'loss': 0.4056, 'learning_rate': 2.2311585035243086e-06, 'epoch': 1.85} {'loss': 1.0608, 'learning_rate': 2.2284474968371587e-06, 'epoch': 1.85} {'loss': 0.494, 'learning_rate': 2.225736490150009e-06, 'epoch': 1.85} {'loss': 1.5838, 'learning_rate': 2.223025483462859e-06, 'epoch': 1.85} {'loss': 0.7595, 'learning_rate': 2.220314476775709e-06, 'epoch': 1.85} {'loss': 0.4973, 'learning_rate': 2.2176034700885597e-06, 'epoch': 1.85} {'loss': 0.9759, 'learning_rate': 2.21489246340141e-06, 'epoch': 1.85} {'loss': 0.6064, 'learning_rate': 2.21218145671426e-06, 'epoch': 1.85} {'loss': 0.528, 'learning_rate': 2.20947045002711e-06, 'epoch': 1.85} {'loss': 0.836, 'learning_rate': 2.20675944333996e-06, 'epoch': 1.85} {'loss': 0.8167, 'learning_rate': 2.2040484366528103e-06, 'epoch': 1.85} {'loss': 0.5798, 'learning_rate': 2.2013374299656605e-06, 'epoch': 1.85} {'loss': 0.8744, 'learning_rate': 2.1986264232785106e-06, 'epoch': 1.85} {'loss': 0.778, 'learning_rate': 2.1959154165913607e-06, 'epoch': 1.85} {'loss': 0.7563, 'learning_rate': 2.193204409904211e-06, 'epoch': 1.85} {'loss': 0.9175, 'learning_rate': 2.190493403217061e-06, 'epoch': 1.85} 93%|█████████▎| 10259/11066 [37:37<02:58, 4.53it/s] 93%|█████████▎| 10260/11066 [37:37<02:58, 4.51it/s] 93%|█████████▎| 10260/11066 [37:37<02:58, 4.51it/s] 93%|█████████▎| 10261/11066 [37:37<03:00, 4.47it/s] 93%|█████████▎| 10261/11066 [37:37<03:00, 4.47it/s] 93%|█████████▎| 10262/11066 [37:37<02:59, 4.47it/s] 93%|█████████▎| 10262/11066 [37:37<02:59, 4.47it/s] 93%|█████████▎| 10263/11066 [37:37<02:58, 4.51it/s] 93%|█████████▎| 10263/11066 [37:37<02:58, 4.51it/s] 93%|█████████▎| 10264/11066 [37:38<02:56, 4.55it/s] 93%|█████████▎| 10264/11066 [37:38<02:56, 4.55it/s] 93%|█████████▎| 10265/11066 [37:38<02:55, 4.57it/s] 93%|█████████▎| 10265/11066 [37:38<02:55, 4.57it/s] 93%|█████████▎| 10266/11066 [37:38<02:53, 4.60it/s] 93%|█████████▎| 10266/11066 [37:38<02:53, 4.60it/s] 93%|█████████▎| 10267/11066 [37:38<02:52, 4.63it/s] 93%|█████████▎| 10267/11066 [37:38<02:52, 4.63it/s] 93%|█████████▎| 10268/11066 [37:39<02:52, 4.63it/s] 93%|█████████▎| 10268/11066 [37:39<02:52, 4.63it/s] 93%|█████████▎| 10269/11066 [37:39<02:53, 4.58it/s] 93%|█████████▎| 10269/11066 [37:39<02:53, 4.58it/s] 93%|█████████▎| 10270/11066 [37:39<02:54, 4.56it/s] 93%|█████████▎| 10270/11066 [37:39<02:54, 4.56it/s] 93%|█████████▎| 10271/11066 [37:39<02:53, 4.57it/s] 93%|█████████▎| 10271/11066 [37:39<02:53, 4.57it/s] 93%|█████████▎| 10272/11066 [37:39<02:52, 4.61it/s] 93%|█████████▎| 10272/11066 [37:39<02:52, 4.61it/s] 93%|█████████▎| 10273/11066 [37:40<02:51, 4.63it/s] 93%|█████████▎| 10273/11066 [37:40<02:51, 4.63it/s] 93%|█████████▎| 10274/11066 [37:40<02:53, 4.57it/s] 93%|█████████▎| 10274/11066 [37:40<02:53, 4.57it/s] 93%|█████████▎| 10275/11066 [37:40<02:53, 4.57it/s] 93%|█████████▎| 10275/11066 [37:40<02:53, 4.57it/s] 93%|█████████▎| 10276/11066 [37:40<02:52, 4.58it/s] 93%|█████████▎| 10276/11066 [37:40<02:52, 4.58it/s] 93%|█████████▎| 10277/11066 [37:40<02:51, 4.59it/s] 93%|█████████▎| 10277/11066 [37:40<02:51, 4.59it/s] 93%|█████████▎| 10278/11066 [37:41<02:53, 4.55it/s] 93%|█████████▎| 10278/11066 [37:41<02:53, 4.55it/s] 93%|█████████▎| 10279/11066 [37:41<02:54, 4.52it/s] 93%|█████████▎| 10279/11066 [37:41<02:54, 4.52it/s] 93%|█████████▎| 10280/11066 [37:41<02:54, 4.51it/s] 93%|█████████▎| 10280/11066 [37:41<02:54, 4.51it/s] 93%|█████████▎| 10281/11066 [37:41<02:53, 4.54it/s] 93%|█████████▎| 10281/11066 [37:41<02:53, 4.54it/s] 93%|█████████▎| 10282/11066 [37:42<02:53, 4.51it/s] 93%|█████████▎| 10282/11066 [37:42<02:53, 4.51it/s] 93%|█████████▎| 10283/11066 [37:42<02:52, 4.53it/s] 93%|█████████▎| 10283/11066 [37:42<02:52, 4.53it/s] 93%|█████████▎| 10284/11066 [37:42<02:50, 4.58it/s] 93%|█████████▎| 10284/11066 [37:42<02:50, 4.58it/s] 93%|█████████▎| 10285/11066 [37:42<02:49, 4.62it/s] 93%|█████████▎| 10285/11066 [37:42<02:49, 4.62it/s] 93%|█████████▎| 10286/11066 [37:42<02:50, 4.58it/s] 93%|█████████▎| 10286/11066 [37:42<02:50, 4.58it/s] 93%|█████████▎| 10287/11066 [37:43<02:51, 4.53it/s] 93%|█████████▎| 10287/11066 [37:43<02:51, 4.53it/s] 93%|█████████▎| 10288/11066 [37:43<02:50, 4.57it/s] 93%|█████████▎| 10288/11066 [37:43<02:50, 4.57it/s] 93%|█████████▎| 10289/11066 [37:43<02:49, 4.59it/s] 93%|█████████▎| 10289/11066 [37:43<02:49, 4.59it/s] 93%|█████████▎| 10290/11066 [37:43<02:49, 4.57it/s] 93%|█████████▎| 10290/11066 [37:43<02:49, 4.57it/s] 93%|█████████▎| 10291/11066 [37:44<02:48, 4.61it/s] 93%|█████████▎| 10291/11066 [37:44<02:48, 4.61it/s] 93%|█████████▎| 10292/11066 [37:44<02:47, 4.63it/s] 93%|█████████▎| 10292/11066 [37:44<02:47, 4.63it/s] 93%|█████████▎| 10293/11066 [37:44<02:46, 4.65it/s] 93%|█████████▎| 10293/11066 [37:44<02:46, 4.65it/s] 93%|█████████▎| 10294/11066 [37:44<02:46, 4.63it/s] 93%|█████████▎| 10294/11066 [37:44<02:46, 4.63it/s] 93%|█████████▎| 10295/11066 [37:44<02:48, 4.59it/s] 93%|█████████▎| 10295/11066 [37:44<02:48, 4.59it/s] 93%|█████████▎| 10296/11066 [37:45<02:48, 4.57it/s] 93%|█████████▎| 10296/11066 [37:45<02:48, 4.57it/s] 93%|█████████▎| 10297/11066 [37:45<02:48, 4.55it/s] 93%|█████████▎| 10297/11066 [37:45<02:48, 4.55it/s] 93%|█████████▎| 10298/11066 [37:45<02:47, 4.57it/s] 93%|█████████▎| 10298/11066 [37:45<02:47, 4.57it/s] 93%|█████████▎| 10299/11066 [37:45<02:49, 4.54it/s] 93%|█████████▎| 10299/11066 [37:45<02:49, 4.54it/s] 93%|█████████▎| 10300/11066 [37:46<02:49, 4.51it/s] 93%|█████████▎| 10300/11066 [37:46<02:49, 4.51it/s] 93%|█████████▎| 10301/11066 [37:46<02:49, 4.51it/s] 93%|█████████▎| 10301/11066 [37:46<02:49, 4.51it/s] 93%|█████████▎| 10302/11066 [37:46<02:49, 4.50it/s] 93%|█████████▎| 10302/11066 [37:46<02:49, 4.50it/s] 93%|█████████▎| 10303/11066 [37:46<02:49, 4.49it/s] 93%|█████████▎| 10303/11066 [37:46<02:49, 4.49it/s] 93%|█████████▎| 10304/11066 [37:46<02:49, 4.50it/s] 93%|█████████▎| 10304/11066 [37:46<02:49, 4.50it/s] 93%|█████████▎| 10305/11066 [37:47<02:49, 4.50it/s] 93%|█████████▎| 10305/11066 [37:47<02:49, 4.50it/s] 93%|█████████▎| 10306/11066 [37:47<02:46, 4.55it/s] 93%|█████████▎| 10306/11066 [37:47<02:46, 4.55it/s] 93%|█████████▎| 10307/11066 [37:47<02:46, 4.55it/s] 93%|█████████▎| 10307/11066 [37:47<02:46, 4.55it/s] 93%|█████████▎| 10308/11066 [37:47<02:46, 4.55it/s] 93%|█████████▎| 10308/11066 [37:47<02:46, 4.55it/s] 93%|█████████▎| 10309/11066 [37:48<02:45, 4.56it/s] 93%|█████████▎| 10309/11066 [37:48<02:45, 4.56it/s] 93%|█████████▎| 10310/11066 [37:48<02:44, 4.60it/s] 93%|█████████▎| 10310/11066 [37:48<02:44, 4.60it/s] 93%|█████████▎| 10311/11066 [37:48<02:43, 4.62it/s] 93%|█████████▎| 10311/11066 [37:48<02:43, 4.62it/s] 93%|█████████▎| 10312/11066 [37:48<02:42, 4.64it/s] 93%|█████████▎| 10312/11066 [37:48<02:42, 4.64it/s] 93%|█████████▎| 10313/11066 [37:48<02:44, 4.58it/s] 93%|█████████▎| 10313/11066 [37:48<02:44, 4.58it/s] 93%|█████████▎| 10314/11066 [37:49<02:43, 4.59it/s] 93%|█████████▎| 10314/11066 [37:49<02:43, 4.59it/s] 93%|█████████▎| 10315/11066 [37:49<02:43, 4.58it/s] 93%|█████████▎| 10315/11066 [37:49<02:43, 4.58it/s] 93%|█████████▎| 10316/11066 [37:49<02:44, 4.57it/s] 93%|█████████▎| 10316/11066 [37:49<02:44, 4.57it/s] 93%|█████████▎| 10317/11066 [37:49<02:43, 4.59it/s] 93%|█████████▎| 10317/11066 [37:49<02:43, 4.59it/s] 93%|█████████▎| 10318/11066 [37:49<02:41, 4.63it/s] 93%|█████████▎| 10318/11066 [37:49<02:41, 4.63it/s] 93%|█████████▎| 10319/11066 [37:50<02:42, 4.59it/s] 93%|█████████▎| 10319/11066 [37:50<02:42, 4.59it/s] 93%|█████████▎| 10320/11066 [37:50<02:42, 4.60it/s] 93%|█████████▎| 10320/11066 [37:50<02:42, 4.60it/s] 93%|█████████▎| 10321/11066 [37:50<02:42, 4.59it/s] 93%|█████████▎| 10321/11066 [37:50<02:42, 4.59it/s] 93%|█████████▎| 10322/11066 [37:50<02:41, 4.60it/s] 93%|█████████▎| 10322/11066 [37:50<02:41, 4.60it/s] 93%|█████████▎| 10323/11066 [37:51<02:41, 4.60it/s] 93%|█████████▎| 10323/11066 [37:51<02:41, 4.60it/s] 93%|█████████▎| 10324/11066 [37:51<02:42, 4.57it/s] 93%|█████████▎| 10324/11066 [37:51<02:42, 4.57it/s] 93%|█████████▎| 10325/11066 [37:51<02:42, 4.55it/s] 93%|█████████▎| 10325/11066 [37:51<02:42, 4.55it/s] 93%|█████████▎| 10326/11066 [37:51<02:42, 4.54it/s] 93%|█████████▎| 10326/11066 [37:51<02:42, 4.54it/s] 93%|█████████▎| 10327/11066 [37:51<02:43, 4.52it/s] 93%|█████████▎| 10327/11066 [37:51<02:43, 4.52it/s] 93%|█████████▎| 10328/11066 [37:52<02:43, 4.50it/s] 93%|█████████▎| 10328/11066 [37:52<02:43, 4.50it/s] 93%|█████████▎| 10329/11066 [37:52<02:44, 4.47it/s] 93%|█████████▎| 10329/11066 [37:52<02:44, 4.47it/s] 93%|█████████▎| 10330/11066 [37:52<02:44, 4.47it/s] 93%|█████████▎| 10330/11066 [37:52<02:44, 4.47it/s] 93%|█████████▎| 10331/11066 [37:52<02:44, 4.48it/s] 93%|█████████▎| 10331/11066 [37:52<02:44, 4.48it/s] 93%|█████████▎| 10332/11066 [37:53<02:43, 4.49it/s] 93%|█████████▎| 10332/11066 [37:53<02:43, 4.49it/s] 93%|█████████▎| 10333/11066 [37:53<02:43, 4.49it/s] 93%|█████████▎| 10333/11066 [37:53<02:43, 4.49it/s] 93%|█████████▎| 10334/11066 [37:53<02:43, 4.49it/s] 93%|█████████▎| 10334/11066 [37:53<02:43, 4.49it/s] 93%|█████████▎| 10335/11066 [37:53<02:42, 4.49it/s] 93%|█████████▎| 10335/11066 [37:53<02:42, 4.49it/s] 93%|█████████▎| 10336/11066 [37:53<02:43, 4.48it/s] 93%|█████████▎| 10336/11066 [37:53<02:43, 4.48it/s] 93%|█████████▎| 10337/11066 [37:54<02:43, 4.47it/s] 93%|█████████▎| 10337/11066 [37:54<02:43, 4.47it/s] 93%|█████████▎| 10338/11066 [37:54<02:41, 4.50it/s] 93%|█████████▎| 10338/11066 [37:54<02:41, 4.50it/s] 93%|█████████▎| 10339/11066 [37:54<02:39, 4.55it/s] 93%|█████████▎| 10339/11066 [37:54<02:39, 4.55it/s] 93%|█████████▎| 10340/11066 [37:54<02:40, 4.53it/s] 93%|█████████▎| 10340/11066 [37:54<02:40, 4.53it/s] 93%|█████████▎| 10341/11066 [37:55<02:38, 4.57it/s] 93%|█████████▎| 10341/11066 [37:55<02:38, 4.57it/s] 93%|█████████▎| 10342/11066 [37:55<02:39, 4.55it/s] 93%|█████████▎| 10342/11066 [37:55<02:39, 4.55it/s] 93%|█████████▎| 10343/11066 [37:55<02:39, 4.52it/s] 93%|█████████▎| 10343/11066 [37:55<02:39, 4.52it/s] 93%|█████████▎| 10344/11066 [37:55<02:38, 4.55it/s] 93%|█████████▎| 10344/11066 [37:55<02:38, 4.55it/s] 93%|█████████▎| 10345/11066 [37:55<02:37, 4.57it/s] 93%|█████████▎| 10345/11066 [37:55<02:37, 4.57it/s] 93%|█████████▎| 10346/11066 [37:56<02:37, 4.56it/s] 93%|█████████▎| 10346/11066 [37:56<02:37, 4.56it/s] 94%|█████████▎| 10347/11066 [37:56<02:37, 4.57it/s] 94%|█████████▎| 10347/11066 [37:56<02:37, 4.57it/s] 94%|█████████▎| 10348/11066 [37:56<02:35, 4.63it/s] 94%|█████████▎| 10348/11066 [37:56<02:35, 4.63it/s] 94%|█████████▎| 10349/11066 [37:56<02:34, 4.63it/s] 94%|█████████▎| 10349/11066 [37:56<02:34, 4.63it/s] 94%|█████████▎| 10350/11066 [37:57<02:33, 4.66it/s] 94%|█████████▎| 10350/11066 [37:57<02:33, 4.66it/s] 94%|█████████▎| 10351/11066 [37:57<02:33, 4.66it/s] 94%|█████████▎| 10351/11066 [37:57<02:33, 4.66it/s] 94%|█████████▎| 10352/11066 [37:57<02:35, 4.60it/s] 94%|█████████▎| 10352/11066 [37:57<02:35, 4.60it/s] 94%|█████████▎| 10353/11066 [37:57<02:35, 4.59it/s] 94%|█████████▎| 10353/11066 [37:57<02:35, 4.59it/s] 94%|█████████▎| 10354/11066 [37:57<02:36, 4.55it/s] 94%|█████████▎| 10354/11066 [37:57<02:36, 4.55it/s] 94%|█████████▎| 10355/11066 [37:58<02:35, 4.56it/s] 94%|█████████▎| 10355/11066 [37:58<02:35, 4.56it/s] 94%|█████████▎| 10356/11066 [37:58<02:34, 4.60it/s] 94%|█████████▎| 10356/11066 [37:58<02:34, 4.60it/s] 94%|█████████▎| 10357/11066 [37:58<02:35, 4.55it/s] 94%|█████████▎| 10357/11066 [37:58<02:35, 4.55it/s] 94%|█████████▎| 10358/11066 [37:58<02:36, 4.53it/s] 94%|█████████▎| 10358/11066 [37:58<02:36, 4.53it/s] 94%|█████████▎| 10359/11066 [37:58<02:36, 4.51it/s] 94%|█████████▎| 10359/11066 [37:59<02:36, 4.51it/s] 94%|█████████▎| 10360/11066 [37:59<02:36, 4.51it/s] 94%|█████████▎| 10360/11066 [37:59<02:36, 4.51it/s] 94%|█████████▎| 10361/11066 [37:59<02:36, 4.50it/s] 94%|█████████▎| 10361/11066 [37:59<02:36, 4.50it/s] 94%|█████████▎| 10362/11066 [37:59<02:35, 4.54it/s] 94%|█████████▎| 10362/11066 [37:59<02:35, 4.54it/s] 94%|█████████▎| 10363/11066 [37:59<02:33, 4.58it/s] 94%|█████████▎| 10363/11066 [37:59<02:33, 4.58it/s] 94%|█████████▎| 10364/11066 [38:00<02:33, 4.58it/s] 94%|█████████▎| 10364/11066 [38:00<02:33, 4.58it/s] 94%|█████████▎| 10365/11066 [38:00<02:31, 4.64it/s] 94%|█████████▎| 10365/11066 [38:00<02:31, 4.64it/s] 94%|█████████▎| 10366/11066 [38:00<02:31, 4.63it/s] 94%|█████████▎| 10366/11066 [38:00<02:31, 4.63it/s] 94%|█████████▎| 10367/11066 [38:00<02:29, 4.67it/s] 94%|█████████▎| 10367/11066 [38:00<02:29, 4.67it/s] 94%|█████████▎| 10368/11066 [38:00<02:29, 4.67it/s] 94%|█████████▎| 10368/11066 [38:00<02:29, 4.67it/s] 94%|█████████▎| 10369/11066 [38:01<02:28, 4.70it/s] 94%|█████████▎| 10369/11066 [38:01<02:28, 4.70it/s] 94%|█████████▎| 10370/11066 [38:01<02:28, 4.70it/s] 94%|█████████▎| 10370/11066 [38:01<02:28, 4.70it/s] 94%|█████████▎| 10371/11066 [38:01<02:30, 4.63it/s] 94%|█████████▎| 10371/11066 [38:01<02:30, 4.63it/s] 94%|█████████▎| 10372/11066 [38:01<02:29, 4.64it/s] {'loss': 1.2403, 'learning_rate': 2.1877823965299116e-06, 'epoch': 1.85} {'loss': 0.867, 'learning_rate': 2.1850713898427617e-06, 'epoch': 1.85} {'loss': 0.9073, 'learning_rate': 2.182360383155612e-06, 'epoch': 1.85} {'loss': 0.7223, 'learning_rate': 2.179649376468462e-06, 'epoch': 1.85} {'loss': 0.958, 'learning_rate': 2.176938369781312e-06, 'epoch': 1.85} {'loss': 0.4673, 'learning_rate': 2.1742273630941622e-06, 'epoch': 1.86} {'loss': 0.6479, 'learning_rate': 2.1715163564070124e-06, 'epoch': 1.86} {'loss': 1.4853, 'learning_rate': 2.1688053497198625e-06, 'epoch': 1.86} {'loss': 0.8926, 'learning_rate': 2.1660943430327126e-06, 'epoch': 1.86} {'loss': 0.9025, 'learning_rate': 2.1633833363455628e-06, 'epoch': 1.86} {'loss': 0.7326, 'learning_rate': 2.1606723296584133e-06, 'epoch': 1.86} {'loss': 0.6986, 'learning_rate': 2.1579613229712635e-06, 'epoch': 1.86} {'loss': 0.4974, 'learning_rate': 2.1552503162841136e-06, 'epoch': 1.86} {'loss': 0.7623, 'learning_rate': 2.1525393095969637e-06, 'epoch': 1.86} {'loss': 0.4255, 'learning_rate': 2.149828302909814e-06, 'epoch': 1.86} {'loss': 0.5093, 'learning_rate': 2.147117296222664e-06, 'epoch': 1.86} {'loss': 0.7983, 'learning_rate': 2.144406289535514e-06, 'epoch': 1.86} {'loss': 0.4706, 'learning_rate': 2.1416952828483643e-06, 'epoch': 1.86} {'loss': 1.1749, 'learning_rate': 2.1389842761612144e-06, 'epoch': 1.86} {'loss': 0.4182, 'learning_rate': 2.1362732694740645e-06, 'epoch': 1.86} {'loss': 0.9088, 'learning_rate': 2.1335622627869147e-06, 'epoch': 1.86} {'loss': 0.5313, 'learning_rate': 2.1308512560997652e-06, 'epoch': 1.86} {'loss': 1.0063, 'learning_rate': 2.1281402494126154e-06, 'epoch': 1.86} {'loss': 0.7883, 'learning_rate': 2.1254292427254655e-06, 'epoch': 1.86} {'loss': 0.5137, 'learning_rate': 2.1227182360383156e-06, 'epoch': 1.86} {'loss': 0.6751, 'learning_rate': 2.1200072293511658e-06, 'epoch': 1.86} {'loss': 0.719, 'learning_rate': 2.117296222664016e-06, 'epoch': 1.86} {'loss': 1.3688, 'learning_rate': 2.114585215976866e-06, 'epoch': 1.86} {'loss': 0.5674, 'learning_rate': 2.111874209289716e-06, 'epoch': 1.86} {'loss': 1.1287, 'learning_rate': 2.1091632026025663e-06, 'epoch': 1.86} {'loss': 0.1908, 'learning_rate': 2.1064521959154164e-06, 'epoch': 1.86} {'loss': 0.5055, 'learning_rate': 2.103741189228267e-06, 'epoch': 1.86} {'loss': 0.5807, 'learning_rate': 2.101030182541117e-06, 'epoch': 1.86} {'loss': 0.8923, 'learning_rate': 2.0983191758539673e-06, 'epoch': 1.86} {'loss': 0.9181, 'learning_rate': 2.0956081691668174e-06, 'epoch': 1.86} {'loss': 0.9167, 'learning_rate': 2.0928971624796675e-06, 'epoch': 1.86} {'loss': 0.3454, 'learning_rate': 2.0901861557925177e-06, 'epoch': 1.86} {'loss': 1.0884, 'learning_rate': 2.087475149105368e-06, 'epoch': 1.86} {'loss': 0.8546, 'learning_rate': 2.084764142418218e-06, 'epoch': 1.86} {'loss': 0.6183, 'learning_rate': 2.082053135731068e-06, 'epoch': 1.86} {'loss': 0.3466, 'learning_rate': 2.0793421290439182e-06, 'epoch': 1.86} {'loss': 0.2458, 'learning_rate': 2.0766311223567683e-06, 'epoch': 1.86} {'loss': 1.3436, 'learning_rate': 2.073920115669619e-06, 'epoch': 1.86} {'loss': 0.2736, 'learning_rate': 2.071209108982469e-06, 'epoch': 1.86} {'loss': 1.3985, 'learning_rate': 2.068498102295319e-06, 'epoch': 1.86} {'loss': 0.9754, 'learning_rate': 2.0657870956081693e-06, 'epoch': 1.86} {'loss': 0.8038, 'learning_rate': 2.0630760889210194e-06, 'epoch': 1.86} {'loss': 1.1964, 'learning_rate': 2.0603650822338696e-06, 'epoch': 1.86} {'loss': 0.8602, 'learning_rate': 2.0576540755467197e-06, 'epoch': 1.86} {'loss': 0.8117, 'learning_rate': 2.05494306885957e-06, 'epoch': 1.86} {'loss': 0.6771, 'learning_rate': 2.05223206217242e-06, 'epoch': 1.86} {'loss': 0.6393, 'learning_rate': 2.04952105548527e-06, 'epoch': 1.86} {'loss': 1.1508, 'learning_rate': 2.0468100487981207e-06, 'epoch': 1.86} {'loss': 1.0455, 'learning_rate': 2.044099042110971e-06, 'epoch': 1.86} {'loss': 0.8888, 'learning_rate': 2.041388035423821e-06, 'epoch': 1.86} {'loss': 0.6354, 'learning_rate': 2.038677028736671e-06, 'epoch': 1.86} {'loss': 0.8028, 'learning_rate': 2.035966022049521e-06, 'epoch': 1.86} {'loss': 0.5321, 'learning_rate': 2.0332550153623713e-06, 'epoch': 1.86} {'loss': 0.2143, 'learning_rate': 2.0305440086752215e-06, 'epoch': 1.86} {'loss': 1.0121, 'learning_rate': 2.0278330019880716e-06, 'epoch': 1.86} {'loss': 0.8453, 'learning_rate': 2.0251219953009217e-06, 'epoch': 1.86} {'loss': 0.5743, 'learning_rate': 2.022410988613772e-06, 'epoch': 1.87} {'loss': 0.6393, 'learning_rate': 2.019699981926622e-06, 'epoch': 1.87} {'loss': 1.0955, 'learning_rate': 2.0169889752394726e-06, 'epoch': 1.87} {'loss': 0.7443, 'learning_rate': 2.0142779685523227e-06, 'epoch': 1.87} {'loss': 1.1907, 'learning_rate': 2.011566961865173e-06, 'epoch': 1.87} {'loss': 0.5677, 'learning_rate': 2.008855955178023e-06, 'epoch': 1.87} {'loss': 0.814, 'learning_rate': 2.006144948490873e-06, 'epoch': 1.87} {'loss': 0.6515, 'learning_rate': 2.0034339418037232e-06, 'epoch': 1.87} {'loss': 0.2841, 'learning_rate': 2.0007229351165734e-06, 'epoch': 1.87} {'loss': 0.3454, 'learning_rate': 1.9980119284294235e-06, 'epoch': 1.87} {'loss': 0.9424, 'learning_rate': 1.9953009217422736e-06, 'epoch': 1.87} {'loss': 0.8536, 'learning_rate': 1.9925899150551238e-06, 'epoch': 1.87} {'loss': 0.519, 'learning_rate': 1.9898789083679743e-06, 'epoch': 1.87} {'loss': 0.4993, 'learning_rate': 1.9871679016808245e-06, 'epoch': 1.87} {'loss': 1.0661, 'learning_rate': 1.9844568949936746e-06, 'epoch': 1.87} {'loss': 0.5924, 'learning_rate': 1.9817458883065247e-06, 'epoch': 1.87} {'loss': 0.8777, 'learning_rate': 1.979034881619375e-06, 'epoch': 1.87} {'loss': 1.345, 'learning_rate': 1.976323874932225e-06, 'epoch': 1.87} {'loss': 1.0124, 'learning_rate': 1.973612868245075e-06, 'epoch': 1.87} {'loss': 0.5424, 'learning_rate': 1.9709018615579253e-06, 'epoch': 1.87} {'loss': 0.3028, 'learning_rate': 1.9681908548707754e-06, 'epoch': 1.87} {'loss': 0.8006, 'learning_rate': 1.9654798481836255e-06, 'epoch': 1.87} {'loss': 0.4343, 'learning_rate': 1.962768841496476e-06, 'epoch': 1.87} {'loss': 0.4887, 'learning_rate': 1.9600578348093262e-06, 'epoch': 1.87} {'loss': 0.6385, 'learning_rate': 1.9573468281221764e-06, 'epoch': 1.87} {'loss': 0.382, 'learning_rate': 1.9546358214350265e-06, 'epoch': 1.87} {'loss': 0.5754, 'learning_rate': 1.9519248147478766e-06, 'epoch': 1.87} {'loss': 0.841, 'learning_rate': 1.9492138080607268e-06, 'epoch': 1.87} {'loss': 0.3559, 'learning_rate': 1.946502801373577e-06, 'epoch': 1.87} {'loss': 0.5123, 'learning_rate': 1.943791794686427e-06, 'epoch': 1.87} {'loss': 1.1674, 'learning_rate': 1.941080787999277e-06, 'epoch': 1.87} {'loss': 1.1815, 'learning_rate': 1.9383697813121273e-06, 'epoch': 1.87} {'loss': 0.5617, 'learning_rate': 1.9356587746249774e-06, 'epoch': 1.87} {'loss': 1.193, 'learning_rate': 1.932947767937828e-06, 'epoch': 1.87} {'loss': 0.7035, 'learning_rate': 1.930236761250678e-06, 'epoch': 1.87} {'loss': 0.6803, 'learning_rate': 1.9275257545635283e-06, 'epoch': 1.87} {'loss': 0.836, 'learning_rate': 1.9248147478763784e-06, 'epoch': 1.87} {'loss': 0.4997, 'learning_rate': 1.9221037411892285e-06, 'epoch': 1.87} {'loss': 0.3195, 'learning_rate': 1.9193927345020787e-06, 'epoch': 1.87} {'loss': 0.6498, 'learning_rate': 1.9166817278149284e-06, 'epoch': 1.87} {'loss': 0.6987, 'learning_rate': 1.9139707211277785e-06, 'epoch': 1.87} {'loss': 0.4904, 'learning_rate': 1.9112597144406287e-06, 'epoch': 1.87} {'loss': 0.8545, 'learning_rate': 1.908548707753479e-06, 'epoch': 1.87} {'loss': 0.571, 'learning_rate': 1.9058377010663291e-06, 'epoch': 1.87} {'loss': 1.5356, 'learning_rate': 1.9031266943791793e-06, 'epoch': 1.87} {'loss': 0.5474, 'learning_rate': 1.9004156876920294e-06, 'epoch': 1.87} {'loss': 0.574, 'learning_rate': 1.8977046810048797e-06, 'epoch': 1.87} {'loss': 0.2306, 'learning_rate': 1.8949936743177299e-06, 'epoch': 1.87} {'loss': 0.5692, 'learning_rate': 1.89228266763058e-06, 'epoch': 1.87} {'loss': 0.9575, 'learning_rate': 1.8895716609434302e-06, 'epoch': 1.87} {'loss': 0.95, 'learning_rate': 1.8868606542562803e-06, 'epoch': 1.87} {'loss': 0.3809, 'learning_rate': 1.8841496475691306e-06, 'epoch': 1.87} 94%|█████████▎| 10372/11066 [38:01<02:29, 4.64it/s] 94%|█████████▎| 10373/11066 [38:02<02:30, 4.59it/s] 94%|█████████▎| 10373/11066 [38:02<02:30, 4.59it/s] 94%|█████████▎| 10374/11066 [38:02<02:31, 4.56it/s] 94%|█████████▎| 10374/11066 [38:02<02:31, 4.56it/s] 94%|█████████▍| 10375/11066 [38:02<02:32, 4.54it/s] 94%|█████████▍| 10375/11066 [38:02<02:32, 4.54it/s] 94%|█████████▍| 10376/11066 [38:02<02:30, 4.59it/s] 94%|█████████▍| 10376/11066 [38:02<02:30, 4.59it/s] 94%|█████████▍| 10377/11066 [38:02<02:29, 4.60it/s] 94%|█████████▍| 10377/11066 [38:02<02:29, 4.60it/s] 94%|█████████▍| 10378/11066 [38:03<02:27, 4.65it/s] 94%|█████████▍| 10378/11066 [38:03<02:27, 4.65it/s] 94%|█████████▍| 10379/11066 [38:03<02:32, 4.50it/s] 94%|█████████▍| 10379/11066 [38:03<02:32, 4.50it/s] 94%|█████████▍| 10380/11066 [38:03<02:32, 4.49it/s] 94%|█████████▍| 10380/11066 [38:03<02:32, 4.49it/s] 94%|█████████▍| 10381/11066 [38:03<02:32, 4.49it/s] 94%|█████████▍| 10381/11066 [38:03<02:32, 4.49it/s] 94%|█████████▍| 10382/11066 [38:04<02:32, 4.49it/s] 94%|█████████▍| 10382/11066 [38:04<02:32, 4.49it/s] 94%|█████████▍| 10383/11066 [38:04<02:31, 4.50it/s] 94%|█████████▍| 10383/11066 [38:04<02:31, 4.50it/s] 94%|█████████▍| 10384/11066 [38:04<02:31, 4.49it/s] 94%|█████████▍| 10384/11066 [38:04<02:31, 4.49it/s] 94%|█████████▍| 10385/11066 [38:04<02:31, 4.50it/s] 94%|█████████▍| 10385/11066 [38:04<02:31, 4.50it/s] 94%|█████████▍| 10386/11066 [38:04<02:29, 4.55it/s] 94%|█████████▍| 10386/11066 [38:04<02:29, 4.55it/s] 94%|█████████▍| 10387/11066 [38:05<02:27, 4.59it/s] 94%|█████████▍| 10387/11066 [38:05<02:27, 4.59it/s] 94%|█████████▍| 10388/11066 [38:05<02:26, 4.63it/s] 94%|█████████▍| 10388/11066 [38:05<02:26, 4.63it/s] 94%|█████████▍| 10389/11066 [38:05<02:27, 4.59it/s] 94%|█████████▍| 10389/11066 [38:05<02:27, 4.59it/s] 94%|█████████▍| 10390/11066 [38:05<02:26, 4.60it/s] 94%|█████████▍| 10390/11066 [38:05<02:26, 4.60it/s] 94%|█████████▍| 10391/11066 [38:05<02:27, 4.58it/s] 94%|█████████▍| 10391/11066 [38:05<02:27, 4.58it/s] 94%|█████████▍| 10392/11066 [38:06<02:26, 4.61it/s] 94%|█████████▍| 10392/11066 [38:06<02:26, 4.61it/s] 94%|█████████▍| 10393/11066 [38:06<02:25, 4.61it/s] 94%|█████████▍| 10393/11066 [38:06<02:25, 4.61it/s] 94%|█████████▍| 10394/11066 [38:06<02:25, 4.63it/s] 94%|█████████▍| 10394/11066 [38:06<02:25, 4.63it/s] 94%|█████████▍| 10395/11066 [38:06<02:24, 4.65it/s] 94%|█████████▍| 10395/11066 [38:06<02:24, 4.65it/s] 94%|█████████▍| 10396/11066 [38:07<02:25, 4.60it/s] 94%|█████████▍| 10396/11066 [38:07<02:25, 4.60it/s] 94%|█████████▍| 10397/11066 [38:07<02:27, 4.54it/s] 94%|█████████▍| 10397/11066 [38:07<02:27, 4.54it/s] 94%|█████████▍| 10398/11066 [38:07<02:26, 4.56it/s] 94%|█████████▍| 10398/11066 [38:07<02:26, 4.56it/s] 94%|█████████▍| 10399/11066 [38:07<02:27, 4.51it/s] 94%|█████████▍| 10399/11066 [38:07<02:27, 4.51it/s] 94%|█████████▍| 10400/11066 [38:07<02:27, 4.50it/s] 94%|█████████▍| 10400/11066 [38:07<02:27, 4.50it/s] 94%|█████████▍| 10401/11066 [38:08<02:27, 4.50it/s] 94%|█████████▍| 10401/11066 [38:08<02:27, 4.50it/s] 94%|█████████▍| 10402/11066 [38:08<02:27, 4.50it/s] 94%|█████████▍| 10402/11066 [38:08<02:27, 4.50it/s] 94%|█████████▍| 10403/11066 [38:08<02:26, 4.54it/s] 94%|█████████▍| 10403/11066 [38:08<02:26, 4.54it/s] 94%|█████████▍| 10404/11066 [38:08<02:23, 4.60it/s] 94%|█████████▍| 10404/11066 [38:08<02:23, 4.60it/s] 94%|█████████▍| 10405/11066 [38:09<02:23, 4.61it/s] 94%|█████████▍| 10405/11066 [38:09<02:23, 4.61it/s] 94%|█████████▍| 10406/11066 [38:09<02:24, 4.56it/s] 94%|█████████▍| 10406/11066 [38:09<02:24, 4.56it/s] 94%|█████████▍| 10407/11066 [38:09<02:25, 4.53it/s] 94%|█████████▍| 10407/11066 [38:09<02:25, 4.53it/s] 94%|█████████▍| 10408/11066 [38:09<02:25, 4.52it/s] 94%|█████████▍| 10408/11066 [38:09<02:25, 4.52it/s] 94%|█████████▍| 10409/11066 [38:09<02:25, 4.52it/s] 94%|█████████▍| 10409/11066 [38:09<02:25, 4.52it/s] 94%|█████████▍| 10410/11066 [38:10<02:25, 4.52it/s] 94%|█████████▍| 10410/11066 [38:10<02:25, 4.52it/s] 94%|█████████▍| 10411/11066 [38:10<02:25, 4.52it/s] 94%|█████████▍| 10411/11066 [38:10<02:25, 4.52it/s] 94%|█████████▍| 10412/11066 [38:10<02:25, 4.50it/s] 94%|█████████▍| 10412/11066 [38:10<02:25, 4.50it/s] 94%|█████████▍| 10413/11066 [38:10<02:25, 4.49it/s] 94%|█████████▍| 10413/11066 [38:10<02:25, 4.49it/s] 94%|█████████▍| 10414/11066 [38:11<02:25, 4.47it/s] 94%|█████████▍| 10414/11066 [38:11<02:25, 4.47it/s] 94%|█████████▍| 10415/11066 [38:11<02:25, 4.47it/s] 94%|█████████▍| 10415/11066 [38:11<02:25, 4.47it/s] 94%|█████████▍| 10416/11066 [38:11<02:25, 4.47it/s] 94%|█████████▍| 10416/11066 [38:11<02:25, 4.47it/s] 94%|█████████▍| 10417/11066 [38:11<02:24, 4.48it/s] 94%|█████████▍| 10417/11066 [38:11<02:24, 4.48it/s] 94%|█████████▍| 10418/11066 [38:11<02:24, 4.48it/s] 94%|█████████▍| 10418/11066 [38:11<02:24, 4.48it/s] 94%|█████████▍| 10419/11066 [38:12<02:24, 4.49it/s] 94%|█████████▍| 10419/11066 [38:12<02:24, 4.49it/s] 94%|█████████▍| 10420/11066 [38:12<02:22, 4.54it/s] 94%|█████████▍| 10420/11066 [38:12<02:22, 4.54it/s] 94%|█████████▍| 10421/11066 [38:12<02:22, 4.53it/s] 94%|█████████▍| 10421/11066 [38:12<02:22, 4.53it/s] 94%|█████████▍| 10422/11066 [38:12<02:22, 4.52it/s] 94%|█████████▍| 10422/11066 [38:12<02:22, 4.52it/s] 94%|█████████▍| 10423/11066 [38:13<02:22, 4.52it/s] 94%|█████████▍| 10423/11066 [38:13<02:22, 4.52it/s] 94%|█████████▍| 10424/11066 [38:13<02:21, 4.55it/s] 94%|█████████▍| 10424/11066 [38:13<02:21, 4.55it/s] 94%|█████████▍| 10425/11066 [38:13<02:22, 4.49it/s] 94%|█████████▍| 10425/11066 [38:13<02:22, 4.49it/s] 94%|█████████▍| 10426/11066 [38:13<02:24, 4.43it/s] 94%|█████████▍| 10426/11066 [38:13<02:24, 4.43it/s] 94%|█████████▍| 10427/11066 [38:13<02:23, 4.45it/s] 94%|█████████▍| 10427/11066 [38:13<02:23, 4.45it/s] 94%|█████████▍| 10428/11066 [38:14<02:24, 4.40it/s] 94%|█████████▍| 10428/11066 [38:14<02:24, 4.40it/s] 94%|█████████▍| 10429/11066 [38:14<02:23, 4.43it/s] 94%|█████████▍| 10429/11066 [38:14<02:23, 4.43it/s] 94%|█████████▍| 10430/11066 [38:14<02:22, 4.46it/s] 94%|█████████▍| 10430/11066 [38:14<02:22, 4.46it/s] 94%|█████████▍| 10431/11066 [38:14<02:22, 4.47it/s] 94%|█████████▍| 10431/11066 [38:14<02:22, 4.47it/s] 94%|█████████▍| 10432/11066 [38:15<02:21, 4.48it/s] 94%|█████████▍| 10432/11066 [38:15<02:21, 4.48it/s] 94%|█████████▍| 10433/11066 [38:15<02:22, 4.44it/s] 94%|█████████▍| 10433/11066 [38:15<02:22, 4.44it/s] 94%|█████████▍| 10434/11066 [38:15<02:22, 4.45it/s] 94%|█████████▍| 10434/11066 [38:15<02:22, 4.45it/s] 94%|█████████▍| 10435/11066 [38:15<02:21, 4.46it/s] 94%|█████████▍| 10435/11066 [38:15<02:21, 4.46it/s] 94%|█████████▍| 10436/11066 [38:15<02:19, 4.51it/s] 94%|█████████▍| 10436/11066 [38:15<02:19, 4.51it/s] 94%|█████████▍| 10437/11066 [38:16<02:18, 4.55it/s] 94%|█████████▍| 10437/11066 [38:16<02:18, 4.55it/s] 94%|█████████▍| 10438/11066 [38:16<02:16, 4.60it/s] 94%|█████████▍| 10438/11066 [38:16<02:16, 4.60it/s] 94%|█████████▍| 10439/11066 [38:16<02:17, 4.55it/s] 94%|█████████▍| 10439/11066 [38:16<02:17, 4.55it/s] 94%|█████████▍| 10440/11066 [38:16<02:18, 4.53it/s] 94%|█████████▍| 10440/11066 [38:16<02:18, 4.53it/s] 94%|█████████▍| 10441/11066 [38:17<02:18, 4.52it/s] 94%|█████████▍| 10441/11066 [38:17<02:18, 4.52it/s] 94%|█████████▍| 10442/11066 [38:17<02:18, 4.51it/s] 94%|█████████▍| 10442/11066 [38:17<02:18, 4.51it/s] 94%|█████████▍| 10443/11066 [38:17<02:18, 4.51it/s] 94%|█████████▍| 10443/11066 [38:17<02:18, 4.51it/s] 94%|█████████▍| 10444/11066 [38:17<02:18, 4.50it/s] 94%|█████████▍| 10444/11066 [38:17<02:18, 4.50it/s] 94%|█████████▍| 10445/11066 [38:17<02:17, 4.51it/s] 94%|█████████▍| 10445/11066 [38:17<02:17, 4.51it/s] 94%|█████████▍| 10446/11066 [38:18<02:17, 4.51it/s] 94%|█████████▍| 10446/11066 [38:18<02:17, 4.51it/s] 94%|█████████▍| 10447/11066 [38:18<02:16, 4.54it/s] 94%|█████████▍| 10447/11066 [38:18<02:16, 4.54it/s] 94%|█████████▍| 10448/11066 [38:18<02:14, 4.60it/s] 94%|█████████▍| 10448/11066 [38:18<02:14, 4.60it/s] 94%|█████████▍| 10449/11066 [38:18<02:13, 4.62it/s] 94%|█████████▍| 10449/11066 [38:18<02:13, 4.62it/s] 94%|█████████▍| 10450/11066 [38:19<02:14, 4.57it/s] 94%|█████████▍| 10450/11066 [38:19<02:14, 4.57it/s] 94%|█████████▍| 10451/11066 [38:19<02:15, 4.55it/s] 94%|█████████▍| 10451/11066 [38:19<02:15, 4.55it/s] 94%|█████████▍| 10452/11066 [38:19<02:15, 4.54it/s] 94%|█████████▍| 10452/11066 [38:19<02:15, 4.54it/s] 94%|█████████▍| 10453/11066 [38:19<02:15, 4.52it/s] 94%|█████████▍| 10453/11066 [38:19<02:15, 4.52it/s] 94%|█████████▍| 10454/11066 [38:19<02:15, 4.52it/s] 94%|█████████▍| 10454/11066 [38:19<02:15, 4.52it/s] 94%|█████████▍| 10455/11066 [38:20<02:14, 4.55it/s] 94%|█████████▍| 10455/11066 [38:20<02:14, 4.55it/s] 94%|█████████▍| 10456/11066 [38:20<02:14, 4.54it/s] 94%|█████████▍| 10456/11066 [38:20<02:14, 4.54it/s] 94%|█████████▍| 10457/11066 [38:20<02:14, 4.53it/s] 94%|█████████▍| 10457/11066 [38:20<02:14, 4.53it/s] 95%|█████████▍| 10458/11066 [38:20<02:15, 4.50it/s] 95%|█████████▍| 10458/11066 [38:20<02:15, 4.50it/s] 95%|█████████▍| 10459/11066 [38:21<02:14, 4.53it/s] 95%|█████████▍| 10459/11066 [38:21<02:14, 4.53it/s] 95%|█████████▍| 10460/11066 [38:21<02:14, 4.50it/s] 95%|█████████▍| 10460/11066 [38:21<02:14, 4.50it/s] 95%|█████████▍| 10461/11066 [38:21<02:13, 4.53it/s] 95%|█████████▍| 10461/11066 [38:21<02:13, 4.53it/s] 95%|█████████▍| 10462/11066 [38:21<02:13, 4.51it/s] 95%|█████████▍| 10462/11066 [38:21<02:13, 4.51it/s] 95%|█████████▍| 10463/11066 [38:21<02:11, 4.57it/s] 95%|█████████▍| 10463/11066 [38:21<02:11, 4.57it/s] 95%|█████████▍| 10464/11066 [38:22<02:11, 4.57it/s] 95%|█████████▍| 10464/11066 [38:22<02:11, 4.57it/s] 95%|█████████▍| 10465/11066 [38:22<02:11, 4.58it/s] 95%|█████████▍| 10465/11066 [38:22<02:11, 4.58it/s] 95%|█████████▍| 10466/11066 [38:22<02:12, 4.54it/s] 95%|█████████▍| 10466/11066 [38:22<02:12, 4.54it/s] 95%|█████████▍| 10467/11066 [38:22<02:11, 4.56it/s] 95%|█████████▍| 10467/11066 [38:22<02:11, 4.56it/s] 95%|█████████▍| 10468/11066 [38:23<02:12, 4.52it/s] 95%|█████████▍| 10468/11066 [38:23<02:12, 4.52it/s] 95%|█████████▍| 10469/11066 [38:23<02:12, 4.50it/s] 95%|█████████▍| 10469/11066 [38:23<02:12, 4.50it/s] 95%|█████████▍| 10470/11066 [38:23<02:12, 4.49it/s] 95%|█████████▍| 10470/11066 [38:23<02:12, 4.49it/s] 95%|█████████▍| 10471/11066 [38:23<02:11, 4.53it/s] 95%|█████████▍| 10471/11066 [38:23<02:11, 4.53it/s] 95%|█████████▍| 10472/11066 [38:23<02:09, 4.57it/s] 95%|█████████▍| 10472/11066 [38:23<02:09, 4.57it/s] 95%|█████████▍| 10473/11066 [38:24<02:10, 4.54it/s] 95%|█████████▍| 10473/11066 [38:24<02:10, 4.54it/s] 95%|█████████▍| 10474/11066 [38:24<02:11, 4.52it/s] 95%|█████████▍| 10474/11066 [38:24<02:11, 4.52it/s] 95%|█████████▍| 10475/11066 [38:24<02:10, 4.54it/s] 95%|█████████▍| 10475/11066 [38:24<02:10, 4.54it/s] 95%|█████████▍| 10476/11066 [38:24<02:09, 4.55it/s] 95%|█████████▍| 10476/11066 [38:24<02:09, 4.55it/s] 95%|█████████▍| 10477/11066 [38:24<02:09, 4.56it/s] 95%|█████████▍| 10477/11066 [38:24<02:09, 4.56it/s] 95%|█████████▍| 10478/11066 [38:25<02:09, 4.53it/s] 95%|█████████▍| 10478/11066 [38:25<02:09, 4.53it/s] 95%|█████████▍| 10479/11066 [38:25<02:08, 4.55it/s] 95%|█████████▍| 10479/11066 [38:25<02:08, 4.55it/s] 95%|█████████▍| 10480/11066 [38:25<02:07, 4.60it/s] 95%|█████████▍| 10480/11066 [38:25<02:07, 4.60it/s] 95%|█████████▍| 10481/11066 [38:25<02:06, 4.62it/s] 95%|█████████▍| 10481/11066 [38:25<02:06, 4.62it/s] 95%|█████████▍| 10482/11066 [38:26<02:06, 4.61it/s] 95%|█████████▍| 10482/11066 [38:26<02:06, 4.61it/s] 95%|█████████▍| 10483/11066 [38:26<02:05, 4.64it/s] 95%|█████████▍| 10483/11066 [38:26<02:05, 4.64it/s] 95%|█████████▍| 10484/11066 [38:26<02:05, 4.62it/s] {'loss': 0.4244, 'learning_rate': 1.8814386408819808e-06, 'epoch': 1.87} {'loss': 0.9214, 'learning_rate': 1.878727634194831e-06, 'epoch': 1.87} {'loss': 0.9124, 'learning_rate': 1.876016627507681e-06, 'epoch': 1.87} {'loss': 0.5002, 'learning_rate': 1.8733056208205314e-06, 'epoch': 1.88} {'loss': 0.5621, 'learning_rate': 1.8705946141333817e-06, 'epoch': 1.88} {'loss': 0.4531, 'learning_rate': 1.8678836074462319e-06, 'epoch': 1.88} {'loss': 0.9359, 'learning_rate': 1.865172600759082e-06, 'epoch': 1.88} {'loss': 0.835, 'learning_rate': 1.8624615940719321e-06, 'epoch': 1.88} {'loss': 0.7674, 'learning_rate': 1.8597505873847823e-06, 'epoch': 1.88} {'loss': 0.7059, 'learning_rate': 1.8570395806976326e-06, 'epoch': 1.88} {'loss': 0.7693, 'learning_rate': 1.8543285740104827e-06, 'epoch': 1.88} {'loss': 1.2803, 'learning_rate': 1.8516175673233329e-06, 'epoch': 1.88} {'loss': 0.6517, 'learning_rate': 1.848906560636183e-06, 'epoch': 1.88} {'loss': 0.8029, 'learning_rate': 1.8461955539490331e-06, 'epoch': 1.88} {'loss': 0.8352, 'learning_rate': 1.8434845472618833e-06, 'epoch': 1.88} {'loss': 0.4797, 'learning_rate': 1.8407735405747336e-06, 'epoch': 1.88} {'loss': 0.6228, 'learning_rate': 1.8380625338875838e-06, 'epoch': 1.88} {'loss': 0.8097, 'learning_rate': 1.835351527200434e-06, 'epoch': 1.88} {'loss': 1.0476, 'learning_rate': 1.832640520513284e-06, 'epoch': 1.88} {'loss': 1.2135, 'learning_rate': 1.829929513826134e-06, 'epoch': 1.88} {'loss': 0.3708, 'learning_rate': 1.8272185071389843e-06, 'epoch': 1.88} {'loss': 1.1144, 'learning_rate': 1.8245075004518344e-06, 'epoch': 1.88} {'loss': 0.5043, 'learning_rate': 1.8217964937646846e-06, 'epoch': 1.88} {'loss': 1.399, 'learning_rate': 1.8190854870775347e-06, 'epoch': 1.88} {'loss': 1.2086, 'learning_rate': 1.8163744803903848e-06, 'epoch': 1.88} {'loss': 0.5265, 'learning_rate': 1.8136634737032352e-06, 'epoch': 1.88} {'loss': 0.5771, 'learning_rate': 1.8109524670160853e-06, 'epoch': 1.88} {'loss': 0.8652, 'learning_rate': 1.8082414603289355e-06, 'epoch': 1.88} {'loss': 0.5774, 'learning_rate': 1.8055304536417856e-06, 'epoch': 1.88} {'loss': 0.51, 'learning_rate': 1.8028194469546357e-06, 'epoch': 1.88} {'loss': 0.9326, 'learning_rate': 1.800108440267486e-06, 'epoch': 1.88} {'loss': 0.5035, 'learning_rate': 1.7973974335803362e-06, 'epoch': 1.88} {'loss': 1.045, 'learning_rate': 1.7946864268931863e-06, 'epoch': 1.88} {'loss': 0.7104, 'learning_rate': 1.7919754202060365e-06, 'epoch': 1.88} {'loss': 0.9099, 'learning_rate': 1.7892644135188866e-06, 'epoch': 1.88} {'loss': 0.742, 'learning_rate': 1.786553406831737e-06, 'epoch': 1.88} {'loss': 0.7695, 'learning_rate': 1.783842400144587e-06, 'epoch': 1.88} {'loss': 0.6477, 'learning_rate': 1.7811313934574372e-06, 'epoch': 1.88} {'loss': 0.377, 'learning_rate': 1.7784203867702874e-06, 'epoch': 1.88} {'loss': 0.3724, 'learning_rate': 1.7757093800831375e-06, 'epoch': 1.88} {'loss': 0.8532, 'learning_rate': 1.7729983733959876e-06, 'epoch': 1.88} {'loss': 0.773, 'learning_rate': 1.770287366708838e-06, 'epoch': 1.88} {'loss': 1.1095, 'learning_rate': 1.767576360021688e-06, 'epoch': 1.88} {'loss': 0.7127, 'learning_rate': 1.7648653533345382e-06, 'epoch': 1.88} {'loss': 0.2894, 'learning_rate': 1.7621543466473884e-06, 'epoch': 1.88} {'loss': 0.5705, 'learning_rate': 1.7594433399602385e-06, 'epoch': 1.88} {'loss': 0.4046, 'learning_rate': 1.7567323332730888e-06, 'epoch': 1.88} {'loss': 0.8602, 'learning_rate': 1.754021326585939e-06, 'epoch': 1.88} {'loss': 0.8996, 'learning_rate': 1.7513103198987891e-06, 'epoch': 1.88} {'loss': 0.8209, 'learning_rate': 1.7485993132116393e-06, 'epoch': 1.88} {'loss': 1.0621, 'learning_rate': 1.7458883065244894e-06, 'epoch': 1.88} {'loss': 0.5109, 'learning_rate': 1.7431772998373397e-06, 'epoch': 1.88} {'loss': 0.4577, 'learning_rate': 1.7404662931501899e-06, 'epoch': 1.88} {'loss': 0.7108, 'learning_rate': 1.73775528646304e-06, 'epoch': 1.88} {'loss': 0.6516, 'learning_rate': 1.7350442797758901e-06, 'epoch': 1.88} {'loss': 0.288, 'learning_rate': 1.7323332730887403e-06, 'epoch': 1.88} {'loss': 0.7292, 'learning_rate': 1.7296222664015906e-06, 'epoch': 1.88} {'loss': 0.886, 'learning_rate': 1.7269112597144407e-06, 'epoch': 1.88} {'loss': 0.6064, 'learning_rate': 1.7242002530272909e-06, 'epoch': 1.89} {'loss': 0.8024, 'learning_rate': 1.721489246340141e-06, 'epoch': 1.89} {'loss': 1.0677, 'learning_rate': 1.7187782396529912e-06, 'epoch': 1.89} {'loss': 0.8465, 'learning_rate': 1.7160672329658413e-06, 'epoch': 1.89} {'loss': 0.7998, 'learning_rate': 1.7133562262786916e-06, 'epoch': 1.89} {'loss': 0.7365, 'learning_rate': 1.7106452195915418e-06, 'epoch': 1.89} {'loss': 1.3211, 'learning_rate': 1.707934212904392e-06, 'epoch': 1.89} {'loss': 0.3939, 'learning_rate': 1.705223206217242e-06, 'epoch': 1.89} {'loss': 1.2495, 'learning_rate': 1.7025121995300922e-06, 'epoch': 1.89} {'loss': 0.2617, 'learning_rate': 1.6998011928429425e-06, 'epoch': 1.89} {'loss': 0.5975, 'learning_rate': 1.6970901861557927e-06, 'epoch': 1.89} {'loss': 0.8337, 'learning_rate': 1.6943791794686428e-06, 'epoch': 1.89} {'loss': 0.5721, 'learning_rate': 1.691668172781493e-06, 'epoch': 1.89} {'loss': 0.969, 'learning_rate': 1.688957166094343e-06, 'epoch': 1.89} {'loss': 1.0905, 'learning_rate': 1.6862461594071934e-06, 'epoch': 1.89} {'loss': 1.1851, 'learning_rate': 1.6835351527200435e-06, 'epoch': 1.89} {'loss': 1.6319, 'learning_rate': 1.6808241460328937e-06, 'epoch': 1.89} {'loss': 0.9048, 'learning_rate': 1.6781131393457438e-06, 'epoch': 1.89} {'loss': 0.8106, 'learning_rate': 1.675402132658594e-06, 'epoch': 1.89} {'loss': 0.513, 'learning_rate': 1.6726911259714443e-06, 'epoch': 1.89} {'loss': 1.0035, 'learning_rate': 1.6699801192842944e-06, 'epoch': 1.89} {'loss': 0.8802, 'learning_rate': 1.6672691125971446e-06, 'epoch': 1.89} {'loss': 0.5418, 'learning_rate': 1.6645581059099947e-06, 'epoch': 1.89} {'loss': 0.497, 'learning_rate': 1.6618470992228448e-06, 'epoch': 1.89} {'loss': 0.4757, 'learning_rate': 1.6591360925356952e-06, 'epoch': 1.89} {'loss': 0.3434, 'learning_rate': 1.656425085848545e-06, 'epoch': 1.89} {'loss': 0.9826, 'learning_rate': 1.6537140791613952e-06, 'epoch': 1.89} {'loss': 0.8279, 'learning_rate': 1.6510030724742454e-06, 'epoch': 1.89} {'loss': 0.5949, 'learning_rate': 1.6482920657870955e-06, 'epoch': 1.89} {'loss': 0.6174, 'learning_rate': 1.6455810590999458e-06, 'epoch': 1.89} {'loss': 0.7034, 'learning_rate': 1.642870052412796e-06, 'epoch': 1.89} {'loss': 0.2829, 'learning_rate': 1.640159045725646e-06, 'epoch': 1.89} {'loss': 1.0014, 'learning_rate': 1.6374480390384962e-06, 'epoch': 1.89} {'loss': 0.6543, 'learning_rate': 1.6347370323513464e-06, 'epoch': 1.89} {'loss': 0.454, 'learning_rate': 1.6320260256641965e-06, 'epoch': 1.89} {'loss': 1.005, 'learning_rate': 1.6293150189770469e-06, 'epoch': 1.89} {'loss': 1.0408, 'learning_rate': 1.626604012289897e-06, 'epoch': 1.89} {'loss': 0.6006, 'learning_rate': 1.6238930056027471e-06, 'epoch': 1.89} {'loss': 0.6424, 'learning_rate': 1.6211819989155973e-06, 'epoch': 1.89} {'loss': 0.9381, 'learning_rate': 1.6184709922284474e-06, 'epoch': 1.89} {'loss': 0.9991, 'learning_rate': 1.6157599855412977e-06, 'epoch': 1.89} {'loss': 0.9822, 'learning_rate': 1.6130489788541479e-06, 'epoch': 1.89} {'loss': 0.3622, 'learning_rate': 1.610337972166998e-06, 'epoch': 1.89} {'loss': 0.7503, 'learning_rate': 1.6076269654798481e-06, 'epoch': 1.89} {'loss': 0.5281, 'learning_rate': 1.6049159587926983e-06, 'epoch': 1.89} {'loss': 0.4735, 'learning_rate': 1.6022049521055486e-06, 'epoch': 1.89} {'loss': 0.6558, 'learning_rate': 1.5994939454183988e-06, 'epoch': 1.89} {'loss': 0.6747, 'learning_rate': 1.5967829387312489e-06, 'epoch': 1.89} {'loss': 0.6185, 'learning_rate': 1.594071932044099e-06, 'epoch': 1.89} {'loss': 1.2186, 'learning_rate': 1.5913609253569492e-06, 'epoch': 1.89} {'loss': 0.611, 'learning_rate': 1.5886499186697995e-06, 'epoch': 1.89} {'loss': 0.5137, 'learning_rate': 1.5859389119826496e-06, 'epoch': 1.89} {'loss': 1.1754, 'learning_rate': 1.5832279052954998e-06, 'epoch': 1.89} {'loss': 0.91, 'learning_rate': 1.58051689860835e-06, 'epoch': 1.89} 95%|█████████▍| 10484/11066 [38:26<02:05, 4.62it/s] 95%|█████████▍| 10485/11066 [38:26<02:06, 4.58it/s] 95%|█████████▍| 10485/11066 [38:26<02:06, 4.58it/s] 95%|█████████▍| 10486/11066 [38:26<02:05, 4.62it/s] 95%|█████████▍| 10486/11066 [38:26<02:05, 4.62it/s] 95%|█████████▍| 10487/11066 [38:27<02:06, 4.58it/s] 95%|█████████▍| 10487/11066 [38:27<02:06, 4.58it/s] 95%|█████████▍| 10488/11066 [38:27<02:05, 4.59it/s] 95%|█████████▍| 10488/11066 [38:27<02:05, 4.59it/s] 95%|█████████▍| 10489/11066 [38:27<02:06, 4.58it/s] 95%|█████████▍| 10489/11066 [38:27<02:06, 4.58it/s] 95%|█████████▍| 10490/11066 [38:27<02:05, 4.58it/s] 95%|█████████▍| 10490/11066 [38:27<02:05, 4.58it/s] 95%|█████████▍| 10491/11066 [38:28<02:05, 4.59it/s] 95%|█████████▍| 10491/11066 [38:28<02:05, 4.59it/s] 95%|█████████▍| 10492/11066 [38:28<02:04, 4.61it/s] 95%|█████████▍| 10492/11066 [38:28<02:04, 4.61it/s] 95%|█████████▍| 10493/11066 [38:28<02:04, 4.61it/s] 95%|█████████▍| 10493/11066 [38:28<02:04, 4.61it/s] 95%|█████████▍| 10494/11066 [38:28<02:05, 4.57it/s] 95%|█████████▍| 10494/11066 [38:28<02:05, 4.57it/s] 95%|█████████▍| 10495/11066 [38:28<02:04, 4.59it/s] 95%|█████████▍| 10495/11066 [38:28<02:04, 4.59it/s] 95%|█████████▍| 10496/11066 [38:29<02:03, 4.61it/s] 95%|█████████▍| 10496/11066 [38:29<02:03, 4.61it/s] 95%|█████████▍| 10497/11066 [38:29<02:04, 4.56it/s] 95%|█████████▍| 10497/11066 [38:29<02:04, 4.56it/s] 95%|█████████▍| 10498/11066 [38:29<02:04, 4.54it/s] 95%|█████████▍| 10498/11066 [38:29<02:04, 4.54it/s] 95%|█████████▍| 10499/11066 [38:29<02:04, 4.57it/s] 95%|█████████▍| 10499/11066 [38:29<02:04, 4.57it/s] 95%|█████████▍| 10500/11066 [38:29<02:02, 4.63it/s] 95%|█████████▍| 10500/11066 [38:29<02:02, 4.63it/s] 95%|█████████▍| 10501/11066 [38:30<02:01, 4.65it/s] 95%|█████████▍| 10501/11066 [38:30<02:01, 4.65it/s] 95%|█████████▍| 10502/11066 [38:30<02:03, 4.56it/s] 95%|█████████▍| 10502/11066 [38:30<02:03, 4.56it/s] 95%|█████████▍| 10503/11066 [38:30<02:02, 4.58it/s] 95%|█████████▍| 10503/11066 [38:30<02:02, 4.58it/s] 95%|█████████▍| 10504/11066 [38:30<02:03, 4.55it/s] 95%|█████████▍| 10504/11066 [38:30<02:03, 4.55it/s] 95%|█████████▍| 10505/11066 [38:31<02:02, 4.58it/s] 95%|█████████▍| 10505/11066 [38:31<02:02, 4.58it/s] 95%|█████████▍| 10506/11066 [38:31<02:03, 4.55it/s] 95%|█████████▍| 10506/11066 [38:31<02:03, 4.55it/s] 95%|█████████▍| 10507/11066 [38:31<02:05, 4.47it/s] 95%|█████████▍| 10507/11066 [38:31<02:05, 4.47it/s] 95%|█████████▍| 10508/11066 [38:31<02:06, 4.42it/s] 95%|█████████▍| 10508/11066 [38:31<02:06, 4.42it/s] 95%|█████████▍| 10509/11066 [38:32<02:07, 4.38it/s] 95%|█████████▍| 10509/11066 [38:32<02:07, 4.38it/s] 95%|█████████▍| 10510/11066 [38:32<02:05, 4.42it/s] 95%|█████████▍| 10510/11066 [38:32<02:05, 4.42it/s] 95%|█████████▍| 10511/11066 [38:32<02:04, 4.44it/s] 95%|█████████▍| 10511/11066 [38:32<02:04, 4.44it/s] 95%|█████████▍| 10512/11066 [38:32<02:04, 4.46it/s] 95%|█████████▍| 10512/11066 [38:32<02:04, 4.46it/s] 95%|█████████▌| 10513/11066 [38:32<02:03, 4.47it/s] 95%|█████████▌| 10513/11066 [38:32<02:03, 4.47it/s] 95%|█████████▌| 10514/11066 [38:33<02:03, 4.48it/s] 95%|█████████▌| 10514/11066 [38:33<02:03, 4.48it/s] 95%|█████████▌| 10515/11066 [38:33<02:02, 4.49it/s] 95%|█████████▌| 10515/11066 [38:33<02:02, 4.49it/s] 95%|█████████▌| 10516/11066 [38:33<02:02, 4.49it/s] 95%|█████████▌| 10516/11066 [38:33<02:02, 4.49it/s] 95%|█████████▌| 10517/11066 [38:33<02:02, 4.49it/s] 95%|█████████▌| 10517/11066 [38:33<02:02, 4.49it/s] 95%|█████████▌| 10518/11066 [38:34<02:01, 4.50it/s] 95%|█████████▌| 10518/11066 [38:34<02:01, 4.50it/s] 95%|█████████▌| 10519/11066 [38:34<02:01, 4.50it/s] 95%|█████████▌| 10519/11066 [38:34<02:01, 4.50it/s] 95%|█████████▌| 10520/11066 [38:34<02:01, 4.50it/s] 95%|█████████▌| 10520/11066 [38:34<02:01, 4.50it/s] 95%|█████████▌| 10521/11066 [38:34<02:01, 4.50it/s] 95%|█████████▌| 10521/11066 [38:34<02:01, 4.50it/s] 95%|█████████▌| 10522/11066 [38:34<02:00, 4.50it/s] 95%|█████████▌| 10522/11066 [38:34<02:00, 4.50it/s] 95%|█████████▌| 10523/11066 [38:35<02:00, 4.50it/s] 95%|█████████▌| 10523/11066 [38:35<02:00, 4.50it/s] 95%|█████████▌| 10524/11066 [38:35<02:00, 4.51it/s] 95%|█████████▌| 10524/11066 [38:35<02:00, 4.51it/s] 95%|█████████▌| 10525/11066 [38:35<02:00, 4.50it/s] 95%|█████████▌| 10525/11066 [38:35<02:00, 4.50it/s] 95%|█████████▌| 10526/11066 [38:35<01:59, 4.50it/s] 95%|█████████▌| 10526/11066 [38:35<01:59, 4.50it/s] 95%|█████████▌| 10527/11066 [38:36<01:59, 4.50it/s] 95%|█████████▌| 10527/11066 [38:36<01:59, 4.50it/s] 95%|█████████▌| 10528/11066 [38:36<01:59, 4.50it/s] 95%|█████████▌| 10528/11066 [38:36<01:59, 4.50it/s] 95%|█████████▌| 10529/11066 [38:36<01:59, 4.50it/s] 95%|█████████▌| 10529/11066 [38:36<01:59, 4.50it/s] 95%|█████████▌| 10530/11066 [38:36<01:59, 4.50it/s] 95%|█████████▌| 10530/11066 [38:36<01:59, 4.50it/s] 95%|█████████▌| 10531/11066 [38:36<01:58, 4.50it/s] 95%|█████████▌| 10531/11066 [38:36<01:58, 4.50it/s] 95%|█████████▌| 10532/11066 [38:37<01:58, 4.50it/s] 95%|█████████▌| 10532/11066 [38:37<01:58, 4.50it/s] 95%|█████████▌| 10533/11066 [38:37<01:58, 4.51it/s] 95%|█████████▌| 10533/11066 [38:37<01:58, 4.51it/s] 95%|█████████▌| 10534/11066 [38:37<01:58, 4.50it/s] 95%|█████████▌| 10534/11066 [38:37<01:58, 4.50it/s] 95%|█████████▌| 10535/11066 [38:37<01:58, 4.50it/s] 95%|█████████▌| 10535/11066 [38:37<01:58, 4.50it/s] 95%|█████████▌| 10536/11066 [38:38<01:57, 4.50it/s] 95%|█████████▌| 10536/11066 [38:38<01:57, 4.50it/s] 95%|█████████▌| 10537/11066 [38:38<01:57, 4.50it/s] 95%|█████████▌| 10537/11066 [38:38<01:57, 4.50it/s] 95%|█████████▌| 10538/11066 [38:38<01:57, 4.50it/s] 95%|█████████▌| 10538/11066 [38:38<01:57, 4.50it/s] 95%|█████████▌| 10539/11066 [38:38<01:57, 4.50it/s] 95%|█████████▌| 10539/11066 [38:38<01:57, 4.50it/s] 95%|█████████▌| 10540/11066 [38:38<01:56, 4.51it/s] 95%|█████████▌| 10540/11066 [38:38<01:56, 4.51it/s] 95%|█████████▌| 10541/11066 [38:39<01:56, 4.51it/s] 95%|█████████▌| 10541/11066 [38:39<01:56, 4.51it/s] 95%|█████████▌| 10542/11066 [38:39<01:56, 4.51it/s] 95%|█████████▌| 10542/11066 [38:39<01:56, 4.51it/s] 95%|█████████▌| 10543/11066 [38:39<01:56, 4.51it/s] 95%|█████████▌| 10543/11066 [38:39<01:56, 4.51it/s] 95%|█████████▌| 10544/11066 [38:39<01:55, 4.50it/s] 95%|█████████▌| 10544/11066 [38:39<01:55, 4.50it/s] 95%|█████████▌| 10545/11066 [38:40<01:55, 4.50it/s] 95%|█████████▌| 10545/11066 [38:40<01:55, 4.50it/s] 95%|█████████▌| 10546/11066 [38:40<01:55, 4.50it/s] 95%|█████████▌| 10546/11066 [38:40<01:55, 4.50it/s] 95%|█████████▌| 10547/11066 [38:40<01:55, 4.50it/s] 95%|█████████▌| 10547/11066 [38:40<01:55, 4.50it/s] 95%|█████████▌| 10548/11066 [38:40<01:55, 4.50it/s] 95%|█████████▌| 10548/11066 [38:40<01:55, 4.50it/s] 95%|█████████▌| 10549/11066 [38:40<01:54, 4.50it/s] 95%|█████████▌| 10549/11066 [38:40<01:54, 4.50it/s] 95%|█████████▌| 10550/11066 [38:41<01:54, 4.50it/s] 95%|█████████▌| 10550/11066 [38:41<01:54, 4.50it/s] 95%|█████████▌| 10551/11066 [38:41<01:54, 4.50it/s] 95%|█████████▌| 10551/11066 [38:41<01:54, 4.50it/s] 95%|█████████▌| 10552/11066 [38:41<01:54, 4.50it/s] 95%|█████████▌| 10552/11066 [38:41<01:54, 4.50it/s] 95%|█████████▌| 10553/11066 [38:41<01:53, 4.50it/s] 95%|█████████▌| 10553/11066 [38:41<01:53, 4.50it/s] 95%|█████████▌| 10554/11066 [38:42<01:53, 4.50it/s] 95%|█████████▌| 10554/11066 [38:42<01:53, 4.50it/s] 95%|█████████▌| 10555/11066 [38:42<01:53, 4.51it/s] 95%|█████████▌| 10555/11066 [38:42<01:53, 4.51it/s] 95%|█████████▌| 10556/11066 [38:42<01:53, 4.50it/s] 95%|█████████▌| 10556/11066 [38:42<01:53, 4.50it/s] 95%|█████████▌| 10557/11066 [38:42<01:52, 4.51it/s] 95%|█████████▌| 10557/11066 [38:42<01:52, 4.51it/s] 95%|█████████▌| 10558/11066 [38:42<01:52, 4.50it/s] 95%|█████████▌| 10558/11066 [38:42<01:52, 4.50it/s] 95%|█████████▌| 10559/11066 [38:43<01:52, 4.51it/s] 95%|█████████▌| 10559/11066 [38:43<01:52, 4.51it/s] 95%|█████████▌| 10560/11066 [38:43<01:52, 4.51it/s] 95%|█████████▌| 10560/11066 [38:43<01:52, 4.51it/s] 95%|█████████▌| 10561/11066 [38:43<01:49, 4.59it/s] 95%|█████████▌| 10561/11066 [38:43<01:49, 4.59it/s] 95%|█████████▌| 10562/11066 [38:43<01:50, 4.55it/s] 95%|█████████▌| 10562/11066 [38:43<01:50, 4.55it/s] 95%|█████████▌| 10563/11066 [38:43<01:50, 4.55it/s] 95%|█████████▌| 10563/11066 [38:43<01:50, 4.55it/s] 95%|█████████▌| 10564/11066 [38:44<01:50, 4.56it/s] 95%|█████████▌| 10564/11066 [38:44<01:50, 4.56it/s] 95%|█████████▌| 10565/11066 [38:44<01:49, 4.59it/s] 95%|█████████▌| 10565/11066 [38:44<01:49, 4.59it/s] 95%|█████████▌| 10566/11066 [38:44<01:49, 4.55it/s] 95%|█████████▌| 10566/11066 [38:44<01:49, 4.55it/s] 95%|█████████▌| 10567/11066 [38:44<01:49, 4.57it/s] 95%|█████████▌| 10567/11066 [38:44<01:49, 4.57it/s] 95%|█████████▌| 10568/11066 [38:45<01:49, 4.57it/s] 95%|█████████▌| 10568/11066 [38:45<01:49, 4.57it/s] 96%|█████████▌| 10569/11066 [38:45<01:48, 4.58it/s] 96%|█████████▌| 10569/11066 [38:45<01:48, 4.58it/s] 96%|█████████▌| 10570/11066 [38:45<01:49, 4.55it/s] 96%|█████████▌| 10570/11066 [38:45<01:49, 4.55it/s] 96%|█████████▌| 10571/11066 [38:45<01:49, 4.53it/s] 96%|█████████▌| 10571/11066 [38:45<01:49, 4.53it/s] 96%|█████████▌| 10572/11066 [38:45<01:48, 4.55it/s] 96%|█████████▌| 10572/11066 [38:45<01:48, 4.55it/s] 96%|█████████▌| 10573/11066 [38:46<01:47, 4.59it/s] 96%|█████████▌| 10573/11066 [38:46<01:47, 4.59it/s] 96%|█████████▌| 10574/11066 [38:46<01:47, 4.59it/s] 96%|█████████▌| 10574/11066 [38:46<01:47, 4.59it/s] 96%|█████████▌| 10575/11066 [38:46<01:45, 4.64it/s] 96%|█████████▌| 10575/11066 [38:46<01:45, 4.64it/s] 96%|█████████▌| 10576/11066 [38:46<01:45, 4.65it/s] 96%|█████████▌| 10576/11066 [38:46<01:45, 4.65it/s] 96%|█████████▌| 10577/11066 [38:47<01:46, 4.59it/s] 96%|█████████▌| 10577/11066 [38:47<01:46, 4.59it/s] 96%|█████████▌| 10578/11066 [38:47<01:47, 4.54it/s] 96%|█████████▌| 10578/11066 [38:47<01:47, 4.54it/s] 96%|█████████▌| 10579/11066 [38:47<01:46, 4.56it/s] 96%|█████████▌| 10579/11066 [38:47<01:46, 4.56it/s] 96%|█████████▌| 10580/11066 [38:47<01:47, 4.53it/s] 96%|█████████▌| 10580/11066 [38:47<01:47, 4.53it/s] 96%|█████████▌| 10581/11066 [38:47<01:46, 4.55it/s] 96%|█████████▌| 10581/11066 [38:47<01:46, 4.55it/s] 96%|█████████▌| 10582/11066 [38:48<01:45, 4.57it/s] 96%|█████████▌| 10582/11066 [38:48<01:45, 4.57it/s] 96%|█████████▌| 10583/11066 [38:48<01:44, 4.60it/s] 96%|█████████▌| 10583/11066 [38:48<01:44, 4.60it/s] 96%|█████████▌| 10584/11066 [38:48<01:45, 4.56it/s] 96%|█████████▌| 10584/11066 [38:48<01:45, 4.56it/s] 96%|█████████▌| 10585/11066 [38:48<01:45, 4.57it/s] 96%|█████████▌| 10585/11066 [38:48<01:45, 4.57it/s] 96%|█████████▌| 10586/11066 [38:49<01:45, 4.54it/s] 96%|█████████▌| 10586/11066 [38:49<01:45, 4.54it/s] 96%|█████████▌| 10587/11066 [38:49<01:45, 4.55it/s] 96%|█████████▌| 10587/11066 [38:49<01:45, 4.55it/s] 96%|█████████▌| 10588/11066 [38:49<01:44, 4.56it/s] 96%|█████████▌| 10588/11066 [38:49<01:44, 4.56it/s] 96%|█████████▌| 10589/11066 [38:49<01:45, 4.53it/s] 96%|█████████▌| 10589/11066 [38:49<01:45, 4.53it/s] 96%|█████████▌| 10590/11066 [38:49<01:44, 4.56it/s] 96%|█████████▌| 10590/11066 [38:49<01:44, 4.56it/s] 96%|█████████▌| 10591/11066 [38:50<01:43, 4.57it/s] 96%|█████████▌| 10591/11066 [38:50<01:43, 4.57it/s] 96%|█████████▌| 10592/11066 [38:50<01:43, 4.59it/s] 96%|█████████▌| 10592/11066 [38:50<01:43, 4.59it/s] 96%|█████████▌| 10593/11066 [38:50<01:42, 4.62it/s] 96%|█████████▌| 10593/11066 [38:50<01:42, 4.62it/s] 96%|█████████▌| 10594/11066 [38:50<01:43, 4.57it/s] 96%|█████████▌| 10594/11066 [38:50<01:43, 4.57it/s] 96%|█████████▌| 10595/11066 [38:50<01:42, 4.58it/s] 96%|█████████▌| 10595/11066 [38:50<01:42, 4.58it/s] 96%|█████████▌| 10596/11066 [38:51<01:43, 4.55it/s] 96%|█████████▌| 10596/11066 [38:51<01:43, 4.55it/s] 96%|█████████▌| 10597/11066 [38:51<01:42, 4.59it/s] {'loss': 0.9331, 'learning_rate': 1.5778058919212e-06, 'epoch': 1.89} {'loss': 0.7206, 'learning_rate': 1.5750948852340502e-06, 'epoch': 1.89} {'loss': 0.5098, 'learning_rate': 1.5723838785469005e-06, 'epoch': 1.9} {'loss': 0.8802, 'learning_rate': 1.5696728718597507e-06, 'epoch': 1.9} {'loss': 0.4244, 'learning_rate': 1.5669618651726008e-06, 'epoch': 1.9} {'loss': 0.4698, 'learning_rate': 1.564250858485451e-06, 'epoch': 1.9} {'loss': 0.7666, 'learning_rate': 1.561539851798301e-06, 'epoch': 1.9} {'loss': 0.5374, 'learning_rate': 1.5588288451111514e-06, 'epoch': 1.9} {'loss': 0.5666, 'learning_rate': 1.5561178384240015e-06, 'epoch': 1.9} {'loss': 0.9331, 'learning_rate': 1.5534068317368517e-06, 'epoch': 1.9} {'loss': 1.0123, 'learning_rate': 1.5506958250497018e-06, 'epoch': 1.9} {'loss': 0.5551, 'learning_rate': 1.547984818362552e-06, 'epoch': 1.9} {'loss': 1.0967, 'learning_rate': 1.5452738116754023e-06, 'epoch': 1.9} {'loss': 0.6481, 'learning_rate': 1.5425628049882524e-06, 'epoch': 1.9} {'loss': 0.479, 'learning_rate': 1.5398517983011026e-06, 'epoch': 1.9} {'loss': 0.9286, 'learning_rate': 1.5371407916139527e-06, 'epoch': 1.9} {'loss': 0.6357, 'learning_rate': 1.5344297849268028e-06, 'epoch': 1.9} {'loss': 1.0608, 'learning_rate': 1.5317187782396532e-06, 'epoch': 1.9} {'loss': 1.2448, 'learning_rate': 1.5290077715525033e-06, 'epoch': 1.9} {'loss': 0.2996, 'learning_rate': 1.5262967648653534e-06, 'epoch': 1.9} {'loss': 0.8536, 'learning_rate': 1.5235857581782036e-06, 'epoch': 1.9} {'loss': 0.6186, 'learning_rate': 1.5208747514910537e-06, 'epoch': 1.9} {'loss': 0.8747, 'learning_rate': 1.518163744803904e-06, 'epoch': 1.9} {'loss': 0.5219, 'learning_rate': 1.5154527381167542e-06, 'epoch': 1.9} {'loss': 0.8289, 'learning_rate': 1.5127417314296043e-06, 'epoch': 1.9} {'loss': 0.5836, 'learning_rate': 1.5100307247424545e-06, 'epoch': 1.9} {'loss': 0.2553, 'learning_rate': 1.5073197180553046e-06, 'epoch': 1.9} {'loss': 0.544, 'learning_rate': 1.5046087113681547e-06, 'epoch': 1.9} {'loss': 0.2638, 'learning_rate': 1.501897704681005e-06, 'epoch': 1.9} {'loss': 0.5012, 'learning_rate': 1.4991866979938552e-06, 'epoch': 1.9} {'loss': 1.104, 'learning_rate': 1.4964756913067053e-06, 'epoch': 1.9} {'loss': 0.4988, 'learning_rate': 1.4937646846195555e-06, 'epoch': 1.9} {'loss': 0.8388, 'learning_rate': 1.4910536779324056e-06, 'epoch': 1.9} {'loss': 0.9396, 'learning_rate': 1.488342671245256e-06, 'epoch': 1.9} {'loss': 0.9373, 'learning_rate': 1.485631664558106e-06, 'epoch': 1.9} {'loss': 0.8816, 'learning_rate': 1.4829206578709562e-06, 'epoch': 1.9} {'loss': 0.4015, 'learning_rate': 1.4802096511838061e-06, 'epoch': 1.9} {'loss': 0.6419, 'learning_rate': 1.4774986444966563e-06, 'epoch': 1.9} {'loss': 0.6144, 'learning_rate': 1.4747876378095066e-06, 'epoch': 1.9} {'loss': 0.4473, 'learning_rate': 1.4720766311223568e-06, 'epoch': 1.9} {'loss': 0.7284, 'learning_rate': 1.469365624435207e-06, 'epoch': 1.9} {'loss': 0.3594, 'learning_rate': 1.466654617748057e-06, 'epoch': 1.9} {'loss': 0.9663, 'learning_rate': 1.4639436110609072e-06, 'epoch': 1.9} {'loss': 0.6046, 'learning_rate': 1.4612326043737575e-06, 'epoch': 1.9} {'loss': 0.7802, 'learning_rate': 1.4585215976866076e-06, 'epoch': 1.9} {'loss': 0.4117, 'learning_rate': 1.4558105909994578e-06, 'epoch': 1.9} {'loss': 0.9009, 'learning_rate': 1.453099584312308e-06, 'epoch': 1.9} {'loss': 0.5827, 'learning_rate': 1.450388577625158e-06, 'epoch': 1.9} {'loss': 0.8169, 'learning_rate': 1.4476775709380084e-06, 'epoch': 1.9} {'loss': 0.975, 'learning_rate': 1.4449665642508585e-06, 'epoch': 1.9} {'loss': 0.3795, 'learning_rate': 1.4422555575637087e-06, 'epoch': 1.9} {'loss': 0.8887, 'learning_rate': 1.4395445508765588e-06, 'epoch': 1.9} {'loss': 1.1393, 'learning_rate': 1.436833544189409e-06, 'epoch': 1.9} {'loss': 0.6201, 'learning_rate': 1.434122537502259e-06, 'epoch': 1.9} {'loss': 0.8955, 'learning_rate': 1.4314115308151094e-06, 'epoch': 1.9} {'loss': 0.8106, 'learning_rate': 1.4287005241279595e-06, 'epoch': 1.9} {'loss': 0.4805, 'learning_rate': 1.4259895174408097e-06, 'epoch': 1.9} {'loss': 0.5858, 'learning_rate': 1.4232785107536598e-06, 'epoch': 1.91} {'loss': 0.533, 'learning_rate': 1.42056750406651e-06, 'epoch': 1.91} {'loss': 0.5374, 'learning_rate': 1.4178564973793603e-06, 'epoch': 1.91} {'loss': 0.8659, 'learning_rate': 1.4151454906922104e-06, 'epoch': 1.91} {'loss': 0.302, 'learning_rate': 1.4124344840050606e-06, 'epoch': 1.91} {'loss': 0.9551, 'learning_rate': 1.4097234773179107e-06, 'epoch': 1.91} {'loss': 0.5668, 'learning_rate': 1.4070124706307608e-06, 'epoch': 1.91} {'loss': 0.5539, 'learning_rate': 1.4043014639436112e-06, 'epoch': 1.91} {'loss': 1.0328, 'learning_rate': 1.4015904572564613e-06, 'epoch': 1.91} {'loss': 0.5221, 'learning_rate': 1.3988794505693114e-06, 'epoch': 1.91} {'loss': 1.0415, 'learning_rate': 1.3961684438821616e-06, 'epoch': 1.91} {'loss': 0.8335, 'learning_rate': 1.3934574371950117e-06, 'epoch': 1.91} {'loss': 0.6166, 'learning_rate': 1.390746430507862e-06, 'epoch': 1.91} {'loss': 0.6832, 'learning_rate': 1.3880354238207122e-06, 'epoch': 1.91} {'loss': 0.5536, 'learning_rate': 1.3853244171335623e-06, 'epoch': 1.91} {'loss': 1.0655, 'learning_rate': 1.3826134104464125e-06, 'epoch': 1.91} {'loss': 0.8088, 'learning_rate': 1.3799024037592626e-06, 'epoch': 1.91} {'loss': 0.9028, 'learning_rate': 1.3771913970721127e-06, 'epoch': 1.91} {'loss': 0.6991, 'learning_rate': 1.374480390384963e-06, 'epoch': 1.91} {'loss': 0.8549, 'learning_rate': 1.3717693836978132e-06, 'epoch': 1.91} {'loss': 0.4908, 'learning_rate': 1.3690583770106633e-06, 'epoch': 1.91} {'loss': 0.6372, 'learning_rate': 1.3663473703235135e-06, 'epoch': 1.91} {'loss': 0.797, 'learning_rate': 1.3636363636363636e-06, 'epoch': 1.91} {'loss': 0.5636, 'learning_rate': 1.360925356949214e-06, 'epoch': 1.91} {'loss': 0.7699, 'learning_rate': 1.358214350262064e-06, 'epoch': 1.91} {'loss': 0.6549, 'learning_rate': 1.3555033435749142e-06, 'epoch': 1.91} {'loss': 0.7668, 'learning_rate': 1.3527923368877644e-06, 'epoch': 1.91} {'loss': 0.4243, 'learning_rate': 1.3500813302006145e-06, 'epoch': 1.91} {'loss': 0.3843, 'learning_rate': 1.3473703235134648e-06, 'epoch': 1.91} {'loss': 0.6633, 'learning_rate': 1.344659316826315e-06, 'epoch': 1.91} {'loss': 0.4826, 'learning_rate': 1.3419483101391651e-06, 'epoch': 1.91} {'loss': 0.9356, 'learning_rate': 1.3392373034520152e-06, 'epoch': 1.91} {'loss': 0.7392, 'learning_rate': 1.3365262967648654e-06, 'epoch': 1.91} {'loss': 0.4416, 'learning_rate': 1.3338152900777157e-06, 'epoch': 1.91} {'loss': 0.8884, 'learning_rate': 1.3311042833905659e-06, 'epoch': 1.91} {'loss': 0.5443, 'learning_rate': 1.328393276703416e-06, 'epoch': 1.91} {'loss': 0.4771, 'learning_rate': 1.3256822700162661e-06, 'epoch': 1.91} {'loss': 0.4661, 'learning_rate': 1.3229712633291163e-06, 'epoch': 1.91} {'loss': 0.623, 'learning_rate': 1.3202602566419666e-06, 'epoch': 1.91} {'loss': 0.5801, 'learning_rate': 1.3175492499548167e-06, 'epoch': 1.91} {'loss': 1.3424, 'learning_rate': 1.3148382432676669e-06, 'epoch': 1.91} {'loss': 0.4303, 'learning_rate': 1.312127236580517e-06, 'epoch': 1.91} {'loss': 1.2358, 'learning_rate': 1.3094162298933671e-06, 'epoch': 1.91} {'loss': 1.0214, 'learning_rate': 1.306705223206217e-06, 'epoch': 1.91} {'loss': 0.7718, 'learning_rate': 1.3039942165190674e-06, 'epoch': 1.91} {'loss': 1.1999, 'learning_rate': 1.3012832098319175e-06, 'epoch': 1.91} {'loss': 0.7123, 'learning_rate': 1.2985722031447677e-06, 'epoch': 1.91} {'loss': 0.7926, 'learning_rate': 1.2958611964576178e-06, 'epoch': 1.91} {'loss': 1.3456, 'learning_rate': 1.293150189770468e-06, 'epoch': 1.91} {'loss': 0.2802, 'learning_rate': 1.2904391830833183e-06, 'epoch': 1.91} {'loss': 1.2769, 'learning_rate': 1.2877281763961684e-06, 'epoch': 1.91} {'loss': 0.559, 'learning_rate': 1.2850171697090186e-06, 'epoch': 1.91} {'loss': 0.7939, 'learning_rate': 1.2823061630218687e-06, 'epoch': 1.91} {'loss': 0.8965, 'learning_rate': 1.2795951563347188e-06, 'epoch': 1.91} {'loss': 0.3305, 'learning_rate': 1.2768841496475692e-06, 'epoch': 1.91} {'loss': 1.4532, 'learning_rate': 1.2741731429604193e-06, 'epoch': 1.92} 96%|█████████▌| 10597/11066 [38:51<01:42, 4.59it/s] 96%|█████████▌| 10598/11066 [38:51<01:42, 4.54it/s] 96%|█████████▌| 10598/11066 [38:51<01:42, 4.54it/s] 96%|█████████▌| 10599/11066 [38:51<01:43, 4.53it/s] 96%|█████████▌| 10599/11066 [38:51<01:43, 4.53it/s] 96%|█████████▌| 10600/11066 [38:52<01:43, 4.51it/s] 96%|█████████▌| 10600/11066 [38:52<01:43, 4.51it/s] 96%|█████████▌| 10601/11066 [38:52<01:43, 4.51it/s] 96%|█████████▌| 10601/11066 [38:52<01:43, 4.51it/s] 96%|█████████▌| 10602/11066 [38:52<01:43, 4.50it/s] 96%|█████████▌| 10602/11066 [38:52<01:43, 4.50it/s] 96%|█████████▌| 10603/11066 [38:52<01:43, 4.45it/s] 96%|█████████▌| 10603/11066 [38:52<01:43, 4.45it/s] 96%|█████████▌| 10604/11066 [38:52<01:42, 4.49it/s] 96%|█████████▌| 10604/11066 [38:52<01:42, 4.49it/s] 96%|█████████▌| 10605/11066 [38:53<01:40, 4.57it/s] 96%|█████████▌| 10605/11066 [38:53<01:40, 4.57it/s] 96%|█████████▌| 10606/11066 [38:53<01:41, 4.55it/s] 96%|█████████▌| 10606/11066 [38:53<01:41, 4.55it/s] 96%|█████████▌| 10607/11066 [38:53<01:41, 4.54it/s] 96%|█████████▌| 10607/11066 [38:53<01:41, 4.54it/s] 96%|█████████▌| 10608/11066 [38:53<01:41, 4.53it/s] 96%|█████████▌| 10608/11066 [38:53<01:41, 4.53it/s] 96%|█████████▌| 10609/11066 [38:54<01:40, 4.55it/s] 96%|█████████▌| 10609/11066 [38:54<01:40, 4.55it/s] 96%|█████████▌| 10610/11066 [38:54<01:39, 4.58it/s] 96%|█████████▌| 10610/11066 [38:54<01:39, 4.58it/s] 96%|█████████▌| 10611/11066 [38:54<01:39, 4.58it/s] 96%|█████████▌| 10611/11066 [38:54<01:39, 4.58it/s] 96%|█████████▌| 10612/11066 [38:54<01:42, 4.43it/s] 96%|█████████▌| 10612/11066 [38:54<01:42, 4.43it/s] 96%|█████████▌| 10613/11066 [38:54<01:43, 4.39it/s] 96%|█████████▌| 10613/11066 [38:54<01:43, 4.39it/s] 96%|█████████▌| 10614/11066 [38:55<01:42, 4.40it/s] 96%|█████████▌| 10614/11066 [38:55<01:42, 4.40it/s] 96%|█████████▌| 10615/11066 [38:55<01:43, 4.37it/s] 96%|█████████▌| 10615/11066 [38:55<01:43, 4.37it/s] 96%|█████████▌| 10616/11066 [38:55<01:44, 4.30it/s] 96%|█████████▌| 10616/11066 [38:55<01:44, 4.30it/s] 96%|█████████▌| 10617/11066 [38:55<01:43, 4.33it/s] 96%|█████████▌| 10617/11066 [38:55<01:43, 4.33it/s] 96%|█████████▌| 10618/11066 [38:56<01:42, 4.38it/s] 96%|█████████▌| 10618/11066 [38:56<01:42, 4.38it/s] 96%|█████████▌| 10619/11066 [38:56<01:42, 4.36it/s] 96%|█████████▌| 10619/11066 [38:56<01:42, 4.36it/s] 96%|█████████▌| 10620/11066 [38:56<01:41, 4.39it/s] 96%|█████████▌| 10620/11066 [38:56<01:41, 4.39it/s] 96%|█████████▌| 10621/11066 [38:56<01:39, 4.48it/s] 96%|█████████▌| 10621/11066 [38:56<01:39, 4.48it/s] 96%|█████████▌| 10622/11066 [38:57<01:38, 4.52it/s] 96%|█████████▌| 10622/11066 [38:57<01:38, 4.52it/s] 96%|█████████▌| 10623/11066 [38:57<01:38, 4.49it/s] 96%|█████████▌| 10623/11066 [38:57<01:38, 4.49it/s] 96%|█████████▌| 10624/11066 [38:57<01:37, 4.52it/s] 96%|█████████▌| 10624/11066 [38:57<01:37, 4.52it/s] 96%|█████████▌| 10625/11066 [38:57<01:37, 4.54it/s] 96%|█████████▌| 10625/11066 [38:57<01:37, 4.54it/s] 96%|█████████▌| 10626/11066 [38:57<01:36, 4.56it/s] 96%|█████████▌| 10626/11066 [38:57<01:36, 4.56it/s] 96%|█████████▌| 10627/11066 [38:58<01:35, 4.60it/s] 96%|█████████▌| 10627/11066 [38:58<01:35, 4.60it/s] 96%|█████████▌| 10628/11066 [38:58<01:35, 4.59it/s] 96%|█████████▌| 10628/11066 [38:58<01:35, 4.59it/s] 96%|█████████▌| 10629/11066 [38:58<01:34, 4.60it/s] 96%|█████████▌| 10629/11066 [38:58<01:34, 4.60it/s] 96%|█████████▌| 10630/11066 [38:58<01:35, 4.55it/s] 96%|█████████▌| 10630/11066 [38:58<01:35, 4.55it/s] 96%|█████████▌| 10631/11066 [38:58<01:36, 4.53it/s] 96%|█████████▌| 10631/11066 [38:58<01:36, 4.53it/s] 96%|█████████▌| 10632/11066 [38:59<01:36, 4.52it/s] 96%|█████████▌| 10632/11066 [38:59<01:36, 4.52it/s] 96%|█████████▌| 10633/11066 [38:59<01:35, 4.51it/s] 96%|█████████▌| 10633/11066 [38:59<01:35, 4.51it/s] 96%|█████████▌| 10634/11066 [38:59<01:35, 4.51it/s] 96%|█████████▌| 10634/11066 [38:59<01:35, 4.51it/s] 96%|█████████▌| 10635/11066 [38:59<01:34, 4.54it/s] 96%|█████████▌| 10635/11066 [38:59<01:34, 4.54it/s] 96%|█████████▌| 10636/11066 [39:00<01:33, 4.58it/s] 96%|█████████▌| 10636/11066 [39:00<01:33, 4.58it/s] 96%|█████████▌| 10637/11066 [39:00<01:34, 4.54it/s] 96%|█████████▌| 10637/11066 [39:00<01:34, 4.54it/s] 96%|█████████▌| 10638/11066 [39:00<01:34, 4.52it/s] 96%|█████████▌| 10638/11066 [39:00<01:34, 4.52it/s] 96%|█████████▌| 10639/11066 [39:00<01:33, 4.57it/s] 96%|█████████▌| 10639/11066 [39:00<01:33, 4.57it/s] 96%|█████████▌| 10640/11066 [39:00<01:32, 4.58it/s] 96%|█████████▌| 10640/11066 [39:00<01:32, 4.58it/s] 96%|█████████▌| 10641/11066 [39:01<01:32, 4.57it/s] 96%|█████████▌| 10641/11066 [39:01<01:32, 4.57it/s] 96%|█████████▌| 10642/11066 [39:01<01:32, 4.59it/s] 96%|█████████▌| 10642/11066 [39:01<01:32, 4.59it/s] 96%|█████████▌| 10643/11066 [39:01<01:33, 4.54it/s] 96%|█████████▌| 10643/11066 [39:01<01:33, 4.54it/s] 96%|█████████▌| 10644/11066 [39:01<01:32, 4.58it/s] 96%|█████████▌| 10644/11066 [39:01<01:32, 4.58it/s] 96%|█████████▌| 10645/11066 [39:02<01:31, 4.59it/s] 96%|█████████▌| 10645/11066 [39:02<01:31, 4.59it/s] 96%|█████████▌| 10646/11066 [39:02<01:32, 4.55it/s] 96%|█████████▌| 10646/11066 [39:02<01:32, 4.55it/s] 96%|█████████▌| 10647/11066 [39:02<01:32, 4.52it/s] 96%|█████████▌| 10647/11066 [39:02<01:32, 4.52it/s] 96%|█████████▌| 10648/11066 [39:02<01:32, 4.52it/s] 96%|█████████▌| 10648/11066 [39:02<01:32, 4.52it/s] 96%|█████████▌| 10649/11066 [39:02<01:31, 4.54it/s] 96%|█████████▌| 10649/11066 [39:02<01:31, 4.54it/s] 96%|█████████▌| 10650/11066 [39:03<01:31, 4.54it/s] 96%|█████████▌| 10650/11066 [39:03<01:31, 4.54it/s] 96%|█████████▌| 10651/11066 [39:03<01:30, 4.58it/s] 96%|█████████▌| 10651/11066 [39:03<01:30, 4.58it/s] 96%|█████████▋| 10652/11066 [39:03<01:30, 4.57it/s] 96%|█████████▋| 10652/11066 [39:03<01:30, 4.57it/s] 96%|█████████▋| 10653/11066 [39:03<01:29, 4.63it/s] 96%|█████████▋| 10653/11066 [39:03<01:29, 4.63it/s] 96%|█████████▋| 10654/11066 [39:04<01:29, 4.62it/s] 96%|█████████▋| 10654/11066 [39:04<01:29, 4.62it/s] 96%|█████████▋| 10655/11066 [39:04<01:29, 4.61it/s] 96%|█████████▋| 10655/11066 [39:04<01:29, 4.61it/s] 96%|█████████▋| 10656/11066 [39:04<01:28, 4.62it/s] 96%|█████████▋| 10656/11066 [39:04<01:28, 4.62it/s] 96%|█████████▋| 10657/11066 [39:04<01:28, 4.62it/s] 96%|█████████▋| 10657/11066 [39:04<01:28, 4.62it/s] 96%|█████████▋| 10658/11066 [39:04<01:28, 4.61it/s] 96%|█████████▋| 10658/11066 [39:04<01:28, 4.61it/s] 96%|█████████▋| 10659/11066 [39:05<01:29, 4.55it/s] 96%|█████████▋| 10659/11066 [39:05<01:29, 4.55it/s] 96%|█████████▋| 10660/11066 [39:05<01:29, 4.53it/s] 96%|█████████▋| 10660/11066 [39:05<01:29, 4.53it/s] 96%|█████████▋| 10661/11066 [39:05<01:29, 4.52it/s] 96%|█████████▋| 10661/11066 [39:05<01:29, 4.52it/s] 96%|█████████▋| 10662/11066 [39:05<01:29, 4.51it/s] 96%|█████████▋| 10662/11066 [39:05<01:29, 4.51it/s] 96%|█████████▋| 10663/11066 [39:06<01:29, 4.51it/s] 96%|█████████▋| 10663/11066 [39:06<01:29, 4.51it/s] 96%|█████████▋| 10664/11066 [39:06<01:29, 4.51it/s] 96%|█████████▋| 10664/11066 [39:06<01:29, 4.51it/s] 96%|█████████▋| 10665/11066 [39:06<01:28, 4.51it/s] 96%|█████████▋| 10665/11066 [39:06<01:28, 4.51it/s] 96%|█████████▋| 10666/11066 [39:06<01:28, 4.50it/s] 96%|█████████▋| 10666/11066 [39:06<01:28, 4.50it/s] 96%|█████████▋| 10667/11066 [39:06<01:28, 4.50it/s] 96%|█████████▋| 10667/11066 [39:06<01:28, 4.50it/s] 96%|█████████▋| 10668/11066 [39:07<01:28, 4.49it/s] 96%|█████████▋| 10668/11066 [39:07<01:28, 4.49it/s] 96%|█████████▋| 10669/11066 [39:07<01:28, 4.49it/s] 96%|█████████▋| 10669/11066 [39:07<01:28, 4.49it/s] 96%|█████████▋| 10670/11066 [39:07<01:28, 4.49it/s] 96%|█████████▋| 10670/11066 [39:07<01:28, 4.49it/s] 96%|█████████▋| 10671/11066 [39:07<01:28, 4.48it/s] 96%|█████████▋| 10671/11066 [39:07<01:28, 4.48it/s] 96%|█████████▋| 10672/11066 [39:08<01:26, 4.55it/s] 96%|█████████▋| 10672/11066 [39:08<01:26, 4.55it/s] 96%|█████████▋| 10673/11066 [39:08<01:25, 4.59it/s] 96%|█████████▋| 10673/11066 [39:08<01:25, 4.59it/s] 96%|█████████▋| 10674/11066 [39:08<01:24, 4.63it/s] 96%|█████████▋| 10674/11066 [39:08<01:24, 4.63it/s] 96%|█████████▋| 10675/11066 [39:08<01:24, 4.63it/s] 96%|█████████▋| 10675/11066 [39:08<01:24, 4.63it/s] 96%|█████████▋| 10676/11066 [39:08<01:23, 4.67it/s] 96%|█████████▋| 10676/11066 [39:08<01:23, 4.67it/s] 96%|█████████▋| 10677/11066 [39:09<01:23, 4.65it/s] 96%|█████████▋| 10677/11066 [39:09<01:23, 4.65it/s] 96%|█████████▋| 10678/11066 [39:09<01:23, 4.64it/s] 96%|█████████▋| 10678/11066 [39:09<01:23, 4.64it/s] 97%|█████████▋| 10679/11066 [39:09<01:22, 4.67it/s] 97%|█████████▋| 10679/11066 [39:09<01:22, 4.67it/s] 97%|█████████▋| 10680/11066 [39:09<01:22, 4.66it/s] 97%|█████████▋| 10680/11066 [39:09<01:22, 4.66it/s] 97%|█████████▋| 10681/11066 [39:09<01:21, 4.70it/s] 97%|█████████▋| 10681/11066 [39:09<01:21, 4.70it/s] 97%|█████████▋| 10682/11066 [39:10<01:21, 4.69it/s] 97%|█████████▋| 10682/11066 [39:10<01:21, 4.69it/s] 97%|█████████▋| 10683/11066 [39:10<01:21, 4.70it/s] 97%|█████████▋| 10683/11066 [39:10<01:21, 4.70it/s] 97%|█████████▋| 10684/11066 [39:10<01:21, 4.67it/s] 97%|█████████▋| 10684/11066 [39:10<01:21, 4.67it/s] 97%|█████████▋| 10685/11066 [39:10<01:22, 4.60it/s] 97%|█████████▋| 10685/11066 [39:10<01:22, 4.60it/s] 97%|█████████▋| 10686/11066 [39:11<01:22, 4.62it/s] 97%|█████████▋| 10686/11066 [39:11<01:22, 4.62it/s] 97%|█████████▋| 10687/11066 [39:11<01:22, 4.58it/s] 97%|█████████▋| 10687/11066 [39:11<01:22, 4.58it/s] 97%|█████████▋| 10688/11066 [39:11<01:21, 4.61it/s] 97%|█████████▋| 10688/11066 [39:11<01:21, 4.61it/s] 97%|█████████▋| 10689/11066 [39:11<01:21, 4.61it/s] 97%|█████████▋| 10689/11066 [39:11<01:21, 4.61it/s] 97%|█████████▋| 10690/11066 [39:11<01:21, 4.64it/s] 97%|█████████▋| 10690/11066 [39:11<01:21, 4.64it/s] 97%|█████████▋| 10691/11066 [39:12<01:20, 4.66it/s] 97%|█████████▋| 10691/11066 [39:12<01:20, 4.66it/s] 97%|█████████▋| 10692/11066 [39:12<01:21, 4.60it/s] 97%|█████████▋| 10692/11066 [39:12<01:21, 4.60it/s] 97%|█████████▋| 10693/11066 [39:12<01:20, 4.64it/s] 97%|█████████▋| 10693/11066 [39:12<01:20, 4.64it/s] 97%|█████████▋| 10694/11066 [39:12<01:19, 4.67it/s] 97%|█████████▋| 10694/11066 [39:12<01:19, 4.67it/s] 97%|█████████▋| 10695/11066 [39:12<01:19, 4.68it/s] 97%|█████████▋| 10695/11066 [39:12<01:19, 4.68it/s] 97%|█████████▋| 10696/11066 [39:13<01:18, 4.69it/s] 97%|█████████▋| 10696/11066 [39:13<01:18, 4.69it/s] 97%|█████████▋| 10697/11066 [39:13<01:18, 4.70it/s] 97%|█████████▋| 10697/11066 [39:13<01:18, 4.70it/s] 97%|█████████▋| 10698/11066 [39:13<01:18, 4.70it/s] 97%|█████████▋| 10698/11066 [39:13<01:18, 4.70it/s] 97%|█████████▋| 10699/11066 [39:13<01:18, 4.70it/s] 97%|█████████▋| 10699/11066 [39:13<01:18, 4.70it/s] 97%|█████████▋| 10700/11066 [39:14<01:17, 4.70it/s] 97%|█████████▋| 10700/11066 [39:14<01:17, 4.70it/s] 97%|█████████▋| 10701/11066 [39:14<01:17, 4.70it/s] 97%|█████████▋| 10701/11066 [39:14<01:17, 4.70it/s] 97%|█████████▋| 10702/11066 [39:14<01:17, 4.71it/s] 97%|█████████▋| 10702/11066 [39:14<01:17, 4.71it/s] 97%|█████████▋| 10703/11066 [39:14<01:18, 4.65it/s] 97%|█████████▋| 10703/11066 [39:14<01:18, 4.65it/s] 97%|█████████▋| 10704/11066 [39:14<01:17, 4.67it/s] 97%|█████████▋| 10704/11066 [39:14<01:17, 4.67it/s] 97%|█████████▋| 10705/11066 [39:15<01:17, 4.69it/s] 97%|█████████▋| 10705/11066 [39:15<01:17, 4.69it/s] 97%|█████████▋| 10706/11066 [39:15<01:17, 4.63it/s] 97%|█████████▋| 10706/11066 [39:15<01:17, 4.63it/s] 97%|█████████▋| 10707/11066 [39:15<01:17, 4.65it/s] 97%|█████████▋| 10707/11066 [39:15<01:17, 4.65it/s] 97%|█████████▋| 10708/11066 [39:15<01:17, 4.60it/s] 97%|█████████▋| 10708/11066 [39:15<01:17, 4.60it/s] 97%|█████████▋| 10709/11066 [39:15<01:17, 4.62it/s] {'loss': 1.1457, 'learning_rate': 1.2714621362732694e-06, 'epoch': 1.92} {'loss': 0.6433, 'learning_rate': 1.2687511295861196e-06, 'epoch': 1.92} {'loss': 0.5456, 'learning_rate': 1.2660401228989697e-06, 'epoch': 1.92} {'loss': 1.2682, 'learning_rate': 1.26332911621182e-06, 'epoch': 1.92} {'loss': 0.661, 'learning_rate': 1.2606181095246702e-06, 'epoch': 1.92} {'loss': 0.8911, 'learning_rate': 1.2579071028375203e-06, 'epoch': 1.92} {'loss': 0.3676, 'learning_rate': 1.2551960961503705e-06, 'epoch': 1.92} {'loss': 0.3337, 'learning_rate': 1.2524850894632206e-06, 'epoch': 1.92} {'loss': 0.9288, 'learning_rate': 1.249774082776071e-06, 'epoch': 1.92} {'loss': 0.4938, 'learning_rate': 1.247063076088921e-06, 'epoch': 1.92} {'loss': 0.8888, 'learning_rate': 1.2443520694017712e-06, 'epoch': 1.92} {'loss': 1.0016, 'learning_rate': 1.2416410627146213e-06, 'epoch': 1.92} {'loss': 0.91, 'learning_rate': 1.2389300560274715e-06, 'epoch': 1.92} {'loss': 0.4438, 'learning_rate': 1.2362190493403216e-06, 'epoch': 1.92} {'loss': 0.5128, 'learning_rate': 1.233508042653172e-06, 'epoch': 1.92} {'loss': 0.914, 'learning_rate': 1.230797035966022e-06, 'epoch': 1.92} {'loss': 0.9649, 'learning_rate': 1.2280860292788722e-06, 'epoch': 1.92} {'loss': 0.612, 'learning_rate': 1.2253750225917224e-06, 'epoch': 1.92} {'loss': 0.4757, 'learning_rate': 1.2226640159045725e-06, 'epoch': 1.92} {'loss': 0.6444, 'learning_rate': 1.2199530092174228e-06, 'epoch': 1.92} {'loss': 0.6658, 'learning_rate': 1.217242002530273e-06, 'epoch': 1.92} {'loss': 0.3485, 'learning_rate': 1.2145309958431231e-06, 'epoch': 1.92} {'loss': 0.8744, 'learning_rate': 1.2118199891559733e-06, 'epoch': 1.92} {'loss': 0.9037, 'learning_rate': 1.2091089824688234e-06, 'epoch': 1.92} {'loss': 0.9285, 'learning_rate': 1.2063979757816737e-06, 'epoch': 1.92} {'loss': 0.2973, 'learning_rate': 1.2036869690945239e-06, 'epoch': 1.92} {'loss': 0.9977, 'learning_rate': 1.200975962407374e-06, 'epoch': 1.92} {'loss': 0.8466, 'learning_rate': 1.1982649557202241e-06, 'epoch': 1.92} {'loss': 0.5699, 'learning_rate': 1.1955539490330743e-06, 'epoch': 1.92} {'loss': 0.3273, 'learning_rate': 1.1928429423459246e-06, 'epoch': 1.92} {'loss': 0.9475, 'learning_rate': 1.1901319356587747e-06, 'epoch': 1.92} {'loss': 0.694, 'learning_rate': 1.1874209289716249e-06, 'epoch': 1.92} {'loss': 1.0804, 'learning_rate': 1.184709922284475e-06, 'epoch': 1.92} {'loss': 0.5092, 'learning_rate': 1.1819989155973252e-06, 'epoch': 1.92} {'loss': 1.2004, 'learning_rate': 1.1792879089101755e-06, 'epoch': 1.92} {'loss': 0.3413, 'learning_rate': 1.1765769022230256e-06, 'epoch': 1.92} {'loss': 0.6452, 'learning_rate': 1.1738658955358758e-06, 'epoch': 1.92} {'loss': 0.8279, 'learning_rate': 1.171154888848726e-06, 'epoch': 1.92} {'loss': 0.3293, 'learning_rate': 1.168443882161576e-06, 'epoch': 1.92} {'loss': 0.5474, 'learning_rate': 1.1657328754744262e-06, 'epoch': 1.92} {'loss': 0.1642, 'learning_rate': 1.1630218687872765e-06, 'epoch': 1.92} {'loss': 0.2176, 'learning_rate': 1.1603108621001266e-06, 'epoch': 1.92} {'loss': 0.2949, 'learning_rate': 1.1575998554129768e-06, 'epoch': 1.92} {'loss': 1.0473, 'learning_rate': 1.154888848725827e-06, 'epoch': 1.92} {'loss': 0.6519, 'learning_rate': 1.152177842038677e-06, 'epoch': 1.92} {'loss': 0.3889, 'learning_rate': 1.1494668353515274e-06, 'epoch': 1.92} {'loss': 1.0133, 'learning_rate': 1.1467558286643775e-06, 'epoch': 1.92} {'loss': 0.8063, 'learning_rate': 1.1440448219772277e-06, 'epoch': 1.92} {'loss': 0.3005, 'learning_rate': 1.1413338152900778e-06, 'epoch': 1.92} {'loss': 0.7134, 'learning_rate': 1.138622808602928e-06, 'epoch': 1.92} {'loss': 0.8426, 'learning_rate': 1.1359118019157783e-06, 'epoch': 1.92} {'loss': 0.6039, 'learning_rate': 1.1332007952286282e-06, 'epoch': 1.92} {'loss': 0.939, 'learning_rate': 1.1304897885414783e-06, 'epoch': 1.92} {'loss': 0.7691, 'learning_rate': 1.1277787818543285e-06, 'epoch': 1.92} {'loss': 0.8365, 'learning_rate': 1.1250677751671786e-06, 'epoch': 1.92} {'loss': 0.4931, 'learning_rate': 1.122356768480029e-06, 'epoch': 1.93} {'loss': 0.4145, 'learning_rate': 1.119645761792879e-06, 'epoch': 1.93} {'loss': 1.2955, 'learning_rate': 1.1169347551057292e-06, 'epoch': 1.93} {'loss': 1.2013, 'learning_rate': 1.1142237484185794e-06, 'epoch': 1.93} {'loss': 0.7726, 'learning_rate': 1.1115127417314295e-06, 'epoch': 1.93} {'loss': 0.967, 'learning_rate': 1.1088017350442798e-06, 'epoch': 1.93} {'loss': 0.7377, 'learning_rate': 1.10609072835713e-06, 'epoch': 1.93} {'loss': 0.4264, 'learning_rate': 1.10337972166998e-06, 'epoch': 1.93} {'loss': 0.9541, 'learning_rate': 1.1006687149828302e-06, 'epoch': 1.93} {'loss': 0.5297, 'learning_rate': 1.0979577082956804e-06, 'epoch': 1.93} {'loss': 0.5817, 'learning_rate': 1.0952467016085305e-06, 'epoch': 1.93} {'loss': 1.2802, 'learning_rate': 1.0925356949213809e-06, 'epoch': 1.93} {'loss': 0.6664, 'learning_rate': 1.089824688234231e-06, 'epoch': 1.93} {'loss': 0.5913, 'learning_rate': 1.0871136815470811e-06, 'epoch': 1.93} {'loss': 0.444, 'learning_rate': 1.0844026748599313e-06, 'epoch': 1.93} {'loss': 0.655, 'learning_rate': 1.0816916681727814e-06, 'epoch': 1.93} {'loss': 0.7119, 'learning_rate': 1.0789806614856317e-06, 'epoch': 1.93} {'loss': 0.2152, 'learning_rate': 1.0762696547984819e-06, 'epoch': 1.93} {'loss': 0.5829, 'learning_rate': 1.073558648111332e-06, 'epoch': 1.93} {'loss': 0.6183, 'learning_rate': 1.0708476414241821e-06, 'epoch': 1.93} {'loss': 0.8399, 'learning_rate': 1.0681366347370323e-06, 'epoch': 1.93} {'loss': 1.498, 'learning_rate': 1.0654256280498826e-06, 'epoch': 1.93} {'loss': 0.5784, 'learning_rate': 1.0627146213627328e-06, 'epoch': 1.93} {'loss': 0.9685, 'learning_rate': 1.0600036146755829e-06, 'epoch': 1.93} {'loss': 0.2872, 'learning_rate': 1.057292607988433e-06, 'epoch': 1.93} {'loss': 0.9061, 'learning_rate': 1.0545816013012832e-06, 'epoch': 1.93} {'loss': 0.2961, 'learning_rate': 1.0518705946141335e-06, 'epoch': 1.93} {'loss': 1.3998, 'learning_rate': 1.0491595879269836e-06, 'epoch': 1.93} {'loss': 0.9921, 'learning_rate': 1.0464485812398338e-06, 'epoch': 1.93} {'loss': 0.6809, 'learning_rate': 1.043737574552684e-06, 'epoch': 1.93} {'loss': 0.9405, 'learning_rate': 1.041026567865534e-06, 'epoch': 1.93} {'loss': 0.4087, 'learning_rate': 1.0383155611783842e-06, 'epoch': 1.93} {'loss': 0.7111, 'learning_rate': 1.0356045544912345e-06, 'epoch': 1.93} {'loss': 0.3934, 'learning_rate': 1.0328935478040847e-06, 'epoch': 1.93} {'loss': 0.4026, 'learning_rate': 1.0301825411169348e-06, 'epoch': 1.93} {'loss': 0.973, 'learning_rate': 1.027471534429785e-06, 'epoch': 1.93} {'loss': 0.4613, 'learning_rate': 1.024760527742635e-06, 'epoch': 1.93} {'loss': 0.7476, 'learning_rate': 1.0220495210554854e-06, 'epoch': 1.93} {'loss': 0.2904, 'learning_rate': 1.0193385143683355e-06, 'epoch': 1.93} {'loss': 0.7323, 'learning_rate': 1.0166275076811857e-06, 'epoch': 1.93} {'loss': 0.6783, 'learning_rate': 1.0139165009940358e-06, 'epoch': 1.93} {'loss': 0.6938, 'learning_rate': 1.011205494306886e-06, 'epoch': 1.93} {'loss': 0.7717, 'learning_rate': 1.0084944876197363e-06, 'epoch': 1.93} {'loss': 0.8241, 'learning_rate': 1.0057834809325864e-06, 'epoch': 1.93} {'loss': 1.4782, 'learning_rate': 1.0030724742454366e-06, 'epoch': 1.93} {'loss': 1.1774, 'learning_rate': 1.0003614675582867e-06, 'epoch': 1.93} {'loss': 0.6376, 'learning_rate': 9.976504608711368e-07, 'epoch': 1.93} {'loss': 0.4407, 'learning_rate': 9.949394541839872e-07, 'epoch': 1.93} {'loss': 0.6535, 'learning_rate': 9.922284474968373e-07, 'epoch': 1.93} {'loss': 1.0971, 'learning_rate': 9.895174408096874e-07, 'epoch': 1.93} {'loss': 0.3355, 'learning_rate': 9.868064341225376e-07, 'epoch': 1.93} {'loss': 0.8386, 'learning_rate': 9.840954274353877e-07, 'epoch': 1.93} {'loss': 1.2594, 'learning_rate': 9.81384420748238e-07, 'epoch': 1.93} {'loss': 1.3227, 'learning_rate': 9.786734140610882e-07, 'epoch': 1.93} {'loss': 0.7263, 'learning_rate': 9.759624073739383e-07, 'epoch': 1.93} {'loss': 0.4048, 'learning_rate': 9.732514006867885e-07, 'epoch': 1.94} {'loss': 0.5995, 'learning_rate': 9.705403939996386e-07, 'epoch': 1.94} 97%|█████████▋| 10709/11066 [39:15<01:17, 4.62it/s] 97%|█████████▋| 10710/11066 [39:16<01:16, 4.65it/s] 97%|█████████▋| 10710/11066 [39:16<01:16, 4.65it/s] 97%|█████████▋| 10711/11066 [39:16<01:15, 4.67it/s] 97%|█████████▋| 10711/11066 [39:16<01:15, 4.67it/s] 97%|█████████▋| 10712/11066 [39:16<01:16, 4.65it/s] 97%|█████████▋| 10712/11066 [39:16<01:16, 4.65it/s] 97%|█████████▋| 10713/11066 [39:16<01:16, 4.59it/s] 97%|█████████▋| 10713/11066 [39:16<01:16, 4.59it/s] 97%|█████████▋| 10714/11066 [39:17<01:17, 4.55it/s] 97%|█████████▋| 10714/11066 [39:17<01:17, 4.55it/s] 97%|█████████▋| 10715/11066 [39:17<01:17, 4.52it/s] 97%|█████████▋| 10715/11066 [39:17<01:17, 4.52it/s] 97%|█████████▋| 10716/11066 [39:17<01:16, 4.58it/s] 97%|█████████▋| 10716/11066 [39:17<01:16, 4.58it/s] 97%|█████████▋| 10717/11066 [39:17<01:16, 4.55it/s] 97%|█████████▋| 10717/11066 [39:17<01:16, 4.55it/s] 97%|█████████▋| 10718/11066 [39:17<01:15, 4.60it/s] 97%|█████████▋| 10718/11066 [39:17<01:15, 4.60it/s] 97%|█████████▋| 10719/11066 [39:18<01:14, 4.63it/s] 97%|█████████▋| 10719/11066 [39:18<01:14, 4.63it/s] 97%|█████████▋| 10720/11066 [39:18<01:14, 4.66it/s] 97%|█████████▋| 10720/11066 [39:18<01:14, 4.66it/s] 97%|█████████▋| 10721/11066 [39:18<01:14, 4.65it/s] 97%|█████████▋| 10721/11066 [39:18<01:14, 4.65it/s] 97%|█████████▋| 10722/11066 [39:18<01:13, 4.69it/s] 97%|█████████▋| 10722/11066 [39:18<01:13, 4.69it/s] 97%|█████████▋| 10723/11066 [39:18<01:13, 4.69it/s] 97%|█████████▋| 10723/11066 [39:18<01:13, 4.69it/s] 97%|█████████▋| 10724/11066 [39:19<01:13, 4.66it/s] 97%|█████████▋| 10724/11066 [39:19<01:13, 4.66it/s] 97%|█████████▋| 10725/11066 [39:19<01:12, 4.69it/s] 97%|█████████▋| 10725/11066 [39:19<01:12, 4.69it/s] 97%|█████████▋| 10726/11066 [39:19<01:14, 4.55it/s] 97%|█████████▋| 10726/11066 [39:19<01:14, 4.55it/s] 97%|█████████▋| 10727/11066 [39:19<01:15, 4.50it/s] 97%|█████████▋| 10727/11066 [39:19<01:15, 4.50it/s] 97%|█████████▋| 10728/11066 [39:20<01:15, 4.50it/s] 97%|█████████▋| 10728/11066 [39:20<01:15, 4.50it/s] 97%|█████████▋| 10729/11066 [39:20<01:14, 4.50it/s] 97%|█████████▋| 10729/11066 [39:20<01:14, 4.50it/s] 97%|█████████▋| 10730/11066 [39:20<01:15, 4.45it/s] 97%|█████████▋| 10730/11066 [39:20<01:15, 4.45it/s] 97%|█████████▋| 10731/11066 [39:20<01:15, 4.46it/s] 97%|█████████▋| 10731/11066 [39:20<01:15, 4.46it/s] 97%|█████████▋| 10732/11066 [39:20<01:14, 4.47it/s] 97%|█████████▋| 10732/11066 [39:20<01:14, 4.47it/s] 97%|█████████▋| 10733/11066 [39:21<01:14, 4.48it/s] 97%|█████████▋| 10733/11066 [39:21<01:14, 4.48it/s] 97%|█████████▋| 10734/11066 [39:21<01:12, 4.55it/s] 97%|█████████▋| 10734/11066 [39:21<01:12, 4.55it/s] 97%|█████████▋| 10735/11066 [39:21<01:12, 4.57it/s] 97%|█████████▋| 10735/11066 [39:21<01:12, 4.57it/s] 97%|█████████▋| 10736/11066 [39:21<01:11, 4.63it/s] 97%|█████████▋| 10736/11066 [39:21<01:11, 4.63it/s] 97%|█████████▋| 10737/11066 [39:22<01:11, 4.63it/s] 97%|█████████▋| 10737/11066 [39:22<01:11, 4.63it/s] 97%|█████████▋| 10738/11066 [39:22<01:11, 4.57it/s] 97%|█████████▋| 10738/11066 [39:22<01:11, 4.57it/s] 97%|█████████▋| 10739/11066 [39:22<01:10, 4.61it/s] 97%|█████████▋| 10739/11066 [39:22<01:10, 4.61it/s] 97%|█████████▋| 10740/11066 [39:22<01:10, 4.61it/s] 97%|█████████▋| 10740/11066 [39:22<01:10, 4.61it/s] 97%|█████████▋| 10741/11066 [39:22<01:10, 4.63it/s] 97%|█████████▋| 10741/11066 [39:22<01:10, 4.63it/s] 97%|█████████▋| 10742/11066 [39:23<01:10, 4.60it/s] 97%|█████████▋| 10742/11066 [39:23<01:10, 4.60it/s] 97%|█████████▋| 10743/11066 [39:23<01:09, 4.63it/s] 97%|█████████▋| 10743/11066 [39:23<01:09, 4.63it/s] 97%|█████████▋| 10744/11066 [39:23<01:09, 4.64it/s] 97%|█████████▋| 10744/11066 [39:23<01:09, 4.64it/s] 97%|█████████▋| 10745/11066 [39:23<01:09, 4.62it/s] 97%|█████████▋| 10745/11066 [39:23<01:09, 4.62it/s] 97%|█████████▋| 10746/11066 [39:24<01:09, 4.61it/s] 97%|█████████▋| 10746/11066 [39:24<01:09, 4.61it/s] 97%|█████████▋| 10747/11066 [39:24<01:09, 4.57it/s] 97%|█████████▋| 10747/11066 [39:24<01:09, 4.57it/s] 97%|█████████▋| 10748/11066 [39:24<01:09, 4.58it/s] 97%|█████████▋| 10748/11066 [39:24<01:09, 4.58it/s] 97%|█████████▋| 10749/11066 [39:24<01:08, 4.61it/s] 97%|█████████▋| 10749/11066 [39:24<01:08, 4.61it/s] 97%|█████████▋| 10750/11066 [39:24<01:08, 4.61it/s] 97%|█████████▋| 10750/11066 [39:24<01:08, 4.61it/s] 97%|█████████▋| 10751/11066 [39:25<01:08, 4.58it/s] 97%|█████████▋| 10751/11066 [39:25<01:08, 4.58it/s] 97%|█████████▋| 10752/11066 [39:25<01:08, 4.59it/s] 97%|█████████▋| 10752/11066 [39:25<01:08, 4.59it/s] 97%|█████████▋| 10753/11066 [39:25<01:07, 4.62it/s] 97%|█████████▋| 10753/11066 [39:25<01:07, 4.62it/s] 97%|█████████▋| 10754/11066 [39:25<01:08, 4.58it/s] 97%|█████████▋| 10754/11066 [39:25<01:08, 4.58it/s] 97%|█████████▋| 10755/11066 [39:25<01:08, 4.54it/s] 97%|█████████▋| 10755/11066 [39:25<01:08, 4.54it/s] 97%|█████████▋| 10756/11066 [39:26<01:08, 4.53it/s] 97%|█████████▋| 10756/11066 [39:26<01:08, 4.53it/s] 97%|█████████▋| 10757/11066 [39:26<01:08, 4.51it/s] 97%|█████████▋| 10757/11066 [39:26<01:08, 4.51it/s] 97%|█████████▋| 10758/11066 [39:26<01:08, 4.51it/s] 97%|█████████▋| 10758/11066 [39:26<01:08, 4.51it/s] 97%|█████████▋| 10759/11066 [39:26<01:08, 4.51it/s] 97%|█████████▋| 10759/11066 [39:26<01:08, 4.51it/s] 97%|█████████▋| 10760/11066 [39:27<01:07, 4.50it/s] 97%|█████████▋| 10760/11066 [39:27<01:07, 4.50it/s] 97%|█████████▋| 10761/11066 [39:27<01:07, 4.50it/s] 97%|█████████▋| 10761/11066 [39:27<01:07, 4.50it/s] 97%|█████████▋| 10762/11066 [39:27<01:07, 4.50it/s] 97%|█████████▋| 10762/11066 [39:27<01:07, 4.50it/s] 97%|█████████▋| 10763/11066 [39:27<01:07, 4.49it/s] 97%|█████████▋| 10763/11066 [39:27<01:07, 4.49it/s] 97%|█████████▋| 10764/11066 [39:27<01:07, 4.50it/s] 97%|█████████▋| 10764/11066 [39:27<01:07, 4.50it/s] 97%|█████████▋| 10765/11066 [39:28<01:06, 4.50it/s] 97%|█████████▋| 10765/11066 [39:28<01:06, 4.50it/s] 97%|█████████▋| 10766/11066 [39:28<01:06, 4.50it/s] 97%|█████████▋| 10766/11066 [39:28<01:06, 4.50it/s] 97%|█████████▋| 10767/11066 [39:28<01:06, 4.50it/s] 97%|█████████▋| 10767/11066 [39:28<01:06, 4.50it/s] 97%|█████████▋| 10768/11066 [39:28<01:06, 4.50it/s] 97%|█████████▋| 10768/11066 [39:28<01:06, 4.50it/s] 97%|█████████▋| 10769/11066 [39:29<01:05, 4.50it/s] 97%|█████████▋| 10769/11066 [39:29<01:05, 4.50it/s] 97%|█████████▋| 10770/11066 [39:29<01:05, 4.51it/s] 97%|█████████▋| 10770/11066 [39:29<01:05, 4.51it/s] 97%|█████████▋| 10771/11066 [39:29<01:05, 4.50it/s] 97%|█████████▋| 10771/11066 [39:29<01:05, 4.50it/s] 97%|█████████▋| 10772/11066 [39:29<01:05, 4.50it/s] 97%|█████████▋| 10772/11066 [39:29<01:05, 4.50it/s] 97%|█████████▋| 10773/11066 [39:29<01:05, 4.50it/s] 97%|█████████▋| 10773/11066 [39:29<01:05, 4.50it/s] 97%|█████████▋| 10774/11066 [39:30<01:04, 4.50it/s] 97%|█████████▋| 10774/11066 [39:30<01:04, 4.50it/s] 97%|█████████▋| 10775/11066 [39:30<01:04, 4.50it/s] 97%|█████████▋| 10775/11066 [39:30<01:04, 4.50it/s] 97%|█████████▋| 10776/11066 [39:30<01:04, 4.50it/s] 97%|█████████▋| 10776/11066 [39:30<01:04, 4.50it/s] 97%|█████████▋| 10777/11066 [39:30<01:04, 4.50it/s] 97%|█████████▋| 10777/11066 [39:30<01:04, 4.50it/s] 97%|█████████▋| 10778/11066 [39:31<01:04, 4.50it/s] 97%|█████████▋| 10778/11066 [39:31<01:04, 4.50it/s] 97%|█████████▋| 10779/11066 [39:31<01:03, 4.50it/s] 97%|█████████▋| 10779/11066 [39:31<01:03, 4.50it/s] 97%|█████████▋| 10780/11066 [39:31<01:03, 4.49it/s] 97%|█████████▋| 10780/11066 [39:31<01:03, 4.49it/s] 97%|█████████▋| 10781/11066 [39:31<01:03, 4.49it/s] 97%|█████████▋| 10781/11066 [39:31<01:03, 4.49it/s] 97%|█████████▋| 10782/11066 [39:31<01:03, 4.49it/s] 97%|█████████▋| 10782/11066 [39:31<01:03, 4.49it/s] 97%|█████████▋| 10783/11066 [39:32<01:02, 4.50it/s] 97%|█████████▋| 10783/11066 [39:32<01:02, 4.50it/s] 97%|█████████▋| 10784/11066 [39:32<01:02, 4.51it/s] 97%|█████████▋| 10784/11066 [39:32<01:02, 4.51it/s] 97%|█████████▋| 10785/11066 [39:32<01:02, 4.51it/s] 97%|█████████▋| 10785/11066 [39:32<01:02, 4.51it/s] 97%|█████████▋| 10786/11066 [39:32<01:02, 4.50it/s] 97%|█████████▋| 10786/11066 [39:32<01:02, 4.50it/s] 97%|█████████▋| 10787/11066 [39:33<01:02, 4.49it/s] 97%|█████████▋| 10787/11066 [39:33<01:02, 4.49it/s] 97%|█████████▋| 10788/11066 [39:33<01:01, 4.51it/s] 97%|█████████▋| 10788/11066 [39:33<01:01, 4.51it/s] 97%|█████████▋| 10789/11066 [39:33<01:01, 4.51it/s] 97%|█████████▋| 10789/11066 [39:33<01:01, 4.51it/s] 98%|█████████▊| 10790/11066 [39:33<01:01, 4.51it/s] 98%|█████████▊| 10790/11066 [39:33<01:01, 4.51it/s] 98%|█████████▊| 10791/11066 [39:33<01:01, 4.50it/s] 98%|█████████▊| 10791/11066 [39:33<01:01, 4.50it/s] 98%|█████████▊| 10792/11066 [39:34<01:00, 4.51it/s] 98%|█████████▊| 10792/11066 [39:34<01:00, 4.51it/s] 98%|█████████▊| 10793/11066 [39:34<01:00, 4.50it/s] 98%|█████████▊| 10793/11066 [39:34<01:00, 4.50it/s] 98%|█████████▊| 10794/11066 [39:34<01:00, 4.50it/s] 98%|█████████▊| 10794/11066 [39:34<01:00, 4.50it/s] 98%|█████████▊| 10795/11066 [39:34<01:00, 4.50it/s] 98%|█████████▊| 10795/11066 [39:34<01:00, 4.50it/s] 98%|█████████▊| 10796/11066 [39:35<00:59, 4.50it/s] 98%|█████████▊| 10796/11066 [39:35<00:59, 4.50it/s] 98%|█████████▊| 10797/11066 [39:35<00:59, 4.50it/s] 98%|█████████▊| 10797/11066 [39:35<00:59, 4.50it/s] 98%|█████████▊| 10798/11066 [39:35<00:59, 4.50it/s] 98%|█████████▊| 10798/11066 [39:35<00:59, 4.50it/s] 98%|█████████▊| 10799/11066 [39:35<00:59, 4.50it/s] 98%|█████████▊| 10799/11066 [39:35<00:59, 4.50it/s] 98%|█████████▊| 10800/11066 [39:35<00:59, 4.49it/s] 98%|█████████▊| 10800/11066 [39:35<00:59, 4.49it/s] 98%|█████████▊| 10801/11066 [39:36<00:58, 4.49it/s] 98%|█████████▊| 10801/11066 [39:36<00:58, 4.49it/s] 98%|█████████▊| 10802/11066 [39:36<00:58, 4.49it/s] 98%|█████████▊| 10802/11066 [39:36<00:58, 4.49it/s] 98%|█████████▊| 10803/11066 [39:36<00:58, 4.49it/s] 98%|█████████▊| 10803/11066 [39:36<00:58, 4.49it/s] 98%|█████████▊| 10804/11066 [39:36<00:58, 4.49it/s] 98%|█████████▊| 10804/11066 [39:36<00:58, 4.49it/s] 98%|█████████▊| 10805/11066 [39:37<00:58, 4.49it/s] 98%|█████████▊| 10805/11066 [39:37<00:58, 4.49it/s] 98%|█████████▊| 10806/11066 [39:37<00:57, 4.50it/s] 98%|█████████▊| 10806/11066 [39:37<00:57, 4.50it/s] 98%|█████████▊| 10807/11066 [39:37<00:57, 4.50it/s] 98%|█████████▊| 10807/11066 [39:37<00:57, 4.50it/s] 98%|█████████▊| 10808/11066 [39:37<00:57, 4.48it/s] 98%|█████████▊| 10808/11066 [39:37<00:57, 4.48it/s] 98%|█████████▊| 10809/11066 [39:37<00:56, 4.52it/s] 98%|█████████▊| 10809/11066 [39:37<00:56, 4.52it/s] 98%|█████████▊| 10810/11066 [39:38<00:56, 4.54it/s] 98%|█████████▊| 10810/11066 [39:38<00:56, 4.54it/s] 98%|█████████▊| 10811/11066 [39:38<00:55, 4.58it/s] 98%|█████████▊| 10811/11066 [39:38<00:55, 4.58it/s] 98%|█████████▊| 10812/11066 [39:38<00:55, 4.56it/s] 98%|█████████▊| 10812/11066 [39:38<00:55, 4.56it/s] 98%|█████████▊| 10813/11066 [39:38<00:55, 4.56it/s] 98%|█████████▊| 10813/11066 [39:38<00:55, 4.56it/s] 98%|█████████▊| 10814/11066 [39:39<00:54, 4.62it/s] 98%|█████████▊| 10814/11066 [39:39<00:54, 4.62it/s] 98%|█████████▊| 10815/11066 [39:39<00:54, 4.59it/s] 98%|█████████▊| 10815/11066 [39:39<00:54, 4.59it/s] 98%|█████████▊| 10816/11066 [39:39<00:54, 4.60it/s] 98%|█████████▊| 10816/11066 [39:39<00:54, 4.60it/s] 98%|█████████▊| 10817/11066 [39:39<00:54, 4.55it/s] 98%|█████████▊| 10817/11066 [39:39<00:54, 4.55it/s] 98%|█████████▊| 10818/11066 [39:39<00:54, 4.56it/s] 98%|█████████▊| 10818/11066 [39:39<00:54, 4.56it/s] 98%|█████████▊| 10819/11066 [39:40<00:53, 4.60it/s] 98%|█████████▊| 10819/11066 [39:40<00:53, 4.60it/s] 98%|█████████▊| 10820/11066 [39:40<00:53, 4.60it/s] 98%|█████████▊| 10820/11066 [39:40<00:53, 4.60it/s] 98%|█████████▊| 10821/11066 [39:40<00:53, 4.60it/s] 98%|█████████▊| 10821/11066 [39:40<00:53, 4.60it/s] 98%|█████████▊| 10822/11066 [39:40<00:53, 4.55it/s] 98%|█████████▊| 10822/11066 [39:40<00:53, 4.55it/s] 98%|█████████▊| 10823/11066 [39:41<00:53, 4.52it/s] {'loss': 0.5831, 'learning_rate': 9.678293873124887e-07, 'epoch': 1.94} {'loss': 0.6266, 'learning_rate': 9.65118380625339e-07, 'epoch': 1.94} {'loss': 1.2054, 'learning_rate': 9.624073739381892e-07, 'epoch': 1.94} {'loss': 0.8757, 'learning_rate': 9.596963672510393e-07, 'epoch': 1.94} {'loss': 0.6794, 'learning_rate': 9.569853605638893e-07, 'epoch': 1.94} {'loss': 0.5199, 'learning_rate': 9.542743538767394e-07, 'epoch': 1.94} {'loss': 0.9414, 'learning_rate': 9.515633471895896e-07, 'epoch': 1.94} {'loss': 1.0303, 'learning_rate': 9.488523405024399e-07, 'epoch': 1.94} {'loss': 0.7973, 'learning_rate': 9.4614133381529e-07, 'epoch': 1.94} {'loss': 0.5439, 'learning_rate': 9.434303271281401e-07, 'epoch': 1.94} {'loss': 0.2546, 'learning_rate': 9.407193204409904e-07, 'epoch': 1.94} {'loss': 0.3948, 'learning_rate': 9.380083137538405e-07, 'epoch': 1.94} {'loss': 0.8121, 'learning_rate': 9.352973070666909e-07, 'epoch': 1.94} {'loss': 0.4386, 'learning_rate': 9.32586300379541e-07, 'epoch': 1.94} {'loss': 0.5275, 'learning_rate': 9.298752936923911e-07, 'epoch': 1.94} {'loss': 0.7608, 'learning_rate': 9.271642870052414e-07, 'epoch': 1.94} {'loss': 1.1615, 'learning_rate': 9.244532803180915e-07, 'epoch': 1.94} {'loss': 0.5794, 'learning_rate': 9.217422736309416e-07, 'epoch': 1.94} {'loss': 0.4866, 'learning_rate': 9.190312669437919e-07, 'epoch': 1.94} {'loss': 0.9027, 'learning_rate': 9.16320260256642e-07, 'epoch': 1.94} {'loss': 1.0761, 'learning_rate': 9.136092535694921e-07, 'epoch': 1.94} {'loss': 0.2938, 'learning_rate': 9.108982468823423e-07, 'epoch': 1.94} {'loss': 0.7183, 'learning_rate': 9.081872401951924e-07, 'epoch': 1.94} {'loss': 0.9061, 'learning_rate': 9.054762335080427e-07, 'epoch': 1.94} {'loss': 0.7161, 'learning_rate': 9.027652268208928e-07, 'epoch': 1.94} {'loss': 0.9015, 'learning_rate': 9.00054220133743e-07, 'epoch': 1.94} {'loss': 1.1441, 'learning_rate': 8.973432134465932e-07, 'epoch': 1.94} {'loss': 0.4616, 'learning_rate': 8.946322067594433e-07, 'epoch': 1.94} {'loss': 0.39, 'learning_rate': 8.919212000722935e-07, 'epoch': 1.94} {'loss': 0.6444, 'learning_rate': 8.892101933851437e-07, 'epoch': 1.94} {'loss': 0.6283, 'learning_rate': 8.864991866979938e-07, 'epoch': 1.94} {'loss': 0.8373, 'learning_rate': 8.83788180010844e-07, 'epoch': 1.94} {'loss': 0.5074, 'learning_rate': 8.810771733236942e-07, 'epoch': 1.94} {'loss': 0.9349, 'learning_rate': 8.783661666365444e-07, 'epoch': 1.94} {'loss': 1.1557, 'learning_rate': 8.756551599493946e-07, 'epoch': 1.94} {'loss': 0.8553, 'learning_rate': 8.729441532622447e-07, 'epoch': 1.94} {'loss': 0.9448, 'learning_rate': 8.702331465750949e-07, 'epoch': 1.94} {'loss': 0.4933, 'learning_rate': 8.675221398879451e-07, 'epoch': 1.94} {'loss': 0.3823, 'learning_rate': 8.648111332007953e-07, 'epoch': 1.94} {'loss': 0.7609, 'learning_rate': 8.621001265136454e-07, 'epoch': 1.94} {'loss': 1.0833, 'learning_rate': 8.593891198264956e-07, 'epoch': 1.94} {'loss': 0.5999, 'learning_rate': 8.566781131393458e-07, 'epoch': 1.94} {'loss': 0.7522, 'learning_rate': 8.53967106452196e-07, 'epoch': 1.94} {'loss': 0.7804, 'learning_rate': 8.512560997650461e-07, 'epoch': 1.94} {'loss': 0.9872, 'learning_rate': 8.485450930778963e-07, 'epoch': 1.94} {'loss': 0.7538, 'learning_rate': 8.458340863907465e-07, 'epoch': 1.94} {'loss': 0.9187, 'learning_rate': 8.431230797035967e-07, 'epoch': 1.94} {'loss': 0.3302, 'learning_rate': 8.404120730164468e-07, 'epoch': 1.94} {'loss': 1.022, 'learning_rate': 8.37701066329297e-07, 'epoch': 1.94} {'loss': 0.425, 'learning_rate': 8.349900596421472e-07, 'epoch': 1.94} {'loss': 0.3351, 'learning_rate': 8.322790529549973e-07, 'epoch': 1.94} {'loss': 0.7003, 'learning_rate': 8.295680462678476e-07, 'epoch': 1.94} {'loss': 0.4509, 'learning_rate': 8.268570395806976e-07, 'epoch': 1.94} {'loss': 0.4867, 'learning_rate': 8.241460328935477e-07, 'epoch': 1.95} {'loss': 0.9975, 'learning_rate': 8.21435026206398e-07, 'epoch': 1.95} {'loss': 0.9777, 'learning_rate': 8.187240195192481e-07, 'epoch': 1.95} {'loss': 0.2929, 'learning_rate': 8.160130128320983e-07, 'epoch': 1.95} {'loss': 0.8419, 'learning_rate': 8.133020061449485e-07, 'epoch': 1.95} {'loss': 0.6973, 'learning_rate': 8.105909994577986e-07, 'epoch': 1.95} {'loss': 0.5077, 'learning_rate': 8.078799927706489e-07, 'epoch': 1.95} {'loss': 1.0246, 'learning_rate': 8.05168986083499e-07, 'epoch': 1.95} {'loss': 0.9928, 'learning_rate': 8.024579793963491e-07, 'epoch': 1.95} {'loss': 1.2263, 'learning_rate': 7.997469727091994e-07, 'epoch': 1.95} {'loss': 0.468, 'learning_rate': 7.970359660220495e-07, 'epoch': 1.95} {'loss': 0.634, 'learning_rate': 7.943249593348998e-07, 'epoch': 1.95} {'loss': 1.1721, 'learning_rate': 7.916139526477499e-07, 'epoch': 1.95} {'loss': 0.9969, 'learning_rate': 7.889029459606e-07, 'epoch': 1.95} {'loss': 0.4106, 'learning_rate': 7.861919392734503e-07, 'epoch': 1.95} {'loss': 0.7497, 'learning_rate': 7.834809325863004e-07, 'epoch': 1.95} {'loss': 0.544, 'learning_rate': 7.807699258991505e-07, 'epoch': 1.95} {'loss': 1.0381, 'learning_rate': 7.780589192120008e-07, 'epoch': 1.95} {'loss': 0.5169, 'learning_rate': 7.753479125248509e-07, 'epoch': 1.95} {'loss': 1.0806, 'learning_rate': 7.726369058377011e-07, 'epoch': 1.95} {'loss': 0.4083, 'learning_rate': 7.699258991505513e-07, 'epoch': 1.95} {'loss': 0.5238, 'learning_rate': 7.672148924634014e-07, 'epoch': 1.95} {'loss': 0.7303, 'learning_rate': 7.645038857762517e-07, 'epoch': 1.95} {'loss': 0.3904, 'learning_rate': 7.617928790891018e-07, 'epoch': 1.95} {'loss': 0.7974, 'learning_rate': 7.59081872401952e-07, 'epoch': 1.95} {'loss': 0.3397, 'learning_rate': 7.563708657148022e-07, 'epoch': 1.95} {'loss': 1.1605, 'learning_rate': 7.536598590276523e-07, 'epoch': 1.95} {'loss': 1.1229, 'learning_rate': 7.509488523405025e-07, 'epoch': 1.95} {'loss': 0.2954, 'learning_rate': 7.482378456533527e-07, 'epoch': 1.95} {'loss': 0.5715, 'learning_rate': 7.455268389662028e-07, 'epoch': 1.95} {'loss': 0.6336, 'learning_rate': 7.42815832279053e-07, 'epoch': 1.95} {'loss': 0.3827, 'learning_rate': 7.401048255919031e-07, 'epoch': 1.95} {'loss': 0.6668, 'learning_rate': 7.373938189047533e-07, 'epoch': 1.95} {'loss': 0.7688, 'learning_rate': 7.346828122176034e-07, 'epoch': 1.95} {'loss': 0.6978, 'learning_rate': 7.319718055304536e-07, 'epoch': 1.95} {'loss': 0.6805, 'learning_rate': 7.292607988433038e-07, 'epoch': 1.95} {'loss': 0.5377, 'learning_rate': 7.26549792156154e-07, 'epoch': 1.95} {'loss': 0.5236, 'learning_rate': 7.238387854690042e-07, 'epoch': 1.95} {'loss': 1.3712, 'learning_rate': 7.211277787818543e-07, 'epoch': 1.95} {'loss': 1.4037, 'learning_rate': 7.184167720947045e-07, 'epoch': 1.95} {'loss': 0.4185, 'learning_rate': 7.157057654075547e-07, 'epoch': 1.95} {'loss': 0.4329, 'learning_rate': 7.129947587204048e-07, 'epoch': 1.95} {'loss': 0.9129, 'learning_rate': 7.10283752033255e-07, 'epoch': 1.95} {'loss': 0.8111, 'learning_rate': 7.075727453461052e-07, 'epoch': 1.95} {'loss': 0.5249, 'learning_rate': 7.048617386589553e-07, 'epoch': 1.95} {'loss': 0.7029, 'learning_rate': 7.021507319718056e-07, 'epoch': 1.95} {'loss': 1.2362, 'learning_rate': 6.994397252846557e-07, 'epoch': 1.95} {'loss': 0.5102, 'learning_rate': 6.967287185975059e-07, 'epoch': 1.95} {'loss': 0.9694, 'learning_rate': 6.940177119103561e-07, 'epoch': 1.95} {'loss': 0.3643, 'learning_rate': 6.913067052232062e-07, 'epoch': 1.95} {'loss': 0.3445, 'learning_rate': 6.885956985360564e-07, 'epoch': 1.95} {'loss': 1.1187, 'learning_rate': 6.858846918489066e-07, 'epoch': 1.95} {'loss': 1.2952, 'learning_rate': 6.831736851617567e-07, 'epoch': 1.95} {'loss': 0.5129, 'learning_rate': 6.80462678474607e-07, 'epoch': 1.95} {'loss': 1.026, 'learning_rate': 6.777516717874571e-07, 'epoch': 1.95} {'loss': 0.5381, 'learning_rate': 6.750406651003072e-07, 'epoch': 1.95} {'loss': 0.7493, 'learning_rate': 6.723296584131575e-07, 'epoch': 1.96} {'loss': 0.6278, 'learning_rate': 6.696186517260076e-07, 'epoch': 1.96} {'loss': 0.6154, 'learning_rate': 6.669076450388579e-07, 'epoch': 1.96} {'loss': 0.481, 'learning_rate': 6.64196638351708e-07, 'epoch': 1.96} {'loss': 0.4896, 'learning_rate': 6.614856316645581e-07, 'epoch': 1.96} 98%|█████████▊| 10823/11066 [39:41<00:53, 4.52it/s] 98%|█████████▊| 10824/11066 [39:41<00:53, 4.50it/s] 98%|█████████▊| 10824/11066 [39:41<00:53, 4.50it/s] 98%|█████████▊| 10825/11066 [39:41<00:53, 4.50it/s] 98%|█████████▊| 10825/11066 [39:41<00:53, 4.50it/s] 98%|█████████▊| 10826/11066 [39:41<00:53, 4.50it/s] 98%|█████████▊| 10826/11066 [39:41<00:53, 4.50it/s] 98%|█████████▊| 10827/11066 [39:41<00:53, 4.49it/s] 98%|█████████▊| 10827/11066 [39:41<00:53, 4.49it/s] 98%|█████████▊| 10828/11066 [39:42<00:53, 4.42it/s] 98%|█████████▊| 10828/11066 [39:42<00:53, 4.42it/s] 98%|█████████▊| 10829/11066 [39:42<00:53, 4.44it/s] 98%|█████████▊| 10829/11066 [39:42<00:53, 4.44it/s] 98%|█████████▊| 10830/11066 [39:42<00:52, 4.50it/s] 98%|█████████▊| 10830/11066 [39:42<00:52, 4.50it/s] 98%|█████████▊| 10831/11066 [39:42<00:51, 4.54it/s] 98%|█████████▊| 10831/11066 [39:42<00:51, 4.54it/s] 98%|█████████▊| 10832/11066 [39:43<00:51, 4.56it/s] 98%|█████████▊| 10832/11066 [39:43<00:51, 4.56it/s] 98%|█████████▊| 10833/11066 [39:43<00:51, 4.53it/s] 98%|█████████▊| 10833/11066 [39:43<00:51, 4.53it/s] 98%|█████████▊| 10834/11066 [39:43<00:50, 4.58it/s] 98%|█████████▊| 10834/11066 [39:43<00:50, 4.58it/s] 98%|█████████▊| 10835/11066 [39:43<00:50, 4.54it/s] 98%|█████████▊| 10835/11066 [39:43<00:50, 4.54it/s] 98%|█████████▊| 10836/11066 [39:43<00:50, 4.52it/s] 98%|█████████▊| 10836/11066 [39:43<00:50, 4.52it/s] 98%|█████████▊| 10837/11066 [39:44<00:51, 4.43it/s] 98%|█████████▊| 10837/11066 [39:44<00:51, 4.43it/s] 98%|█████████▊| 10838/11066 [39:44<00:51, 4.45it/s] 98%|█████████▊| 10838/11066 [39:44<00:51, 4.45it/s] 98%|█████████▊| 10839/11066 [39:44<00:50, 4.47it/s] 98%|█████████▊| 10839/11066 [39:44<00:50, 4.47it/s] 98%|█████████▊| 10840/11066 [39:44<00:50, 4.49it/s] 98%|█████████▊| 10840/11066 [39:44<00:50, 4.49it/s] 98%|█████████▊| 10841/11066 [39:45<00:51, 4.40it/s] 98%|█████████▊| 10841/11066 [39:45<00:51, 4.40it/s] 98%|█████████▊| 10842/11066 [39:45<00:50, 4.42it/s] 98%|█████████▊| 10842/11066 [39:45<00:50, 4.42it/s] 98%|█████████▊| 10843/11066 [39:45<00:50, 4.44it/s] 98%|█████████▊| 10843/11066 [39:45<00:50, 4.44it/s] 98%|█████████▊| 10844/11066 [39:45<00:50, 4.41it/s] 98%|█████████▊| 10844/11066 [39:45<00:50, 4.41it/s] 98%|█████████▊| 10845/11066 [39:45<00:49, 4.43it/s] 98%|█████████▊| 10845/11066 [39:45<00:49, 4.43it/s] 98%|█████████▊| 10846/11066 [39:46<00:49, 4.48it/s] 98%|█████████▊| 10846/11066 [39:46<00:49, 4.48it/s] 98%|█████████▊| 10847/11066 [39:46<00:48, 4.50it/s] 98%|█████████▊| 10847/11066 [39:46<00:48, 4.50it/s] 98%|█████████▊| 10848/11066 [39:46<00:48, 4.54it/s] 98%|█████████▊| 10848/11066 [39:46<00:48, 4.54it/s] 98%|█████████▊| 10849/11066 [39:46<00:48, 4.51it/s] 98%|█████████▊| 10849/11066 [39:46<00:48, 4.51it/s] 98%|█████████▊| 10850/11066 [39:47<00:47, 4.54it/s] 98%|█████████▊| 10850/11066 [39:47<00:47, 4.54it/s] 98%|█████████▊| 10851/11066 [39:47<00:47, 4.51it/s] 98%|█████████▊| 10851/11066 [39:47<00:47, 4.51it/s] 98%|█████████▊| 10852/11066 [39:47<00:46, 4.56it/s] 98%|█████████▊| 10852/11066 [39:47<00:46, 4.56it/s] 98%|█████████▊| 10853/11066 [39:47<00:46, 4.54it/s] 98%|█████████▊| 10853/11066 [39:47<00:46, 4.54it/s] 98%|█████████▊| 10854/11066 [39:47<00:46, 4.53it/s] 98%|█████████▊| 10854/11066 [39:47<00:46, 4.53it/s] 98%|█████████▊| 10855/11066 [39:48<00:46, 4.55it/s] 98%|█████████▊| 10855/11066 [39:48<00:46, 4.55it/s] 98%|█████████▊| 10856/11066 [39:48<00:46, 4.52it/s] 98%|█████████▊| 10856/11066 [39:48<00:46, 4.52it/s] 98%|█████████▊| 10857/11066 [39:48<00:46, 4.51it/s] 98%|█████████▊| 10857/11066 [39:48<00:46, 4.51it/s] 98%|█████████▊| 10858/11066 [39:48<00:46, 4.50it/s] 98%|█████████▊| 10858/11066 [39:48<00:46, 4.50it/s] 98%|█████████▊| 10859/11066 [39:49<00:45, 4.50it/s] 98%|█████████▊| 10859/11066 [39:49<00:45, 4.50it/s] 98%|█████████▊| 10860/11066 [39:49<00:45, 4.50it/s] 98%|█████████▊| 10860/11066 [39:49<00:45, 4.50it/s] 98%|█████████▊| 10861/11066 [39:49<00:45, 4.50it/s] 98%|█████████▊| 10861/11066 [39:49<00:45, 4.50it/s] 98%|█████████▊| 10862/11066 [39:49<00:44, 4.59it/s] 98%|█████████▊| 10862/11066 [39:49<00:44, 4.59it/s] 98%|█████████▊| 10863/11066 [39:49<00:44, 4.58it/s] 98%|█████████▊| 10863/11066 [39:49<00:44, 4.58it/s] 98%|█████████▊| 10864/11066 [39:50<00:44, 4.56it/s] 98%|█████████▊| 10864/11066 [39:50<00:44, 4.56it/s] 98%|█████████▊| 10865/11066 [39:50<00:44, 4.57it/s] 98%|█████████▊| 10865/11066 [39:50<00:44, 4.57it/s] 98%|█████████▊| 10866/11066 [39:50<00:43, 4.61it/s] 98%|█████████▊| 10866/11066 [39:50<00:43, 4.61it/s] 98%|█████████▊| 10867/11066 [39:50<00:43, 4.57it/s] 98%|█████████▊| 10867/11066 [39:50<00:43, 4.57it/s] 98%|█████████▊| 10868/11066 [39:51<00:43, 4.55it/s] 98%|█████████▊| 10868/11066 [39:51<00:43, 4.55it/s] 98%|█████████▊| 10869/11066 [39:51<00:43, 4.54it/s] 98%|█████████▊| 10869/11066 [39:51<00:43, 4.54it/s] 98%|█████████▊| 10870/11066 [39:51<00:42, 4.56it/s] 98%|█████████▊| 10870/11066 [39:51<00:42, 4.56it/s] 98%|█████████▊| 10871/11066 [39:51<00:43, 4.53it/s] 98%|█████████▊| 10871/11066 [39:51<00:43, 4.53it/s] 98%|█████████▊| 10872/11066 [39:51<00:42, 4.54it/s] 98%|█████████▊| 10872/11066 [39:51<00:42, 4.54it/s] 98%|█████████▊| 10873/11066 [39:52<00:42, 4.58it/s] 98%|█████████▊| 10873/11066 [39:52<00:42, 4.58it/s] 98%|█████████▊| 10874/11066 [39:52<00:42, 4.53it/s] 98%|█████████▊| 10874/11066 [39:52<00:42, 4.53it/s] 98%|█████████▊| 10875/11066 [39:52<00:42, 4.50it/s] 98%|█████████▊| 10875/11066 [39:52<00:42, 4.50it/s] 98%|█████████▊| 10876/11066 [39:52<00:42, 4.51it/s] 98%|█████████▊| 10876/11066 [39:52<00:42, 4.51it/s] 98%|█████████▊| 10877/11066 [39:53<00:42, 4.49it/s] 98%|█████████▊| 10877/11066 [39:53<00:42, 4.49it/s] 98%|█████████▊| 10878/11066 [39:53<00:41, 4.48it/s] 98%|█████████▊| 10878/11066 [39:53<00:41, 4.48it/s] 98%|█████████▊| 10879/11066 [39:53<00:41, 4.45it/s] 98%|█████████▊| 10879/11066 [39:53<00:41, 4.45it/s] 98%|█████████▊| 10880/11066 [39:53<00:41, 4.43it/s] 98%|█████████▊| 10880/11066 [39:53<00:41, 4.43it/s] 98%|█████████▊| 10881/11066 [39:53<00:41, 4.45it/s] 98%|█████████▊| 10881/11066 [39:53<00:41, 4.45it/s] 98%|█████████▊| 10882/11066 [39:54<00:40, 4.53it/s] 98%|█████████▊| 10882/11066 [39:54<00:40, 4.53it/s] 98%|█████████▊| 10883/11066 [39:54<00:41, 4.46it/s] 98%|█████████▊| 10883/11066 [39:54<00:41, 4.46it/s] 98%|█████████▊| 10884/11066 [39:54<00:40, 4.46it/s] 98%|█████████▊| 10884/11066 [39:54<00:40, 4.46it/s] 98%|█████████▊| 10885/11066 [39:54<00:40, 4.49it/s] 98%|█████████▊| 10885/11066 [39:54<00:40, 4.49it/s] 98%|█████████▊| 10886/11066 [39:55<00:40, 4.49it/s] 98%|█████████▊| 10886/11066 [39:55<00:40, 4.49it/s] 98%|█████████▊| 10887/11066 [39:55<00:40, 4.47it/s] 98%|█████████▊| 10887/11066 [39:55<00:40, 4.47it/s] 98%|█████████▊| 10888/11066 [39:55<00:39, 4.50it/s] 98%|█████████▊| 10888/11066 [39:55<00:39, 4.50it/s] 98%|█████████▊| 10889/11066 [39:55<00:39, 4.49it/s] 98%|█████████▊| 10889/11066 [39:55<00:39, 4.49it/s] 98%|█████████▊| 10890/11066 [39:55<00:39, 4.47it/s] 98%|█████████▊| 10890/11066 [39:55<00:39, 4.47it/s] 98%|█████████▊| 10891/11066 [39:56<00:39, 4.48it/s] 98%|█████████▊| 10891/11066 [39:56<00:39, 4.48it/s] 98%|█████████▊| 10892/11066 [39:56<00:38, 4.48it/s] 98%|█████████▊| 10892/11066 [39:56<00:38, 4.48it/s] 98%|█████████▊| 10893/11066 [39:56<00:38, 4.48it/s] 98%|█████████▊| 10893/11066 [39:56<00:38, 4.48it/s] 98%|█████████▊| 10894/11066 [39:56<00:38, 4.51it/s] 98%|█████████▊| 10894/11066 [39:56<00:38, 4.51it/s] 98%|█████████▊| 10895/11066 [39:57<00:37, 4.51it/s] 98%|█████████▊| 10895/11066 [39:57<00:37, 4.51it/s] 98%|█████████▊| 10896/11066 [39:57<00:37, 4.54it/s] 98%|█████████▊| 10896/11066 [39:57<00:37, 4.54it/s] 98%|█████████▊| 10897/11066 [39:57<00:37, 4.54it/s] 98%|█████████▊| 10897/11066 [39:57<00:37, 4.54it/s] 98%|█████████▊| 10898/11066 [39:57<00:37, 4.50it/s] 98%|█████████▊| 10898/11066 [39:57<00:37, 4.50it/s] 98%|█████████▊| 10899/11066 [39:57<00:37, 4.49it/s] 98%|█████████▊| 10899/11066 [39:57<00:37, 4.49it/s] 98%|█████████▊| 10900/11066 [39:58<00:36, 4.49it/s] 98%|█████████▊| 10900/11066 [39:58<00:36, 4.49it/s] 99%|█████████▊| 10901/11066 [39:58<00:36, 4.49it/s] 99%|█████████▊| 10901/11066 [39:58<00:36, 4.49it/s] 99%|█████████▊| 10902/11066 [39:58<00:36, 4.50it/s] 99%|█████████▊| 10902/11066 [39:58<00:36, 4.50it/s] 99%|█████████▊| 10903/11066 [39:58<00:35, 4.56it/s] 99%|█████████▊| 10903/11066 [39:58<00:35, 4.56it/s] 99%|█████████▊| 10904/11066 [39:59<00:35, 4.54it/s] 99%|█████████▊| 10904/11066 [39:59<00:35, 4.54it/s] 99%|█████████▊| 10905/11066 [39:59<00:35, 4.53it/s] 99%|█████████▊| 10905/11066 [39:59<00:35, 4.53it/s] 99%|█████████▊| 10906/11066 [39:59<00:35, 4.52it/s] 99%|█████████▊| 10906/11066 [39:59<00:35, 4.52it/s] 99%|█████████▊| 10907/11066 [39:59<00:35, 4.51it/s] 99%|█████████▊| 10907/11066 [39:59<00:35, 4.51it/s] 99%|█████████▊| 10908/11066 [39:59<00:35, 4.51it/s] 99%|█████████▊| 10908/11066 [39:59<00:35, 4.51it/s] 99%|█████████▊| 10909/11066 [40:00<00:34, 4.54it/s] 99%|█████████▊| 10909/11066 [40:00<00:34, 4.54it/s] 99%|█████████▊| 10910/11066 [40:00<00:34, 4.51it/s] 99%|█████████▊| 10910/11066 [40:00<00:34, 4.51it/s] 99%|█████████▊| 10911/11066 [40:00<00:34, 4.50it/s] 99%|█████████▊| 10911/11066 [40:00<00:34, 4.50it/s] 99%|█████████▊| 10912/11066 [40:00<00:34, 4.50it/s] 99%|█████████▊| 10912/11066 [40:00<00:34, 4.50it/s] 99%|█████████▊| 10913/11066 [40:01<00:33, 4.53it/s] 99%|█████████▊| 10913/11066 [40:01<00:33, 4.53it/s] 99%|█████████▊| 10914/11066 [40:01<00:33, 4.51it/s] 99%|█████████▊| 10914/11066 [40:01<00:33, 4.51it/s] 99%|█████████▊| 10915/11066 [40:01<00:33, 4.53it/s] 99%|█████████▊| 10915/11066 [40:01<00:33, 4.53it/s] 99%|█████████▊| 10916/11066 [40:01<00:33, 4.51it/s] 99%|█████████▊| 10916/11066 [40:01<00:33, 4.51it/s] 99%|█████████▊| 10917/11066 [40:01<00:33, 4.49it/s] 99%|█████████▊| 10917/11066 [40:01<00:33, 4.49it/s] 99%|█████████▊| 10918/11066 [40:02<00:33, 4.48it/s] 99%|█████████▊| 10918/11066 [40:02<00:33, 4.48it/s] 99%|█████████▊| 10919/11066 [40:02<00:32, 4.49it/s] 99%|█████████▊| 10919/11066 [40:02<00:32, 4.49it/s] 99%|█████████▊| 10920/11066 [40:02<00:32, 4.49it/s] 99%|█████████▊| 10920/11066 [40:02<00:32, 4.49it/s] 99%|█████████▊| 10921/11066 [40:02<00:32, 4.49it/s] 99%|█████████▊| 10921/11066 [40:02<00:32, 4.49it/s] 99%|█████████▊| 10922/11066 [40:03<00:31, 4.52it/s] 99%|█████████▊| 10922/11066 [40:03<00:31, 4.52it/s] 99%|█████████▊| 10923/11066 [40:03<00:31, 4.51it/s] 99%|█████████▊| 10923/11066 [40:03<00:31, 4.51it/s] 99%|█████████▊| 10924/11066 [40:03<00:31, 4.50it/s] 99%|█████████▊| 10924/11066 [40:03<00:31, 4.50it/s] 99%|█████████▊| 10925/11066 [40:03<00:31, 4.50it/s] 99%|█████████▊| 10925/11066 [40:03<00:31, 4.50it/s] 99%|█████████▊| 10926/11066 [40:03<00:31, 4.50it/s] 99%|█████████▊| 10926/11066 [40:03<00:31, 4.50it/s] 99%|█████████▊| 10927/11066 [40:04<00:30, 4.50it/s] 99%|█████████▊| 10927/11066 [40:04<00:30, 4.50it/s] 99%|█████████▉| 10928/11066 [40:04<00:30, 4.50it/s] 99%|█████████▉| 10928/11066 [40:04<00:30, 4.50it/s] 99%|█████████▉| 10929/11066 [40:04<00:30, 4.50it/s] 99%|█████████▉| 10929/11066 [40:04<00:30, 4.50it/s] 99%|█████████▉| 10930/11066 [40:04<00:29, 4.57it/s] 99%|█████████▉| 10930/11066 [40:04<00:29, 4.57it/s] 99%|█████████▉| 10931/11066 [40:05<00:29, 4.53it/s] 99%|█████████▉| 10931/11066 [40:05<00:29, 4.53it/s] 99%|█████████▉| 10932/11066 [40:05<00:29, 4.52it/s] 99%|█████████▉| 10932/11066 [40:05<00:29, 4.52it/s] 99%|█████████▉| 10933/11066 [40:05<00:30, 4.42it/s] 99%|█████████▉| 10933/11066 [40:05<00:30, 4.42it/s] 99%|█████████▉| 10934/11066 [40:05<00:29, 4.43it/s] 99%|█████████▉| 10934/11066 [40:05<00:29, 4.43it/s] 99%|█████████▉| 10935/11066 [40:05<00:29, 4.44it/s] 99%|█████████▉| 10935/11066 [40:05<00:29, 4.44it/s] 99%|█████████▉| 10936/11066 [40:06<00:28, 4.49it/s] {'loss': 1.3428, 'learning_rate': 6.587746249774084e-07, 'epoch': 1.96} {'loss': 1.2545, 'learning_rate': 6.560636182902585e-07, 'epoch': 1.96} {'loss': 0.8438, 'learning_rate': 6.533526116031085e-07, 'epoch': 1.96} {'loss': 0.7747, 'learning_rate': 6.506416049159588e-07, 'epoch': 1.96} {'loss': 0.8123, 'learning_rate': 6.479305982288089e-07, 'epoch': 1.96} {'loss': 0.6486, 'learning_rate': 6.452195915416591e-07, 'epoch': 1.96} {'loss': 0.8435, 'learning_rate': 6.425085848545093e-07, 'epoch': 1.96} {'loss': 0.8698, 'learning_rate': 6.397975781673594e-07, 'epoch': 1.96} {'loss': 0.4283, 'learning_rate': 6.370865714802097e-07, 'epoch': 1.96} {'loss': 0.5766, 'learning_rate': 6.343755647930598e-07, 'epoch': 1.96} {'loss': 0.6586, 'learning_rate': 6.3166455810591e-07, 'epoch': 1.96} {'loss': 0.4745, 'learning_rate': 6.289535514187602e-07, 'epoch': 1.96} {'loss': 0.4739, 'learning_rate': 6.262425447316103e-07, 'epoch': 1.96} {'loss': 0.5451, 'learning_rate': 6.235315380444605e-07, 'epoch': 1.96} {'loss': 0.6707, 'learning_rate': 6.208205313573107e-07, 'epoch': 1.96} {'loss': 0.3946, 'learning_rate': 6.181095246701608e-07, 'epoch': 1.96} {'loss': 0.8898, 'learning_rate': 6.15398517983011e-07, 'epoch': 1.96} {'loss': 0.7063, 'learning_rate': 6.126875112958612e-07, 'epoch': 1.96} {'loss': 0.252, 'learning_rate': 6.099765046087114e-07, 'epoch': 1.96} {'loss': 0.8446, 'learning_rate': 6.072654979215616e-07, 'epoch': 1.96} {'loss': 0.6551, 'learning_rate': 6.045544912344117e-07, 'epoch': 1.96} {'loss': 0.6257, 'learning_rate': 6.018434845472619e-07, 'epoch': 1.96} {'loss': 0.6599, 'learning_rate': 5.991324778601121e-07, 'epoch': 1.96} {'loss': 1.0033, 'learning_rate': 5.964214711729623e-07, 'epoch': 1.96} {'loss': 0.748, 'learning_rate': 5.937104644858124e-07, 'epoch': 1.96} {'loss': 0.4513, 'learning_rate': 5.909994577986626e-07, 'epoch': 1.96} {'loss': 1.0466, 'learning_rate': 5.882884511115128e-07, 'epoch': 1.96} {'loss': 0.4233, 'learning_rate': 5.85577444424363e-07, 'epoch': 1.96} {'loss': 0.3063, 'learning_rate': 5.828664377372131e-07, 'epoch': 1.96} {'loss': 0.9016, 'learning_rate': 5.801554310500633e-07, 'epoch': 1.96} {'loss': 0.7211, 'learning_rate': 5.774444243629135e-07, 'epoch': 1.96} {'loss': 0.7258, 'learning_rate': 5.747334176757637e-07, 'epoch': 1.96} {'loss': 1.3917, 'learning_rate': 5.720224109886138e-07, 'epoch': 1.96} {'loss': 0.546, 'learning_rate': 5.69311404301464e-07, 'epoch': 1.96} {'loss': 1.1886, 'learning_rate': 5.666003976143141e-07, 'epoch': 1.96} {'loss': 0.6637, 'learning_rate': 5.638893909271642e-07, 'epoch': 1.96} {'loss': 0.7202, 'learning_rate': 5.611783842400145e-07, 'epoch': 1.96} {'loss': 0.3564, 'learning_rate': 5.584673775528646e-07, 'epoch': 1.96} {'loss': 0.5877, 'learning_rate': 5.557563708657147e-07, 'epoch': 1.96} {'loss': 0.6769, 'learning_rate': 5.53045364178565e-07, 'epoch': 1.96} {'loss': 0.8955, 'learning_rate': 5.503343574914151e-07, 'epoch': 1.96} {'loss': 1.0589, 'learning_rate': 5.476233508042653e-07, 'epoch': 1.96} {'loss': 0.8337, 'learning_rate': 5.449123441171155e-07, 'epoch': 1.96} {'loss': 0.6903, 'learning_rate': 5.422013374299656e-07, 'epoch': 1.96} {'loss': 0.3602, 'learning_rate': 5.394903307428159e-07, 'epoch': 1.96} {'loss': 0.522, 'learning_rate': 5.36779324055666e-07, 'epoch': 1.96} {'loss': 0.5718, 'learning_rate': 5.340683173685161e-07, 'epoch': 1.96} {'loss': 0.6319, 'learning_rate': 5.313573106813664e-07, 'epoch': 1.96} {'loss': 1.0768, 'learning_rate': 5.286463039942165e-07, 'epoch': 1.96} {'loss': 0.4094, 'learning_rate': 5.259352973070668e-07, 'epoch': 1.96} {'loss': 1.0955, 'learning_rate': 5.232242906199169e-07, 'epoch': 1.97} {'loss': 0.4571, 'learning_rate': 5.20513283932767e-07, 'epoch': 1.97} {'loss': 0.4865, 'learning_rate': 5.178022772456173e-07, 'epoch': 1.97} {'loss': 0.6409, 'learning_rate': 5.150912705584674e-07, 'epoch': 1.97} {'loss': 0.8702, 'learning_rate': 5.123802638713175e-07, 'epoch': 1.97} {'loss': 0.6902, 'learning_rate': 5.096692571841678e-07, 'epoch': 1.97} {'loss': 0.4931, 'learning_rate': 5.069582504970179e-07, 'epoch': 1.97} {'loss': 0.3086, 'learning_rate': 5.042472438098681e-07, 'epoch': 1.97} {'loss': 0.839, 'learning_rate': 5.015362371227183e-07, 'epoch': 1.97} {'loss': 0.4937, 'learning_rate': 4.988252304355684e-07, 'epoch': 1.97} {'loss': 0.6506, 'learning_rate': 4.961142237484187e-07, 'epoch': 1.97} {'loss': 1.1031, 'learning_rate': 4.934032170612688e-07, 'epoch': 1.97} {'loss': 0.645, 'learning_rate': 4.90692210374119e-07, 'epoch': 1.97} {'loss': 0.5629, 'learning_rate': 4.879812036869692e-07, 'epoch': 1.97} {'loss': 0.3914, 'learning_rate': 4.852701969998193e-07, 'epoch': 1.97} {'loss': 0.7342, 'learning_rate': 4.825591903126695e-07, 'epoch': 1.97} {'loss': 1.1886, 'learning_rate': 4.798481836255197e-07, 'epoch': 1.97} {'loss': 0.4077, 'learning_rate': 4.771371769383697e-07, 'epoch': 1.97} {'loss': 1.1107, 'learning_rate': 4.7442617025121994e-07, 'epoch': 1.97} {'loss': 0.6388, 'learning_rate': 4.7171516356407007e-07, 'epoch': 1.97} {'loss': 0.4615, 'learning_rate': 4.6900415687692026e-07, 'epoch': 1.97} {'loss': 0.4432, 'learning_rate': 4.662931501897705e-07, 'epoch': 1.97} {'loss': 0.7286, 'learning_rate': 4.635821435026207e-07, 'epoch': 1.97} {'loss': 0.464, 'learning_rate': 4.608711368154708e-07, 'epoch': 1.97} {'loss': 0.5851, 'learning_rate': 4.58160130128321e-07, 'epoch': 1.97} {'loss': 0.6786, 'learning_rate': 4.5544912344117114e-07, 'epoch': 1.97} {'loss': 0.503, 'learning_rate': 4.5273811675402133e-07, 'epoch': 1.97} {'loss': 0.5892, 'learning_rate': 4.500271100668715e-07, 'epoch': 1.97} {'loss': 0.7091, 'learning_rate': 4.4731610337972165e-07, 'epoch': 1.97} {'loss': 0.7288, 'learning_rate': 4.4460509669257184e-07, 'epoch': 1.97} {'loss': 1.4084, 'learning_rate': 4.41894090005422e-07, 'epoch': 1.97} {'loss': 0.4794, 'learning_rate': 4.391830833182722e-07, 'epoch': 1.97} {'loss': 0.8416, 'learning_rate': 4.3647207663112235e-07, 'epoch': 1.97} {'loss': 0.9282, 'learning_rate': 4.3376106994397253e-07, 'epoch': 1.97} {'loss': 0.6303, 'learning_rate': 4.310500632568227e-07, 'epoch': 1.97} {'loss': 0.5357, 'learning_rate': 4.283390565696729e-07, 'epoch': 1.97} {'loss': 0.6424, 'learning_rate': 4.2562804988252304e-07, 'epoch': 1.97} {'loss': 1.3173, 'learning_rate': 4.2291704319537323e-07, 'epoch': 1.97} {'loss': 0.5124, 'learning_rate': 4.202060365082234e-07, 'epoch': 1.97} {'loss': 0.5378, 'learning_rate': 4.174950298210736e-07, 'epoch': 1.97} {'loss': 1.0757, 'learning_rate': 4.147840231339238e-07, 'epoch': 1.97} {'loss': 0.5583, 'learning_rate': 4.1207301644677387e-07, 'epoch': 1.97} {'loss': 1.1384, 'learning_rate': 4.0936200975962406e-07, 'epoch': 1.97} {'loss': 0.5838, 'learning_rate': 4.0665100307247425e-07, 'epoch': 1.97} {'loss': 0.548, 'learning_rate': 4.0393999638532443e-07, 'epoch': 1.97} {'loss': 0.7062, 'learning_rate': 4.0122898969817457e-07, 'epoch': 1.97} {'loss': 0.7535, 'learning_rate': 3.9851798301102476e-07, 'epoch': 1.97} {'loss': 1.2658, 'learning_rate': 3.9580697632387494e-07, 'epoch': 1.97} {'loss': 0.4446, 'learning_rate': 3.9309596963672513e-07, 'epoch': 1.97} {'loss': 0.7511, 'learning_rate': 3.9038496294957526e-07, 'epoch': 1.97} {'loss': 0.1788, 'learning_rate': 3.8767395626242545e-07, 'epoch': 1.97} {'loss': 0.4641, 'learning_rate': 3.8496294957527564e-07, 'epoch': 1.97} {'loss': 0.4811, 'learning_rate': 3.822519428881258e-07, 'epoch': 1.97} {'loss': 0.647, 'learning_rate': 3.79540936200976e-07, 'epoch': 1.97} {'loss': 0.3885, 'learning_rate': 3.7682992951382615e-07, 'epoch': 1.97} {'loss': 0.5655, 'learning_rate': 3.7411892282667633e-07, 'epoch': 1.98} {'loss': 0.7734, 'learning_rate': 3.714079161395265e-07, 'epoch': 1.98} {'loss': 0.8253, 'learning_rate': 3.6869690945237666e-07, 'epoch': 1.98} {'loss': 0.9247, 'learning_rate': 3.659859027652268e-07, 'epoch': 1.98} {'loss': 1.1011, 'learning_rate': 3.63274896078077e-07, 'epoch': 1.98} {'loss': 0.6545, 'learning_rate': 3.6056388939092717e-07, 'epoch': 1.98} {'loss': 0.2961, 'learning_rate': 3.5785288270377735e-07, 'epoch': 1.98} {'loss': 0.5024, 'learning_rate': 3.551418760166275e-07, 'epoch': 1.98} 99%|█████████▉| 10936/11066 [40:06<00:28, 4.49it/s] 99%|█████████▉| 10937/11066 [40:06<00:28, 4.48it/s] 99%|█████████▉| 10937/11066 [40:06<00:28, 4.48it/s] 99%|█████████▉| 10938/11066 [40:06<00:28, 4.47it/s] 99%|█████████▉| 10938/11066 [40:06<00:28, 4.47it/s] 99%|█████████▉| 10939/11066 [40:06<00:28, 4.48it/s] 99%|█████████▉| 10939/11066 [40:06<00:28, 4.48it/s] 99%|█████████▉| 10940/11066 [40:07<00:28, 4.48it/s] 99%|█████████▉| 10940/11066 [40:07<00:28, 4.48it/s] 99%|█████████▉| 10941/11066 [40:07<00:27, 4.48it/s] 99%|█████████▉| 10941/11066 [40:07<00:27, 4.48it/s] 99%|█████████▉| 10942/11066 [40:07<00:27, 4.50it/s] 99%|█████████▉| 10942/11066 [40:07<00:27, 4.50it/s] 99%|█████████▉| 10943/11066 [40:07<00:27, 4.50it/s] 99%|█████████▉| 10943/11066 [40:07<00:27, 4.50it/s] 99%|█████████▉| 10944/11066 [40:07<00:27, 4.49it/s] 99%|█████████▉| 10944/11066 [40:07<00:27, 4.49it/s] 99%|█████████▉| 10945/11066 [40:08<00:26, 4.50it/s] 99%|█████████▉| 10945/11066 [40:08<00:26, 4.50it/s] 99%|█████████▉| 10946/11066 [40:08<00:26, 4.52it/s] 99%|█████████▉| 10946/11066 [40:08<00:26, 4.52it/s] 99%|█████████▉| 10947/11066 [40:08<00:26, 4.50it/s] 99%|█████████▉| 10947/11066 [40:08<00:26, 4.50it/s] 99%|█████████▉| 10948/11066 [40:08<00:26, 4.52it/s] 99%|█████████▉| 10948/11066 [40:08<00:26, 4.52it/s] 99%|█████████▉| 10949/11066 [40:09<00:25, 4.51it/s] 99%|█████████▉| 10949/11066 [40:09<00:25, 4.51it/s] 99%|█████████▉| 10950/11066 [40:09<00:25, 4.49it/s] 99%|█████████▉| 10950/11066 [40:09<00:25, 4.49it/s] 99%|█████████▉| 10951/11066 [40:09<00:25, 4.50it/s] 99%|█████████▉| 10951/11066 [40:09<00:25, 4.50it/s] 99%|█████████▉| 10952/11066 [40:09<00:25, 4.50it/s] 99%|█████████▉| 10952/11066 [40:09<00:25, 4.50it/s] 99%|█████████▉| 10953/11066 [40:09<00:25, 4.50it/s] 99%|█████████▉| 10953/11066 [40:09<00:25, 4.50it/s] 99%|█████████▉| 10954/11066 [40:10<00:24, 4.53it/s] 99%|█████████▉| 10954/11066 [40:10<00:24, 4.53it/s] 99%|█████████▉| 10955/11066 [40:10<00:24, 4.51it/s] 99%|█████████▉| 10955/11066 [40:10<00:24, 4.51it/s] 99%|█████████▉| 10956/11066 [40:10<00:24, 4.50it/s] 99%|█████████▉| 10956/11066 [40:10<00:24, 4.50it/s] 99%|█████████▉| 10957/11066 [40:10<00:24, 4.49it/s] 99%|█████████▉| 10957/11066 [40:10<00:24, 4.49it/s] 99%|█████████▉| 10958/11066 [40:11<00:24, 4.49it/s] 99%|█████████▉| 10958/11066 [40:11<00:24, 4.49it/s] 99%|█████████▉| 10959/11066 [40:11<00:23, 4.52it/s] 99%|█████████▉| 10959/11066 [40:11<00:23, 4.52it/s] 99%|█████████▉| 10960/11066 [40:11<00:23, 4.50it/s] 99%|█████████▉| 10960/11066 [40:11<00:23, 4.50it/s] 99%|█████████▉| 10961/11066 [40:11<00:23, 4.50it/s] 99%|█████████▉| 10961/11066 [40:11<00:23, 4.50it/s] 99%|█████████▉| 10962/11066 [40:11<00:23, 4.50it/s] 99%|█████████▉| 10962/11066 [40:11<00:23, 4.50it/s] 99%|█████████▉| 10963/11066 [40:12<00:22, 4.56it/s] 99%|█████████▉| 10963/11066 [40:12<00:22, 4.56it/s] 99%|█████████▉| 10964/11066 [40:12<00:22, 4.54it/s] 99%|█████████▉| 10964/11066 [40:12<00:22, 4.54it/s] 99%|█████████▉| 10965/11066 [40:12<00:22, 4.53it/s] 99%|█████████▉| 10965/11066 [40:12<00:22, 4.53it/s] 99%|█████████▉| 10966/11066 [40:12<00:21, 4.56it/s] 99%|█████████▉| 10966/11066 [40:12<00:21, 4.56it/s] 99%|█████████▉| 10967/11066 [40:13<00:21, 4.59it/s] 99%|█████████▉| 10967/11066 [40:13<00:21, 4.59it/s] 99%|█████████▉| 10968/11066 [40:13<00:21, 4.59it/s] 99%|█████████▉| 10968/11066 [40:13<00:21, 4.59it/s] 99%|█████████▉| 10969/11066 [40:13<00:20, 4.62it/s] 99%|█████████▉| 10969/11066 [40:13<00:20, 4.62it/s] 99%|█████████▉| 10970/11066 [40:13<00:20, 4.61it/s] 99%|█████████▉| 10970/11066 [40:13<00:20, 4.61it/s] 99%|█████████▉| 10971/11066 [40:13<00:20, 4.60it/s] 99%|█████████▉| 10971/11066 [40:13<00:20, 4.60it/s] 99%|█████████▉| 10972/11066 [40:14<00:20, 4.55it/s] 99%|█████████▉| 10972/11066 [40:14<00:20, 4.55it/s] 99%|█████████▉| 10973/11066 [40:14<00:20, 4.53it/s] 99%|█████████▉| 10973/11066 [40:14<00:20, 4.53it/s] 99%|█████████▉| 10974/11066 [40:14<00:20, 4.52it/s] 99%|█████████▉| 10974/11066 [40:14<00:20, 4.52it/s] 99%|█████████▉| 10975/11066 [40:14<00:20, 4.51it/s] 99%|█████████▉| 10975/11066 [40:14<00:20, 4.51it/s] 99%|█████████▉| 10976/11066 [40:14<00:19, 4.51it/s] 99%|█████████▉| 10976/11066 [40:14<00:19, 4.51it/s] 99%|█████████▉| 10977/11066 [40:15<00:19, 4.51it/s] 99%|█████████▉| 10977/11066 [40:15<00:19, 4.51it/s] 99%|█████████▉| 10978/11066 [40:15<00:19, 4.57it/s] 99%|█████████▉| 10978/11066 [40:15<00:19, 4.57it/s] 99%|█████████▉| 10979/11066 [40:15<00:19, 4.55it/s] 99%|█████████▉| 10979/11066 [40:15<00:19, 4.55it/s] 99%|█████████▉| 10980/11066 [40:15<00:18, 4.59it/s] 99%|█████████▉| 10980/11066 [40:15<00:18, 4.59it/s] 99%|█████████▉| 10981/11066 [40:16<00:18, 4.57it/s] 99%|█████████▉| 10981/11066 [40:16<00:18, 4.57it/s] 99%|█████████▉| 10982/11066 [40:16<00:18, 4.61it/s] 99%|█████████▉| 10982/11066 [40:16<00:18, 4.61it/s] 99%|█████████▉| 10983/11066 [40:16<00:18, 4.58it/s] 99%|█████████▉| 10983/11066 [40:16<00:18, 4.58it/s] 99%|█████████▉| 10984/11066 [40:16<00:17, 4.57it/s] 99%|█████████▉| 10984/11066 [40:16<00:17, 4.57it/s] 99%|█████████▉| 10985/11066 [40:16<00:17, 4.54it/s] 99%|█████████▉| 10985/11066 [40:16<00:17, 4.54it/s] 99%|█████████▉| 10986/11066 [40:17<00:18, 4.44it/s] 99%|█████████▉| 10986/11066 [40:17<00:18, 4.44it/s] 99%|█████████▉| 10987/11066 [40:17<00:17, 4.43it/s] 99%|█████████▉| 10987/11066 [40:17<00:17, 4.43it/s] 99%|█████████▉| 10988/11066 [40:17<00:17, 4.44it/s] 99%|█████████▉| 10988/11066 [40:17<00:17, 4.44it/s] 99%|█████████▉| 10989/11066 [40:17<00:17, 4.46it/s] 99%|█████████▉| 10989/11066 [40:17<00:17, 4.46it/s] 99%|█████████▉| 10990/11066 [40:18<00:16, 4.47it/s] 99%|█████████▉| 10990/11066 [40:18<00:16, 4.47it/s] 99%|█████████▉| 10991/11066 [40:18<00:16, 4.48it/s] 99%|█████████▉| 10991/11066 [40:18<00:16, 4.48it/s] 99%|█████████▉| 10992/11066 [40:18<00:16, 4.52it/s] 99%|█████████▉| 10992/11066 [40:18<00:16, 4.52it/s] 99%|█████████▉| 10993/11066 [40:18<00:16, 4.49it/s] 99%|█████████▉| 10993/11066 [40:18<00:16, 4.49it/s] 99%|█████████▉| 10994/11066 [40:18<00:15, 4.52it/s] 99%|█████████▉| 10994/11066 [40:18<00:15, 4.52it/s] 99%|█████████▉| 10995/11066 [40:19<00:15, 4.49it/s] 99%|█████████▉| 10995/11066 [40:19<00:15, 4.49it/s] 99%|█████████▉| 10996/11066 [40:19<00:15, 4.49it/s] 99%|█████████▉| 10996/11066 [40:19<00:15, 4.49it/s] 99%|█████████▉| 10997/11066 [40:19<00:15, 4.49it/s] 99%|█████████▉| 10997/11066 [40:19<00:15, 4.49it/s] 99%|█████████▉| 10998/11066 [40:19<00:15, 4.48it/s] 99%|█████████▉| 10998/11066 [40:19<00:15, 4.48it/s] 99%|█████████▉| 10999/11066 [40:20<00:14, 4.47it/s] 99%|█████████▉| 10999/11066 [40:20<00:14, 4.47it/s] 99%|█████████▉| 11000/11066 [40:20<00:14, 4.46it/s] 99%|█████████▉| 11000/11066 [40:20<00:14, 4.46it/s] 99%|█████████▉| 11001/11066 [40:20<00:14, 4.47it/s] 99%|█████████▉| 11001/11066 [40:20<00:14, 4.47it/s] 99%|█████████▉| 11002/11066 [40:20<00:14, 4.47it/s] 99%|█████████▉| 11002/11066 [40:20<00:14, 4.47it/s] 99%|█████████▉| 11003/11066 [40:20<00:13, 4.52it/s] 99%|█████████▉| 11003/11066 [40:20<00:13, 4.52it/s] 99%|█████████▉| 11004/11066 [40:21<00:13, 4.52it/s] 99%|█████████▉| 11004/11066 [40:21<00:13, 4.52it/s] 99%|█████████▉| 11005/11066 [40:21<00:13, 4.57it/s] 99%|█████████▉| 11005/11066 [40:21<00:13, 4.57it/s] 99%|█████████▉| 11006/11066 [40:21<00:13, 4.56it/s] 99%|█████████▉| 11006/11066 [40:21<00:13, 4.56it/s] 99%|█████████▉| 11007/11066 [40:21<00:12, 4.59it/s] 99%|█████████▉| 11007/11066 [40:21<00:12, 4.59it/s] 99%|█████████▉| 11008/11066 [40:22<00:12, 4.62it/s] 99%|█████████▉| 11008/11066 [40:22<00:12, 4.62it/s] 99%|█████████▉| 11009/11066 [40:22<00:12, 4.61it/s] 99%|█████████▉| 11009/11066 [40:22<00:12, 4.61it/s] 99%|█████████▉| 11010/11066 [40:22<00:12, 4.63it/s] 99%|█████████▉| 11010/11066 [40:22<00:12, 4.63it/s] 100%|█████████▉| 11011/11066 [40:22<00:11, 4.60it/s] 100%|█████████▉| 11011/11066 [40:22<00:11, 4.60it/s] 100%|█████████▉| 11012/11066 [40:22<00:12, 4.49it/s] 100%|█████████▉| 11012/11066 [40:22<00:12, 4.49it/s] 100%|█████████▉| 11013/11066 [40:23<00:11, 4.50it/s] 100%|█████████▉| 11013/11066 [40:23<00:11, 4.50it/s] 100%|█████████▉| 11014/11066 [40:23<00:11, 4.58it/s] 100%|█████████▉| 11014/11066 [40:23<00:11, 4.58it/s] 100%|█████████▉| 11015/11066 [40:23<00:10, 4.64it/s] 100%|█████████▉| 11015/11066 [40:23<00:10, 4.64it/s] 100%|█████████▉| 11016/11066 [40:23<00:10, 4.59it/s] 100%|█████████▉| 11016/11066 [40:23<00:10, 4.59it/s] 100%|█████████▉| 11017/11066 [40:24<00:10, 4.59it/s] 100%|█████████▉| 11017/11066 [40:24<00:10, 4.59it/s] 100%|█████████▉| 11018/11066 [40:24<00:10, 4.64it/s] 100%|█████████▉| 11018/11066 [40:24<00:10, 4.64it/s] 100%|█████████▉| 11019/11066 [40:24<00:10, 4.67it/s] 100%|█████████▉| 11019/11066 [40:24<00:10, 4.67it/s] 100%|█████████▉| 11020/11066 [40:24<00:09, 4.69it/s] 100%|█████████▉| 11020/11066 [40:24<00:09, 4.69it/s] 100%|█████████▉| 11021/11066 [40:24<00:09, 4.70it/s] 100%|█████████▉| 11021/11066 [40:24<00:09, 4.70it/s] 100%|█████████▉| 11022/11066 [40:25<00:09, 4.63it/s] 100%|█████████▉| 11022/11066 [40:25<00:09, 4.63it/s] 100%|█████████▉| 11023/11066 [40:25<00:09, 4.66it/s] 100%|█████████▉| 11023/11066 [40:25<00:09, 4.66it/s] 100%|█████████▉| 11024/11066 [40:25<00:08, 4.67it/s] 100%|█████████▉| 11024/11066 [40:25<00:08, 4.67it/s] 100%|█████████▉| 11025/11066 [40:25<00:08, 4.62it/s] 100%|█████████▉| 11025/11066 [40:25<00:08, 4.62it/s] 100%|█████████▉| 11026/11066 [40:25<00:08, 4.57it/s] 100%|█████████▉| 11026/11066 [40:25<00:08, 4.57it/s] 100%|█████████▉| 11027/11066 [40:26<00:08, 4.61it/s] 100%|█████████▉| 11027/11066 [40:26<00:08, 4.61it/s] 100%|█████████▉| 11028/11066 [40:26<00:08, 4.64it/s] 100%|█████████▉| 11028/11066 [40:26<00:08, 4.64it/s] 100%|█████████▉| 11029/11066 [40:26<00:07, 4.66it/s] 100%|█████████▉| 11029/11066 [40:26<00:07, 4.66it/s] 100%|█████████▉| 11030/11066 [40:26<00:07, 4.65it/s] 100%|█████████▉| 11030/11066 [40:26<00:07, 4.65it/s] 100%|█████████▉| 11031/11066 [40:27<00:07, 4.68it/s] 100%|█████████▉| 11031/11066 [40:27<00:07, 4.68it/s] 100%|█████████▉| 11032/11066 [40:27<00:07, 4.63it/s] 100%|█████████▉| 11032/11066 [40:27<00:07, 4.63it/s] 100%|█████████▉| 11033/11066 [40:27<00:07, 4.63it/s] 100%|█████████▉| 11033/11066 [40:27<00:07, 4.63it/s] 100%|█████████▉| 11034/11066 [40:27<00:06, 4.62it/s] 100%|█████████▉| 11034/11066 [40:27<00:06, 4.62it/s] 100%|█████████▉| 11035/11066 [40:27<00:06, 4.65it/s] 100%|█████████▉| 11035/11066 [40:27<00:06, 4.65it/s] 100%|█████████▉| 11036/11066 [40:28<00:06, 4.67it/s] 100%|█████████▉| 11036/11066 [40:28<00:06, 4.67it/s] 100%|█████████▉| 11037/11066 [40:28<00:06, 4.69it/s] 100%|█████████▉| 11037/11066 [40:28<00:06, 4.69it/s] 100%|█████████▉| 11038/11066 [40:28<00:05, 4.69it/s] 100%|█████████▉| 11038/11066 [40:28<00:05, 4.69it/s] 100%|█████████▉| 11039/11066 [40:28<00:05, 4.67it/s] 100%|█████████▉| 11039/11066 [40:28<00:05, 4.67it/s] 100%|█████████▉| 11040/11066 [40:28<00:05, 4.67it/s] 100%|█████████▉| 11040/11066 [40:28<00:05, 4.67it/s] 100%|█████████▉| 11041/11066 [40:29<00:05, 4.64it/s] 100%|█████████▉| 11041/11066 [40:29<00:05, 4.64it/s] 100%|█████████▉| 11042/11066 [40:29<00:05, 4.68it/s] 100%|█████████▉| 11042/11066 [40:29<00:05, 4.68it/s] 100%|█████████▉| 11043/11066 [40:29<00:04, 4.68it/s] 100%|█████████▉| 11043/11066 [40:29<00:04, 4.68it/s] 100%|█████████▉| 11044/11066 [40:29<00:04, 4.67it/s] 100%|█████████▉| 11044/11066 [40:29<00:04, 4.67it/s] 100%|█████████▉| 11045/11066 [40:30<00:04, 4.70it/s] 100%|█████████▉| 11045/11066 [40:30<00:04, 4.70it/s] 100%|█████████▉| 11046/11066 [40:30<00:04, 4.72it/s] 100%|█████████▉| 11046/11066 [40:30<00:04, 4.72it/s] 100%|█████████▉| 11047/11066 [40:30<00:04, 4.72it/s] 100%|█████████▉| 11047/11066 [40:30<00:04, 4.72it/s] 100%|█████████▉| 11048/11066 [40:30<00:03, 4.72it/s] 100%|█████████▉| 11048/11066 [40:30<00:03, 4.72it/s] 100%|█████████▉| 11049/11066 [40:30<00:03, 4.71it/s] {'loss': 1.1048, 'learning_rate': 3.524308693294777e-07, 'epoch': 1.98} {'loss': 0.6476, 'learning_rate': 3.4971986264232786e-07, 'epoch': 1.98} {'loss': 0.2974, 'learning_rate': 3.4700885595517805e-07, 'epoch': 1.98} {'loss': 0.7423, 'learning_rate': 3.442978492680282e-07, 'epoch': 1.98} {'loss': 0.7019, 'learning_rate': 3.4158684258087837e-07, 'epoch': 1.98} {'loss': 0.654, 'learning_rate': 3.3887583589372856e-07, 'epoch': 1.98} {'loss': 1.0116, 'learning_rate': 3.3616482920657874e-07, 'epoch': 1.98} {'loss': 0.8012, 'learning_rate': 3.3345382251942893e-07, 'epoch': 1.98} {'loss': 0.6982, 'learning_rate': 3.3074281583227907e-07, 'epoch': 1.98} {'loss': 0.8199, 'learning_rate': 3.2803180914512925e-07, 'epoch': 1.98} {'loss': 0.7294, 'learning_rate': 3.253208024579794e-07, 'epoch': 1.98} {'loss': 0.3557, 'learning_rate': 3.226097957708296e-07, 'epoch': 1.98} {'loss': 0.413, 'learning_rate': 3.198987890836797e-07, 'epoch': 1.98} {'loss': 0.3363, 'learning_rate': 3.171877823965299e-07, 'epoch': 1.98} {'loss': 0.6272, 'learning_rate': 3.144767757093801e-07, 'epoch': 1.98} {'loss': 0.8527, 'learning_rate': 3.1176576902223027e-07, 'epoch': 1.98} {'loss': 0.235, 'learning_rate': 3.090547623350804e-07, 'epoch': 1.98} {'loss': 0.5767, 'learning_rate': 3.063437556479306e-07, 'epoch': 1.98} {'loss': 0.5585, 'learning_rate': 3.036327489607808e-07, 'epoch': 1.98} {'loss': 0.4596, 'learning_rate': 3.0092174227363097e-07, 'epoch': 1.98} {'loss': 0.9205, 'learning_rate': 2.9821073558648115e-07, 'epoch': 1.98} {'loss': 0.9336, 'learning_rate': 2.954997288993313e-07, 'epoch': 1.98} {'loss': 0.8773, 'learning_rate': 2.927887222121815e-07, 'epoch': 1.98} {'loss': 0.3223, 'learning_rate': 2.9007771552503166e-07, 'epoch': 1.98} {'loss': 0.719, 'learning_rate': 2.8736670883788185e-07, 'epoch': 1.98} {'loss': 0.7092, 'learning_rate': 2.84655702150732e-07, 'epoch': 1.98} {'loss': 0.8337, 'learning_rate': 2.819446954635821e-07, 'epoch': 1.98} {'loss': 0.6949, 'learning_rate': 2.792336887764323e-07, 'epoch': 1.98} {'loss': 0.851, 'learning_rate': 2.765226820892825e-07, 'epoch': 1.98} {'loss': 0.8821, 'learning_rate': 2.7381167540213263e-07, 'epoch': 1.98} {'loss': 0.9523, 'learning_rate': 2.711006687149828e-07, 'epoch': 1.98} {'loss': 0.7278, 'learning_rate': 2.68389662027833e-07, 'epoch': 1.98} {'loss': 0.6208, 'learning_rate': 2.656786553406832e-07, 'epoch': 1.98} {'loss': 0.5151, 'learning_rate': 2.629676486535334e-07, 'epoch': 1.98} {'loss': 1.0197, 'learning_rate': 2.602566419663835e-07, 'epoch': 1.98} {'loss': 0.6817, 'learning_rate': 2.575456352792337e-07, 'epoch': 1.98} {'loss': 0.6522, 'learning_rate': 2.548346285920839e-07, 'epoch': 1.98} {'loss': 0.5543, 'learning_rate': 2.5212362190493407e-07, 'epoch': 1.98} {'loss': 0.6465, 'learning_rate': 2.494126152177842e-07, 'epoch': 1.98} {'loss': 0.7342, 'learning_rate': 2.467016085306344e-07, 'epoch': 1.98} {'loss': 0.9579, 'learning_rate': 2.439906018434846e-07, 'epoch': 1.98} {'loss': 0.5579, 'learning_rate': 2.4127959515633477e-07, 'epoch': 1.98} {'loss': 1.0729, 'learning_rate': 2.3856858846918485e-07, 'epoch': 1.98} {'loss': 1.0067, 'learning_rate': 2.3585758178203504e-07, 'epoch': 1.98} {'loss': 0.795, 'learning_rate': 2.3314657509488525e-07, 'epoch': 1.98} {'loss': 0.8886, 'learning_rate': 2.304355684077354e-07, 'epoch': 1.98} {'loss': 0.7426, 'learning_rate': 2.2772456172058557e-07, 'epoch': 1.98} {'loss': 0.6107, 'learning_rate': 2.2501355503343576e-07, 'epoch': 1.98} {'loss': 0.5422, 'learning_rate': 2.2230254834628592e-07, 'epoch': 1.99} {'loss': 0.6236, 'learning_rate': 2.195915416591361e-07, 'epoch': 1.99} {'loss': 0.6775, 'learning_rate': 2.1688053497198627e-07, 'epoch': 1.99} {'loss': 0.3561, 'learning_rate': 2.1416952828483645e-07, 'epoch': 1.99} {'loss': 0.3834, 'learning_rate': 2.1145852159768661e-07, 'epoch': 1.99} {'loss': 0.5268, 'learning_rate': 2.087475149105368e-07, 'epoch': 1.99} {'loss': 0.4498, 'learning_rate': 2.0603650822338694e-07, 'epoch': 1.99} {'loss': 1.0319, 'learning_rate': 2.0332550153623712e-07, 'epoch': 1.99} {'loss': 0.4949, 'learning_rate': 2.0061449484908728e-07, 'epoch': 1.99} {'loss': 0.7002, 'learning_rate': 1.9790348816193747e-07, 'epoch': 1.99} {'loss': 0.3424, 'learning_rate': 1.9519248147478763e-07, 'epoch': 1.99} {'loss': 0.4705, 'learning_rate': 1.9248147478763782e-07, 'epoch': 1.99} {'loss': 0.256, 'learning_rate': 1.89770468100488e-07, 'epoch': 1.99} {'loss': 0.5019, 'learning_rate': 1.8705946141333817e-07, 'epoch': 1.99} {'loss': 1.2005, 'learning_rate': 1.8434845472618833e-07, 'epoch': 1.99} {'loss': 0.9312, 'learning_rate': 1.816374480390385e-07, 'epoch': 1.99} {'loss': 0.731, 'learning_rate': 1.7892644135188868e-07, 'epoch': 1.99} {'loss': 1.029, 'learning_rate': 1.7621543466473884e-07, 'epoch': 1.99} {'loss': 0.6349, 'learning_rate': 1.7350442797758902e-07, 'epoch': 1.99} {'loss': 0.5103, 'learning_rate': 1.7079342129043918e-07, 'epoch': 1.99} {'loss': 0.9348, 'learning_rate': 1.6808241460328937e-07, 'epoch': 1.99} {'loss': 0.7165, 'learning_rate': 1.6537140791613953e-07, 'epoch': 1.99} {'loss': 0.7424, 'learning_rate': 1.626604012289897e-07, 'epoch': 1.99} {'loss': 0.3513, 'learning_rate': 1.5994939454183985e-07, 'epoch': 1.99} {'loss': 0.8015, 'learning_rate': 1.5723838785469004e-07, 'epoch': 1.99} {'loss': 0.905, 'learning_rate': 1.545273811675402e-07, 'epoch': 1.99} {'loss': 1.167, 'learning_rate': 1.518163744803904e-07, 'epoch': 1.99} {'loss': 0.6511, 'learning_rate': 1.4910536779324058e-07, 'epoch': 1.99} {'loss': 0.5468, 'learning_rate': 1.4639436110609074e-07, 'epoch': 1.99} {'loss': 0.4404, 'learning_rate': 1.4368335441894092e-07, 'epoch': 1.99} {'loss': 0.9051, 'learning_rate': 1.4097234773179106e-07, 'epoch': 1.99} {'loss': 0.5647, 'learning_rate': 1.3826134104464125e-07, 'epoch': 1.99} {'loss': 0.6354, 'learning_rate': 1.355503343574914e-07, 'epoch': 1.99} {'loss': 0.6661, 'learning_rate': 1.328393276703416e-07, 'epoch': 1.99} {'loss': 1.0375, 'learning_rate': 1.3012832098319175e-07, 'epoch': 1.99} {'loss': 0.6944, 'learning_rate': 1.2741731429604194e-07, 'epoch': 1.99} {'loss': 0.38, 'learning_rate': 1.247063076088921e-07, 'epoch': 1.99} {'loss': 0.6036, 'learning_rate': 1.219953009217423e-07, 'epoch': 1.99} {'loss': 1.2028, 'learning_rate': 1.1928429423459242e-07, 'epoch': 1.99} {'loss': 1.0183, 'learning_rate': 1.1657328754744262e-07, 'epoch': 1.99} {'loss': 0.6078, 'learning_rate': 1.1386228086029279e-07, 'epoch': 1.99} {'loss': 0.474, 'learning_rate': 1.1115127417314296e-07, 'epoch': 1.99} {'loss': 0.9146, 'learning_rate': 1.0844026748599313e-07, 'epoch': 1.99} {'loss': 0.9846, 'learning_rate': 1.0572926079884331e-07, 'epoch': 1.99} {'loss': 0.5561, 'learning_rate': 1.0301825411169347e-07, 'epoch': 1.99} {'loss': 0.7157, 'learning_rate': 1.0030724742454364e-07, 'epoch': 1.99} {'loss': 0.7976, 'learning_rate': 9.759624073739382e-08, 'epoch': 1.99} {'loss': 0.6179, 'learning_rate': 9.4885234050244e-08, 'epoch': 1.99} {'loss': 0.7891, 'learning_rate': 9.217422736309416e-08, 'epoch': 1.99} {'loss': 0.5762, 'learning_rate': 8.946322067594434e-08, 'epoch': 1.99} {'loss': 0.471, 'learning_rate': 8.675221398879451e-08, 'epoch': 1.99} {'loss': 0.4826, 'learning_rate': 8.404120730164469e-08, 'epoch': 1.99} {'loss': 0.7229, 'learning_rate': 8.133020061449485e-08, 'epoch': 1.99} {'loss': 0.3919, 'learning_rate': 7.861919392734502e-08, 'epoch': 1.99} {'loss': 0.2105, 'learning_rate': 7.59081872401952e-08, 'epoch': 1.99} {'loss': 0.6759, 'learning_rate': 7.319718055304537e-08, 'epoch': 2.0} {'loss': 0.5047, 'learning_rate': 7.048617386589553e-08, 'epoch': 2.0} {'loss': 0.8142, 'learning_rate': 6.77751671787457e-08, 'epoch': 2.0} {'loss': 0.4116, 'learning_rate': 6.506416049159588e-08, 'epoch': 2.0} {'loss': 0.9319, 'learning_rate': 6.235315380444605e-08, 'epoch': 2.0} {'loss': 0.5246, 'learning_rate': 5.964214711729621e-08, 'epoch': 2.0} {'loss': 0.9541, 'learning_rate': 5.693114043014639e-08, 'epoch': 2.0} {'loss': 0.8759, 'learning_rate': 5.422013374299657e-08, 'epoch': 2.0} {'loss': 0.6786, 'learning_rate': 5.1509127055846734e-08, 'epoch': 2.0} {'loss': 0.7232, 'learning_rate': 4.879812036869691e-08, 'epoch': 2.0} 100%|█████████▉| 11049/11066 [40:30<00:03, 4.71it/s] 100%|█████████▉| 11050/11066 [40:31<00:03, 4.68it/s] 100%|█████████▉| 11050/11066 [40:31<00:03, 4.68it/s] 100%|█████████▉| 11051/11066 [40:31<00:03, 4.64it/s] 100%|█████████▉| 11051/11066 [40:31<00:03, 4.64it/s] 100%|█████████▉| 11052/11066 [40:31<00:02, 4.69it/s] 100%|█████████▉| 11052/11066 [40:31<00:02, 4.69it/s] 100%|█████████▉| 11053/11066 [40:31<00:02, 4.66it/s] 100%|█████████▉| 11053/11066 [40:31<00:02, 4.66it/s] 100%|█████████▉| 11054/11066 [40:31<00:02, 4.69it/s] 100%|█████████▉| 11054/11066 [40:31<00:02, 4.69it/s] 100%|█████████▉| 11055/11066 [40:32<00:02, 4.71it/s] 100%|█████████▉| 11055/11066 [40:32<00:02, 4.71it/s] 100%|█████████▉| 11056/11066 [40:32<00:02, 4.64it/s] 100%|█████████▉| 11056/11066 [40:32<00:02, 4.64it/s] 100%|█████████▉| 11057/11066 [40:32<00:01, 4.66it/s] 100%|█████████▉| 11057/11066 [40:32<00:01, 4.66it/s] 100%|█████████▉| 11058/11066 [40:32<00:01, 4.65it/s] 100%|█████████▉| 11058/11066 [40:32<00:01, 4.65it/s] 100%|█████████▉| 11059/11066 [40:33<00:01, 4.63it/s] 100%|█████████▉| 11059/11066 [40:33<00:01, 4.63it/s] 100%|█████████▉| 11060/11066 [40:33<00:01, 4.59it/s] 100%|█████████▉| 11060/11066 [40:33<00:01, 4.59it/s] 100%|█████████▉| 11061/11066 [40:33<00:01, 4.63it/s] 100%|█████████▉| 11061/11066 [40:33<00:01, 4.63it/s] 100%|█████████▉| 11062/11066 [40:33<00:00, 4.65it/s] 100%|█████████▉| 11062/11066 [40:33<00:00, 4.65it/s] 100%|█████████▉| 11063/11066 [40:33<00:00, 4.64it/s] 100%|█████████▉| 11063/11066 [40:33<00:00, 4.64it/s] 100%|█████████▉| 11064/11066 [40:34<00:00, 4.65it/s] 100%|█████████▉| 11064/11066 [40:34<00:00, 4.65it/s] 100%|█████████▉| 11065/11066 [40:34<00:00, 4.63it/s] 100%|█████████▉| 11065/11066 [40:34<00:00, 4.63it/s] 100%|██████████| 11066/11066 [40:34<00:00, 4.94it/s] 100%|██████████| 11066/11066 [40:34<00:00, 4.94it/s][INFO|trainer.py:1366] 2021-10-20 22:28:50,423 >> Training completed. Do not forget to share your model on huggingface.co/models =) 100%|██████████| 11066/11066 [40:34<00:00, 4.94it/s] 100%|██████████| 11066/11066 [40:34<00:00, 4.55it/s] [INFO|trainer.py:1935] 2021-10-20 22:28:50,424 >> Saving model checkpoint to bert-based-uncased-squad [INFO|configuration_utils.py:391] 2021-10-20 22:28:50,425 >> Configuration saved in bert-based-uncased-squad/config.json [INFO|modeling_utils.py:1001] 2021-10-20 22:28:50,902 >> Model weights saved in bert-based-uncased-squad/pytorch_model.bin [INFO|tokenization_utils_base.py:2020] 2021-10-20 22:28:50,902 >> tokenizer config file saved in bert-based-uncased-squad/tokenizer_config.json [INFO|tokenization_utils_base.py:2026] 2021-10-20 22:28:50,902 >> Special tokens file saved in bert-based-uncased-squad/special_tokens_map.json {'loss': 0.1013, 'learning_rate': 4.608711368154708e-08, 'epoch': 2.0} {'loss': 1.202, 'learning_rate': 4.3376106994397256e-08, 'epoch': 2.0} {'loss': 0.686, 'learning_rate': 4.0665100307247423e-08, 'epoch': 2.0} {'loss': 1.0953, 'learning_rate': 3.79540936200976e-08, 'epoch': 2.0} {'loss': 0.4561, 'learning_rate': 3.5243086932947765e-08, 'epoch': 2.0} {'loss': 0.4277, 'learning_rate': 3.253208024579794e-08, 'epoch': 2.0} {'loss': 0.1749, 'learning_rate': 2.9821073558648106e-08, 'epoch': 2.0} {'loss': 0.6099, 'learning_rate': 2.7110066871498283e-08, 'epoch': 2.0} {'loss': 0.5117, 'learning_rate': 2.4399060184348454e-08, 'epoch': 2.0} {'loss': 0.5277, 'learning_rate': 2.1688053497198628e-08, 'epoch': 2.0} {'loss': 1.204, 'learning_rate': 1.89770468100488e-08, 'epoch': 2.0} {'loss': 0.4059, 'learning_rate': 1.626604012289897e-08, 'epoch': 2.0} {'loss': 0.8129, 'learning_rate': 1.3555033435749142e-08, 'epoch': 2.0} {'loss': 0.474, 'learning_rate': 1.0844026748599314e-08, 'epoch': 2.0} {'loss': 0.7607, 'learning_rate': 8.133020061449485e-09, 'epoch': 2.0} {'loss': 0.5483, 'learning_rate': 5.422013374299657e-09, 'epoch': 2.0} {'loss': 0.3523, 'learning_rate': 2.7110066871498285e-09, 'epoch': 2.0} {'loss': 0.6686, 'learning_rate': 0.0, 'epoch': 2.0} {'train_runtime': 2434.5113, 'train_samples_per_second': 72.724, 'train_steps_per_second': 4.545, 'train_loss': 1.0129275434533833, 'epoch': 2.0} ***** train metrics ***** epoch = 2.0 train_loss = 1.0129 train_runtime = 0:40:34.51 train_samples = 88524 train_samples_per_second = 72.724 train_steps_per_second = 4.545 10/20/2021 22:28:51 - INFO - __main__ - *** Evaluate *** [INFO|trainer.py:520] 2021-10-20 22:28:51,066 >> The following columns in the evaluation set don't have a corresponding argument in `BertForQuestionAnswering.forward` and have been ignored: example_id, offset_mapping. [INFO|trainer.py:2181] 2021-10-20 22:28:51,068 >> ***** Running Evaluation ***** [INFO|trainer.py:2183] 2021-10-20 22:28:51,068 >> Num examples = 10784 [INFO|trainer.py:2186] 2021-10-20 22:28:51,068 >> Batch size = 16 0%| | 0/674 [00:00