/workspace/thumbs_up/train_dreambooth_lora_sdxl.py:122: DeprecationWarning: BILINEAR is deprecated and will be removed in Pillow 10 (2023-07-01). Use Resampling.BILINEAR instead.
  def resize_image(image, size, interpolation=Image.BILINEAR):
10/12/2023 11:10:09 - INFO - __main__ - Current working directory: /workspace/thumbs_up
10/12/2023 11:10:09 - INFO - __main__ - Distributed environment: NO
Num processes: 1
Process index: 0
Local process index: 0
Device: cuda

Mixed precision type: fp16

You are using a model of type clip_text_model to instantiate a model of type . This is not supported for all configurations of models and can yield errors.
You are using a model of type clip_text_model to instantiate a model of type . This is not supported for all configurations of models and can yield errors.
{'clip_sample_range', 'dynamic_thresholding_ratio', 'variance_type', 'thresholding'} was not found in config. Values will be initialized to default values.
{'dropout', 'attention_type'} was not found in config. Values will be initialized to default values.
`text_config_dict` is provided which will be used to initialize `CLIPTextConfig`. The value `text_config["id2label"]` will be overriden.
`text_config_dict` is provided which will be used to initialize `CLIPTextConfig`. The value `text_config["bos_token_id"]` will be overriden.
`text_config_dict` is provided which will be used to initialize `CLIPTextConfig`. The value `text_config["eos_token_id"]` will be overriden.
`text_config_dict` is provided which will be used to initialize `CLIPTextConfig`. The value `text_config["id2label"]` will be overriden.
`text_config_dict` is provided which will be used to initialize `CLIPTextConfig`. The value `text_config["bos_token_id"]` will be overriden.
`text_config_dict` is provided which will be used to initialize `CLIPTextConfig`. The value `text_config["eos_token_id"]` will be overriden.
Some weights of ViTModel were not initialized from the model checkpoint at facebook/dino-vits16 and are newly initialized: ['pooler.dense.weight', 'pooler.dense.bias']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
wandb: Currently logged in as: berglund. Use `wandb login --relogin` to force relogin
wandb: Tracking run with wandb version 0.15.12
wandb: Run data is saved locally in /workspace/thumbs_up/wandb/run-20231012_111029-2jrzk1p1
wandb: Run `wandb offline` to turn off syncing.
wandb: Syncing run bumbling-water-40
wandb: ⭐️ View project at https://wandb.ai/berglund/dreambooth-lora-sd-xl
wandb: 🚀 View run at https://wandb.ai/berglund/dreambooth-lora-sd-xl/runs/2jrzk1p1
10/12/2023 11:10:30 - INFO - __main__ - ***** Running training *****
10/12/2023 11:10:30 - INFO - __main__ -   Num examples = 21
10/12/2023 11:10:30 - INFO - __main__ -   Num batches each epoch = 11
10/12/2023 11:10:30 - INFO - __main__ -   Num Epochs = 100
10/12/2023 11:10:30 - INFO - __main__ -   Instantaneous batch size per device = 2
10/12/2023 11:10:30 - INFO - __main__ -   Total train batch size (w. parallel, distributed & accumulation) = 4
10/12/2023 11:10:30 - INFO - __main__ -   Gradient Accumulation steps = 2
10/12/2023 11:10:30 - INFO - __main__ -   Total optimization steps = 600

Steps:   0%|          | 0/600 [00:00<?, ?it/s]/usr/local/lib/python3.10/dist-packages/diffusers/models/attention_processor.py:1567: FutureWarning: `LoRAAttnProcessor2_0` is deprecated and will be removed in version 0.26.0. Make sure use AttnProcessor2_0 instead by settingLoRA layers to `self.{to_q,to_k,to_v,to_out[0]}.lora_layer` respectively. This will be done automatically when using `LoraLoaderMixin.load_lora_weights`
  deprecate(

Steps:   0%|          | 0/600 [00:02<?, ?it/s, loss=0.0509, lr=0.0001]
Steps:   0%|          | 1/600 [00:04<42:53,  4.30s/it, loss=0.0509, lr=0.0001]
Steps:   0%|          | 1/600 [00:04<42:53,  4.30s/it, loss=0.0944, lr=0.0001]
Steps:   0%|          | 1/600 [00:06<42:53,  4.30s/it, loss=0.235, lr=0.0001] 
Steps:   0%|          | 2/600 [00:08<40:07,  4.03s/it, loss=0.235, lr=0.0001]
Steps:   0%|          | 2/600 [00:08<40:07,  4.03s/it, loss=0.0463, lr=0.0001]
Steps:   0%|          | 2/600 [00:09<40:07,  4.03s/it, loss=0.061, lr=0.0001] 
Steps:   0%|          | 3/600 [00:11<37:32,  3.77s/it, loss=0.061, lr=0.0001]
Steps:   0%|          | 3/600 [00:11<37:32,  3.77s/it, loss=0.00998, lr=0.0001]
Steps:   0%|          | 3/600 [00:13<37:32,  3.77s/it, loss=0.132, lr=0.0001]  
Steps:   1%|          | 4/600 [00:14<34:18,  3.45s/it, loss=0.132, lr=0.0001]
Steps:   1%|          | 4/600 [00:14<34:18,  3.45s/it, loss=0.134, lr=0.0001]
Steps:   1%|          | 4/600 [00:16<34:18,  3.45s/it, loss=0.0905, lr=0.0001]
Steps:   1%|          | 5/600 [00:17<33:26,  3.37s/it, loss=0.0905, lr=0.0001]
Steps:   1%|          | 5/600 [00:17<33:26,  3.37s/it, loss=0.0585, lr=0.0001]
Steps:   1%|          | 6/600 [00:18<25:08,  2.54s/it, loss=0.0585, lr=0.0001]
Steps:   1%|          | 6/600 [00:18<25:08,  2.54s/it, loss=0.291, lr=0.0001] 10/12/2023 11:10:49 - INFO - __main__ - Running validation... 
 Generating 4 images with prompts: "a photo of Brad Pitt in a suit and sunglasses showing <thumbs_up> thumbs up", "a photo of Barack Obama wearing a vest showing <thumbs_up> thumbs up", "a photo of a black man at the beach showing <thumbs_up> thumbs up".


Loading pipeline components...:   0%|          | 0/7 [00:00<?, ?it/s]Loaded tokenizer as CLIPTokenizer from `tokenizer` subfolder of stabilityai/stable-diffusion-xl-base-1.0.
Loaded scheduler as EulerDiscreteScheduler from `scheduler` subfolder of stabilityai/stable-diffusion-xl-base-1.0.
Loaded tokenizer_2 as CLIPTokenizer from `tokenizer_2` subfolder of stabilityai/stable-diffusion-xl-base-1.0.


Loading pipeline components...:  71%|███████▏  | 5/7 [00:00<00:00, 49.85it/s]
Loading pipeline components...: 100%|██████████| 7/7 [00:00<00:00, 68.90it/s]
{'dynamic_thresholding_ratio', 'solver_order', 'lower_order_final', 'lambda_min_clipped', 'solver_type', 'thresholding', 'algorithm_type', 'variance_type'} was not found in config. Values will be initialized to default values.
10/12/2023 11:11:47 - INFO - __main__ - Image features shape: torch.Size([5, 75648])
10/12/2023 11:12:37 - INFO - __main__ - Image features shape: torch.Size([5, 75648])
10/12/2023 11:13:27 - INFO - __main__ - Image features shape: torch.Size([5, 75648])

Steps:   1%|          | 6/600 [03:06<25:08,  2.54s/it, loss=0.143, lr=0.0001]
Steps:   1%|          | 7/600 [03:08<9:26:25, 57.31s/it, loss=0.143, lr=0.0001]
Steps:   1%|          | 7/600 [03:08<9:26:25, 57.31s/it, loss=0.103, lr=0.0001]
Steps:   1%|          | 7/600 [03:10<9:26:25, 57.31s/it, loss=0.185, lr=0.0001]
Steps:   1%|▏         | 8/600 [03:11<6:34:43, 40.01s/it, loss=0.185, lr=0.0001]
Steps:   1%|▏         | 8/600 [03:11<6:34:43, 40.01s/it, loss=0.136, lr=0.0001]
Steps:   1%|▏         | 8/600 [03:13<6:34:43, 40.01s/it, loss=0.0198, lr=0.0001]wandb: WARNING Step only supports monotonically increasing values, use define_metric to set a custom x axis. For details see: https://wandb.me/define-metric
wandb: WARNING (User provided step: 6 is less than current step: 7. Dropping entry: {'loss': 0.14274241030216217, 'lr': 0.0001, '_timestamp': 1697109217.4450603}).

Steps:   2%|▏         | 9/600 [03:15<4:41:13, 28.55s/it, loss=0.0198, lr=0.0001]
Steps:   2%|▏         | 9/600 [03:15<4:41:13, 28.55s/it, loss=0.15, lr=0.0001]  
Steps:   2%|▏         | 9/600 [03:16<4:41:13, 28.55s/it, loss=0.112, lr=0.0001]
Steps:   2%|▏         | 10/600 [03:18<3:24:14, 20.77s/it, loss=0.112, lr=0.0001]
Steps:   2%|▏         | 10/600 [03:18<3:24:14, 20.77s/it, loss=0.184, lr=0.0001]
Steps:   2%|▏         | 10/600 [03:20<3:24:14, 20.77s/it, loss=0.143, lr=0.0001]
Steps:   2%|▏         | 11/600 [03:21<2:30:35, 15.34s/it, loss=0.143, lr=0.0001]
Steps:   2%|▏         | 11/600 [03:21<2:30:35, 15.34s/it, loss=0.102, lr=0.0001]
Steps:   2%|▏         | 12/600 [03:22<1:46:53, 10.91s/it, loss=0.102, lr=0.0001]
Steps:   2%|▏         | 12/600 [03:22<1:46:53, 10.91s/it, loss=0.319, lr=0.0001]
Steps:   2%|▏         | 12/600 [03:24<1:46:53, 10.91s/it, loss=0.0734, lr=0.0001]
Steps:   2%|▏         | 13/600 [03:25<1:25:12,  8.71s/it, loss=0.0734, lr=0.0001]
Steps:   2%|▏         | 13/600 [03:25<1:25:12,  8.71s/it, loss=0.0967, lr=0.0001]
Steps:   2%|▏         | 13/600 [03:27<1:25:12,  8.71s/it, loss=0.0827, lr=0.0001]
Steps:   2%|▏         | 14/600 [03:29<1:09:30,  7.12s/it, loss=0.0827, lr=0.0001]
Steps:   2%|▏         | 14/600 [03:29<1:09:30,  7.12s/it, loss=0.0605, lr=0.0001]
Steps:   2%|▏         | 14/600 [03:31<1:09:30,  7.12s/it, loss=0.197, lr=0.0001] 
Steps:   2%|▎         | 15/600 [03:32<57:23,  5.89s/it, loss=0.197, lr=0.0001]  
Steps:   2%|▎         | 15/600 [03:32<57:23,  5.89s/it, loss=0.0577, lr=0.0001]
Steps:   2%|▎         | 15/600 [03:34<57:23,  5.89s/it, loss=0.0054, lr=0.0001]
Steps:   3%|▎         | 16/600 [03:36<50:54,  5.23s/it, loss=0.0054, lr=0.0001]
Steps:   3%|▎         | 16/600 [03:36<50:54,  5.23s/it, loss=0.15, lr=0.0001]  
Steps:   3%|▎         | 16/600 [03:37<50:54,  5.23s/it, loss=0.0863, lr=0.0001]
Steps:   3%|▎         | 17/600 [03:38<43:23,  4.47s/it, loss=0.0863, lr=0.0001]
Steps:   3%|▎         | 17/600 [03:38<43:23,  4.47s/it, loss=0.142, lr=0.0001] 
Steps:   3%|▎         | 18/600 [03:39<32:33,  3.36s/it, loss=0.142, lr=0.0001]
Steps:   3%|▎         | 18/600 [03:39<32:33,  3.36s/it, loss=0.0125, lr=0.0001]
Steps:   3%|▎         | 18/600 [03:42<32:33,  3.36s/it, loss=0.0872, lr=0.0001]
Steps:   3%|▎         | 19/600 [03:43<34:04,  3.52s/it, loss=0.0872, lr=0.0001]
Steps:   3%|▎         | 19/600 [03:43<34:04,  3.52s/it, loss=0.136, lr=0.0001] 
Steps:   3%|▎         | 19/600 [03:44<34:04,  3.52s/it, loss=0.0605, lr=0.0001]
Steps:   3%|▎         | 20/600 [03:46<32:25,  3.35s/it, loss=0.0605, lr=0.0001]
Steps:   3%|▎         | 20/600 [03:46<32:25,  3.35s/it, loss=0.196, lr=0.0001] 
Steps:   3%|▎         | 20/600 [03:48<32:25,  3.35s/it, loss=0.183, lr=0.0001]
Steps:   4%|▎         | 21/600 [03:49<31:48,  3.30s/it, loss=0.183, lr=0.0001]
Steps:   4%|▎         | 21/600 [03:49<31:48,  3.30s/it, loss=0.175, lr=0.0001]
Steps:   4%|▎         | 21/600 [03:51<31:48,  3.30s/it, loss=0.0723, lr=0.0001]
Steps:   4%|▎         | 22/600 [03:53<32:07,  3.33s/it, loss=0.0723, lr=0.0001]
Steps:   4%|▎         | 22/600 [03:53<32:07,  3.33s/it, loss=0.0251, lr=0.0001]
Steps:   4%|▎         | 22/600 [03:54<32:07,  3.33s/it, loss=0.173, lr=0.0001] 
Steps:   4%|▍         | 23/600 [03:56<31:19,  3.26s/it, loss=0.173, lr=0.0001]
Steps:   4%|▍         | 23/600 [03:56<31:19,  3.26s/it, loss=0.247, lr=0.0001]
Steps:   4%|▍         | 24/600 [03:56<24:07,  2.51s/it, loss=0.247, lr=0.0001]
Steps:   4%|▍         | 24/600 [03:56<24:07,  2.51s/it, loss=0.0922, lr=0.0001]
Steps:   4%|▍         | 24/600 [03:58<24:07,  2.51s/it, loss=0.0783, lr=0.0001]
Steps:   4%|▍         | 25/600 [04:00<26:31,  2.77s/it, loss=0.0783, lr=0.0001]
Steps:   4%|▍         | 25/600 [04:00<26:31,  2.77s/it, loss=0.24, lr=0.0001]  
Steps:   4%|▍         | 25/600 [04:01<26:31,  2.77s/it, loss=0.149, lr=0.0001]
Steps:   4%|▍         | 26/600 [04:03<28:59,  3.03s/it, loss=0.149, lr=0.0001]
Steps:   4%|▍         | 26/600 [04:03<28:59,  3.03s/it, loss=0.0203, lr=0.0001]
Steps:   4%|▍         | 26/600 [04:05<28:59,  3.03s/it, loss=0.263, lr=0.0001] 
Steps:   4%|▍         | 27/600 [04:07<29:40,  3.11s/it, loss=0.263, lr=0.0001]
Steps:   4%|▍         | 27/600 [04:07<29:40,  3.11s/it, loss=0.168, lr=0.0001]
Steps:   4%|▍         | 27/600 [04:08<29:40,  3.11s/it, loss=0.172, lr=0.0001]
Steps:   5%|▍         | 28/600 [04:10<30:30,  3.20s/it, loss=0.172, lr=0.0001]
Steps:   5%|▍         | 28/600 [04:10<30:30,  3.20s/it, loss=0.137, lr=0.0001]
Steps:   5%|▍         | 28/600 [04:11<30:30,  3.20s/it, loss=0.15, lr=0.0001] 
Steps:   5%|▍         | 29/600 [04:13<29:12,  3.07s/it, loss=0.15, lr=0.0001]
Steps:   5%|▍         | 29/600 [04:13<29:12,  3.07s/it, loss=0.025, lr=0.0001]
Steps:   5%|▌         | 30/600 [04:14<22:34,  2.38s/it, loss=0.025, lr=0.0001]
Steps:   5%|▌         | 30/600 [04:14<22:34,  2.38s/it, loss=0.0709, lr=0.0001]
Steps:   5%|▌         | 30/600 [04:16<22:34,  2.38s/it, loss=0.161, lr=0.0001] 
Steps:   5%|▌         | 31/600 [04:18<27:52,  2.94s/it, loss=0.161, lr=0.0001]
Steps:   5%|▌         | 31/600 [04:18<27:52,  2.94s/it, loss=0.0125, lr=0.0001]
Steps:   5%|▌         | 31/600 [04:19<27:52,  2.94s/it, loss=0.169, lr=0.0001] 
Steps:   5%|▌         | 32/600 [04:21<27:44,  2.93s/it, loss=0.169, lr=0.0001]
Steps:   5%|▌         | 32/600 [04:21<27:44,  2.93s/it, loss=0.154, lr=0.0001]
Steps:   5%|▌         | 32/600 [04:22<27:44,  2.93s/it, loss=0.0701, lr=0.0001]
Steps:   6%|▌         | 33/600 [04:24<28:19,  3.00s/it, loss=0.0701, lr=0.0001]
Steps:   6%|▌         | 33/600 [04:24<28:19,  3.00s/it, loss=0.104, lr=0.0001] 
Steps:   6%|▌         | 33/600 [04:25<28:19,  3.00s/it, loss=0.0639, lr=0.0001]
Steps:   6%|▌         | 34/600 [04:27<28:59,  3.07s/it, loss=0.0639, lr=0.0001]
Steps:   6%|▌         | 34/600 [04:27<28:59,  3.07s/it, loss=0.135, lr=0.0001] 
Steps:   6%|▌         | 34/600 [04:29<28:59,  3.07s/it, loss=0.169, lr=0.0001]
Steps:   6%|▌         | 35/600 [04:30<28:24,  3.02s/it, loss=0.169, lr=0.0001]
Steps:   6%|▌         | 35/600 [04:30<28:24,  3.02s/it, loss=0.059, lr=0.0001]
Steps:   6%|▌         | 36/600 [04:31<21:59,  2.34s/it, loss=0.059, lr=0.0001]
Steps:   6%|▌         | 36/600 [04:31<21:59,  2.34s/it, loss=0.00229, lr=0.0001]
Steps:   6%|▌         | 36/600 [04:33<21:59,  2.34s/it, loss=0.0976, lr=0.0001] 
Steps:   6%|▌         | 37/600 [04:35<25:54,  2.76s/it, loss=0.0976, lr=0.0001]
Steps:   6%|▌         | 37/600 [04:35<25:54,  2.76s/it, loss=0.0996, lr=0.0001]
Steps:   6%|▌         | 37/600 [04:36<25:54,  2.76s/it, loss=0.2, lr=0.0001]   
Steps:   6%|▋         | 38/600 [04:38<28:09,  3.01s/it, loss=0.2, lr=0.0001]
Steps:   6%|▋         | 38/600 [04:38<28:09,  3.01s/it, loss=0.144, lr=0.0001]
Steps:   6%|▋         | 38/600 [04:40<28:09,  3.01s/it, loss=0.0461, lr=0.0001]
Steps:   6%|▋         | 39/600 [04:41<28:38,  3.06s/it, loss=0.0461, lr=0.0001]
Steps:   6%|▋         | 39/600 [04:41<28:38,  3.06s/it, loss=0.0286, lr=0.0001]
Steps:   6%|▋         | 39/600 [04:43<28:38,  3.06s/it, loss=0.016, lr=0.0001] 
Steps:   7%|▋         | 40/600 [04:44<28:39,  3.07s/it, loss=0.016, lr=0.0001]
Steps:   7%|▋         | 40/600 [04:44<28:39,  3.07s/it, loss=0.114, lr=0.0001]
Steps:   7%|▋         | 40/600 [04:46<28:39,  3.07s/it, loss=0.0512, lr=0.0001]
Steps:   7%|▋         | 41/600 [04:47<28:22,  3.05s/it, loss=0.0512, lr=0.0001]
Steps:   7%|▋         | 41/600 [04:47<28:22,  3.05s/it, loss=0.14, lr=0.0001]  
Steps:   7%|▋         | 42/600 [04:48<21:57,  2.36s/it, loss=0.14, lr=0.0001]
Steps:   7%|▋         | 42/600 [04:48<21:57,  2.36s/it, loss=0.00212, lr=0.0001]
Steps:   7%|▋         | 42/600 [04:50<21:57,  2.36s/it, loss=0.0582, lr=0.0001] 
Steps:   7%|▋         | 43/600 [04:52<26:18,  2.83s/it, loss=0.0582, lr=0.0001]
Steps:   7%|▋         | 43/600 [04:52<26:18,  2.83s/it, loss=0.21, lr=0.0001]  
Steps:   7%|▋         | 43/600 [04:54<26:18,  2.83s/it, loss=0.034, lr=0.0001]
Steps:   7%|▋         | 44/600 [04:55<27:29,  2.97s/it, loss=0.034, lr=0.0001]
Steps:   7%|▋         | 44/600 [04:55<27:29,  2.97s/it, loss=0.111, lr=0.0001]
Steps:   7%|▋         | 44/600 [04:57<27:29,  2.97s/it, loss=0.0384, lr=0.0001]
Steps:   8%|▊         | 45/600 [04:58<27:22,  2.96s/it, loss=0.0384, lr=0.0001]
Steps:   8%|▊         | 45/600 [04:58<27:22,  2.96s/it, loss=0.0318, lr=0.0001]
Steps:   8%|▊         | 45/600 [05:00<27:22,  2.96s/it, loss=0.0763, lr=0.0001]
Steps:   8%|▊         | 46/600 [05:02<28:45,  3.11s/it, loss=0.0763, lr=0.0001]
Steps:   8%|▊         | 46/600 [05:02<28:45,  3.11s/it, loss=0.201, lr=0.0001] 
Steps:   8%|▊         | 46/600 [05:03<28:45,  3.11s/it, loss=0.0298, lr=0.0001]
Steps:   8%|▊         | 47/600 [05:05<27:59,  3.04s/it, loss=0.0298, lr=0.0001]
Steps:   8%|▊         | 47/600 [05:05<27:59,  3.04s/it, loss=0.194, lr=0.0001] 
Steps:   8%|▊         | 48/600 [05:05<21:38,  2.35s/it, loss=0.194, lr=0.0001]
Steps:   8%|▊         | 48/600 [05:05<21:38,  2.35s/it, loss=0.397, lr=0.0001]
Steps:   8%|▊         | 48/600 [05:08<21:38,  2.35s/it, loss=0.0848, lr=0.0001]
Steps:   8%|▊         | 49/600 [05:09<25:01,  2.73s/it, loss=0.0848, lr=0.0001]
Steps:   8%|▊         | 49/600 [05:09<25:01,  2.73s/it, loss=0.156, lr=0.0001] 
Steps:   8%|▊         | 49/600 [05:11<25:01,  2.73s/it, loss=0.0625, lr=0.0001]
Steps:   8%|▊         | 50/600 [05:12<26:45,  2.92s/it, loss=0.0625, lr=0.0001]
Steps:   8%|▊         | 50/600 [05:12<26:45,  2.92s/it, loss=0.143, lr=0.0001] 
Steps:   8%|▊         | 50/600 [05:14<26:45,  2.92s/it, loss=0.00493, lr=0.0001]
Steps:   8%|▊         | 51/600 [05:16<27:56,  3.05s/it, loss=0.00493, lr=0.0001]
Steps:   8%|▊         | 51/600 [05:16<27:56,  3.05s/it, loss=0.112, lr=0.0001]  
Steps:   8%|▊         | 51/600 [05:17<27:56,  3.05s/it, loss=0.0723, lr=0.0001]
Steps:   9%|▊         | 52/600 [05:19<27:47,  3.04s/it, loss=0.0723, lr=0.0001]
Steps:   9%|▊         | 52/600 [05:19<27:47,  3.04s/it, loss=0.0142, lr=0.0001]
Steps:   9%|▊         | 52/600 [05:20<27:47,  3.04s/it, loss=0.0048, lr=0.0001]
Steps:   9%|▉         | 53/600 [05:22<27:53,  3.06s/it, loss=0.0048, lr=0.0001]
Steps:   9%|▉         | 53/600 [05:22<27:53,  3.06s/it, loss=0.13, lr=0.0001]  
Steps:   9%|▉         | 54/600 [05:23<21:32,  2.37s/it, loss=0.13, lr=0.0001]
Steps:   9%|▉         | 54/600 [05:23<21:32,  2.37s/it, loss=0.25, lr=0.0001]
Steps:   9%|▉         | 54/600 [05:24<21:32,  2.37s/it, loss=0.226, lr=0.0001]
Steps:   9%|▉         | 55/600 [05:26<25:07,  2.77s/it, loss=0.226, lr=0.0001]
Steps:   9%|▉         | 55/600 [05:26<25:07,  2.77s/it, loss=0.0418, lr=0.0001]
Steps:   9%|▉         | 55/600 [05:28<25:07,  2.77s/it, loss=0.00839, lr=0.0001]
Steps:   9%|▉         | 56/600 [05:29<25:52,  2.85s/it, loss=0.00839, lr=0.0001]
Steps:   9%|▉         | 56/600 [05:29<25:52,  2.85s/it, loss=0.109, lr=0.0001]  
Steps:   9%|▉         | 56/600 [05:31<25:52,  2.85s/it, loss=0.0143, lr=0.0001]
Steps:  10%|▉         | 57/600 [05:33<27:51,  3.08s/it, loss=0.0143, lr=0.0001]
Steps:  10%|▉         | 57/600 [05:33<27:51,  3.08s/it, loss=0.186, lr=0.0001] 
Steps:  10%|▉         | 57/600 [05:35<27:51,  3.08s/it, loss=0.0973, lr=0.0001]
Steps:  10%|▉         | 58/600 [05:36<28:33,  3.16s/it, loss=0.0973, lr=0.0001]
Steps:  10%|▉         | 58/600 [05:36<28:33,  3.16s/it, loss=0.205, lr=0.0001] 
Steps:  10%|▉         | 58/600 [05:38<28:33,  3.16s/it, loss=0.0546, lr=0.0001]
Steps:  10%|▉         | 59/600 [05:39<27:25,  3.04s/it, loss=0.0546, lr=0.0001]
Steps:  10%|▉         | 59/600 [05:39<27:25,  3.04s/it, loss=0.0294, lr=0.0001]
Steps:  10%|█         | 60/600 [05:40<21:13,  2.36s/it, loss=0.0294, lr=0.0001]
Steps:  10%|█         | 60/600 [05:40<21:13,  2.36s/it, loss=0.321, lr=0.0001] 
Steps:  10%|█         | 60/600 [05:42<21:13,  2.36s/it, loss=0.119, lr=0.0001]
Steps:  10%|█         | 61/600 [05:44<24:53,  2.77s/it, loss=0.119, lr=0.0001]
Steps:  10%|█         | 61/600 [05:44<24:53,  2.77s/it, loss=0.159, lr=0.0001]
Steps:  10%|█         | 61/600 [05:45<24:53,  2.77s/it, loss=0.197, lr=0.0001]
Steps:  10%|█         | 62/600 [05:47<26:32,  2.96s/it, loss=0.197, lr=0.0001]
Steps:  10%|█         | 62/600 [05:47<26:32,  2.96s/it, loss=0.0344, lr=0.0001]
Steps:  10%|█         | 62/600 [05:49<26:32,  2.96s/it, loss=0.264, lr=0.0001] 
Steps:  10%|█         | 63/600 [05:50<26:49,  3.00s/it, loss=0.264, lr=0.0001]
Steps:  10%|█         | 63/600 [05:50<26:49,  3.00s/it, loss=0.00302, lr=0.0001]
Steps:  10%|█         | 63/600 [05:52<26:49,  3.00s/it, loss=0.0194, lr=0.0001] 
Steps:  11%|█         | 64/600 [05:53<27:36,  3.09s/it, loss=0.0194, lr=0.0001]
Steps:  11%|█         | 64/600 [05:53<27:36,  3.09s/it, loss=0.0502, lr=0.0001]
Steps:  11%|█         | 64/600 [05:55<27:36,  3.09s/it, loss=0.017, lr=0.0001] 
Steps:  11%|█         | 65/600 [05:56<27:26,  3.08s/it, loss=0.017, lr=0.0001]
Steps:  11%|█         | 65/600 [05:56<27:26,  3.08s/it, loss=0.199, lr=0.0001]
Steps:  11%|█         | 66/600 [05:57<21:17,  2.39s/it, loss=0.199, lr=0.0001]
Steps:  11%|█         | 66/600 [05:57<21:17,  2.39s/it, loss=0.358, lr=0.0001]
Steps:  11%|█         | 66/600 [06:00<21:17,  2.39s/it, loss=0.0326, lr=0.0001]
Steps:  11%|█         | 67/600 [06:01<26:17,  2.96s/it, loss=0.0326, lr=0.0001]
Steps:  11%|█         | 67/600 [06:02<26:17,  2.96s/it, loss=0.0202, lr=0.0001]
Steps:  11%|█         | 67/600 [06:03<26:17,  2.96s/it, loss=0.0848, lr=0.0001]
Steps:  11%|█▏        | 68/600 [06:05<26:56,  3.04s/it, loss=0.0848, lr=0.0001]
Steps:  11%|█▏        | 68/600 [06:05<26:56,  3.04s/it, loss=0.0872, lr=0.0001]
Steps:  11%|█▏        | 68/600 [06:06<26:56,  3.04s/it, loss=0.131, lr=0.0001] 
Steps:  12%|█▏        | 69/600 [06:08<27:02,  3.06s/it, loss=0.131, lr=0.0001]
Steps:  12%|█▏        | 69/600 [06:08<27:02,  3.06s/it, loss=0.1, lr=0.0001]  
Steps:  12%|█▏        | 69/600 [06:09<27:02,  3.06s/it, loss=0.0346, lr=0.0001]
Steps:  12%|█▏        | 70/600 [06:11<27:26,  3.11s/it, loss=0.0346, lr=0.0001]
Steps:  12%|█▏        | 70/600 [06:11<27:26,  3.11s/it, loss=0.0887, lr=0.0001]
Steps:  12%|█▏        | 70/600 [06:13<27:26,  3.11s/it, loss=0.0554, lr=0.0001]
Steps:  12%|█▏        | 71/600 [06:14<26:26,  3.00s/it, loss=0.0554, lr=0.0001]
Steps:  12%|█▏        | 71/600 [06:14<26:26,  3.00s/it, loss=0.155, lr=0.0001] 
Steps:  12%|█▏        | 72/600 [06:15<20:32,  2.33s/it, loss=0.155, lr=0.0001]
Steps:  12%|█▏        | 72/600 [06:15<20:32,  2.33s/it, loss=0.363, lr=0.0001]
Steps:  12%|█▏        | 72/600 [06:17<20:32,  2.33s/it, loss=0.0933, lr=0.0001]
Steps:  12%|█▏        | 73/600 [06:18<24:26,  2.78s/it, loss=0.0933, lr=0.0001]
Steps:  12%|█▏        | 73/600 [06:18<24:26,  2.78s/it, loss=0.0806, lr=0.0001]
Steps:  12%|█▏        | 73/600 [06:20<24:26,  2.78s/it, loss=0.0712, lr=0.0001]
Steps:  12%|█▏        | 74/600 [06:22<26:21,  3.01s/it, loss=0.0712, lr=0.0001]
Steps:  12%|█▏        | 74/600 [06:22<26:21,  3.01s/it, loss=0.113, lr=0.0001] 
Steps:  12%|█▏        | 74/600 [06:24<26:21,  3.01s/it, loss=0.104, lr=0.0001]
Steps:  12%|█▎        | 75/600 [06:25<27:33,  3.15s/it, loss=0.104, lr=0.0001]
Steps:  12%|█▎        | 75/600 [06:25<27:33,  3.15s/it, loss=0.127, lr=0.0001]
Steps:  12%|█▎        | 75/600 [06:27<27:33,  3.15s/it, loss=0.0204, lr=0.0001]
Steps:  13%|█▎        | 76/600 [06:29<27:40,  3.17s/it, loss=0.0204, lr=0.0001]
Steps:  13%|█▎        | 76/600 [06:29<27:40,  3.17s/it, loss=0.186, lr=0.0001] 
Steps:  13%|█▎        | 76/600 [06:30<27:40,  3.17s/it, loss=0.0765, lr=0.0001]
Steps:  13%|█▎        | 77/600 [06:31<25:52,  2.97s/it, loss=0.0765, lr=0.0001]
Steps:  13%|█▎        | 77/600 [06:31<25:52,  2.97s/it, loss=0.103, lr=0.0001] 
Steps:  13%|█▎        | 78/600 [06:32<20:05,  2.31s/it, loss=0.103, lr=0.0001]
Steps:  13%|█▎        | 78/600 [06:32<20:05,  2.31s/it, loss=0.112, lr=0.0001]
Steps:  13%|█▎        | 78/600 [06:34<20:05,  2.31s/it, loss=0.0303, lr=0.0001]
Steps:  13%|█▎        | 79/600 [06:36<25:22,  2.92s/it, loss=0.0303, lr=0.0001]
Steps:  13%|█▎        | 79/600 [06:36<25:22,  2.92s/it, loss=0.0488, lr=0.0001]
Steps:  13%|█▎        | 79/600 [06:38<25:22,  2.92s/it, loss=0.0273, lr=0.0001]
Steps:  13%|█▎        | 80/600 [06:39<25:53,  2.99s/it, loss=0.0273, lr=0.0001]
Steps:  13%|█▎        | 80/600 [06:39<25:53,  2.99s/it, loss=0.147, lr=0.0001] 
Steps:  13%|█▎        | 80/600 [06:41<25:53,  2.99s/it, loss=0.0481, lr=0.0001]
Steps:  14%|█▎        | 81/600 [06:43<26:35,  3.07s/it, loss=0.0481, lr=0.0001]
Steps:  14%|█▎        | 81/600 [06:43<26:35,  3.07s/it, loss=0.0311, lr=0.0001]
Steps:  14%|█▎        | 81/600 [06:44<26:35,  3.07s/it, loss=0.3, lr=0.0001]   
Steps:  14%|█▎        | 82/600 [06:46<26:50,  3.11s/it, loss=0.3, lr=0.0001]
Steps:  14%|█▎        | 82/600 [06:46<26:50,  3.11s/it, loss=0.214, lr=0.0001]
Steps:  14%|█▎        | 82/600 [06:47<26:50,  3.11s/it, loss=0.102, lr=0.0001]
Steps:  14%|█▍        | 83/600 [06:48<25:30,  2.96s/it, loss=0.102, lr=0.0001]
Steps:  14%|█▍        | 83/600 [06:48<25:30,  2.96s/it, loss=0.171, lr=0.0001]
Steps:  14%|█▍        | 84/600 [06:49<19:50,  2.31s/it, loss=0.171, lr=0.0001]
Steps:  14%|█▍        | 84/600 [06:49<19:50,  2.31s/it, loss=0.00434, lr=0.0001]
Steps:  14%|█▍        | 84/600 [06:52<19:50,  2.31s/it, loss=0.201, lr=0.0001]  
Steps:  14%|█▍        | 85/600 [06:53<24:40,  2.87s/it, loss=0.201, lr=0.0001]
Steps:  14%|█▍        | 85/600 [06:53<24:40,  2.87s/it, loss=0.187, lr=0.0001]
Steps:  14%|█▍        | 85/600 [06:55<24:40,  2.87s/it, loss=0.0748, lr=0.0001]
Steps:  14%|█▍        | 86/600 [06:56<24:49,  2.90s/it, loss=0.0748, lr=0.0001]
Steps:  14%|█▍        | 86/600 [06:56<24:49,  2.90s/it, loss=0.113, lr=0.0001] 
Steps:  14%|█▍        | 86/600 [06:58<24:49,  2.90s/it, loss=0.08, lr=0.0001] 
Steps:  14%|█▍        | 87/600 [07:00<26:54,  3.15s/it, loss=0.08, lr=0.0001]
Steps:  14%|█▍        | 87/600 [07:00<26:54,  3.15s/it, loss=0.134, lr=0.0001]
Steps:  14%|█▍        | 87/600 [07:02<26:54,  3.15s/it, loss=0.0385, lr=0.0001]
Steps:  15%|█▍        | 88/600 [07:03<26:13,  3.07s/it, loss=0.0385, lr=0.0001]
Steps:  15%|█▍        | 88/600 [07:03<26:13,  3.07s/it, loss=0.058, lr=0.0001] 
Steps:  15%|█▍        | 88/600 [07:05<26:13,  3.07s/it, loss=0.00927, lr=0.0001]
Steps:  15%|█▍        | 89/600 [07:06<25:32,  3.00s/it, loss=0.00927, lr=0.0001]
Steps:  15%|█▍        | 89/600 [07:06<25:32,  3.00s/it, loss=0.115, lr=0.0001]  
Steps:  15%|█▌        | 90/600 [07:07<19:48,  2.33s/it, loss=0.115, lr=0.0001]
Steps:  15%|█▌        | 90/600 [07:07<19:48,  2.33s/it, loss=0.321, lr=0.0001]
Steps:  15%|█▌        | 90/600 [07:08<19:48,  2.33s/it, loss=0.125, lr=0.0001]
Steps:  15%|█▌        | 91/600 [07:10<22:40,  2.67s/it, loss=0.125, lr=0.0001]
Steps:  15%|█▌        | 91/600 [07:10<22:40,  2.67s/it, loss=0.078, lr=0.0001]
Steps:  15%|█▌        | 91/600 [07:12<22:40,  2.67s/it, loss=0.0376, lr=0.0001]
Steps:  15%|█▌        | 92/600 [07:14<25:02,  2.96s/it, loss=0.0376, lr=0.0001]
Steps:  15%|█▌        | 92/600 [07:14<25:02,  2.96s/it, loss=0.188, lr=0.0001] 
Steps:  15%|█▌        | 92/600 [07:15<25:02,  2.96s/it, loss=0.141, lr=0.0001]
Steps:  16%|█▌        | 93/600 [07:17<26:01,  3.08s/it, loss=0.141, lr=0.0001]
Steps:  16%|█▌        | 93/600 [07:17<26:01,  3.08s/it, loss=0.216, lr=0.0001]
Steps:  16%|█▌        | 93/600 [07:19<26:01,  3.08s/it, loss=0.195, lr=0.0001]
Steps:  16%|█▌        | 94/600 [07:20<26:08,  3.10s/it, loss=0.195, lr=0.0001]
Steps:  16%|█▌        | 94/600 [07:20<26:08,  3.10s/it, loss=0.129, lr=0.0001]
Steps:  16%|█▌        | 94/600 [07:22<26:08,  3.10s/it, loss=0.00983, lr=0.0001]
Steps:  16%|█▌        | 95/600 [07:23<25:28,  3.03s/it, loss=0.00983, lr=0.0001]
Steps:  16%|█▌        | 95/600 [07:23<25:28,  3.03s/it, loss=0.179, lr=0.0001]  
Steps:  16%|█▌        | 96/600 [07:24<19:42,  2.35s/it, loss=0.179, lr=0.0001]
Steps:  16%|█▌        | 96/600 [07:24<19:42,  2.35s/it, loss=0.0223, lr=0.0001]
Steps:  16%|█▌        | 96/600 [07:27<19:42,  2.35s/it, loss=0.0303, lr=0.0001]
Steps:  16%|█▌        | 97/600 [07:28<25:06,  3.00s/it, loss=0.0303, lr=0.0001]
Steps:  16%|█▌        | 97/600 [07:28<25:06,  3.00s/it, loss=0.0418, lr=0.0001]
Steps:  16%|█▌        | 97/600 [07:30<25:06,  3.00s/it, loss=0.0112, lr=0.0001]
Steps:  16%|█▋        | 98/600 [07:31<25:00,  2.99s/it, loss=0.0112, lr=0.0001]
Steps:  16%|█▋        | 98/600 [07:31<25:00,  2.99s/it, loss=0.159, lr=0.0001] 
Steps:  16%|█▋        | 98/600 [07:33<25:00,  2.99s/it, loss=0.0292, lr=0.0001]
Steps:  16%|█▋        | 99/600 [07:35<25:24,  3.04s/it, loss=0.0292, lr=0.0001]
Steps:  16%|█▋        | 99/600 [07:35<25:24,  3.04s/it, loss=0.0687, lr=0.0001]
Steps:  16%|█▋        | 99/600 [07:36<25:24,  3.04s/it, loss=0.0918, lr=0.0001]
Steps:  17%|█▋        | 100/600 [07:37<25:09,  3.02s/it, loss=0.0918, lr=0.0001]
Steps:  17%|█▋        | 100/600 [07:37<25:09,  3.02s/it, loss=0.192, lr=0.0001] 
Steps:  17%|█▋        | 100/600 [07:39<25:09,  3.02s/it, loss=0.00971, lr=0.0001]
Steps:  17%|█▋        | 101/600 [07:40<24:37,  2.96s/it, loss=0.00971, lr=0.0001]
Steps:  17%|█▋        | 101/600 [07:40<24:37,  2.96s/it, loss=0.0842, lr=0.0001] 
Steps:  17%|█▋        | 102/600 [07:41<19:07,  2.30s/it, loss=0.0842, lr=0.0001]
Steps:  17%|█▋        | 102/600 [07:41<19:07,  2.30s/it, loss=0.0331, lr=0.0001]
Steps:  17%|█▋        | 102/600 [07:44<19:07,  2.30s/it, loss=0.0573, lr=0.0001]
Steps:  17%|█▋        | 103/600 [07:45<23:41,  2.86s/it, loss=0.0573, lr=0.0001]
Steps:  17%|█▋        | 103/600 [07:45<23:41,  2.86s/it, loss=0.117, lr=0.0001] 
Steps:  17%|█▋        | 103/600 [07:47<23:41,  2.86s/it, loss=0.193, lr=0.0001]
Steps:  17%|█▋        | 104/600 [07:49<24:42,  2.99s/it, loss=0.193, lr=0.0001]
Steps:  17%|█▋        | 104/600 [07:49<24:42,  2.99s/it, loss=0.198, lr=0.0001]
Steps:  17%|█▋        | 104/600 [07:50<24:42,  2.99s/it, loss=0.0971, lr=0.0001]
Steps:  18%|█▊        | 105/600 [07:52<24:59,  3.03s/it, loss=0.0971, lr=0.0001]
Steps:  18%|█▊        | 105/600 [07:52<24:59,  3.03s/it, loss=0.123, lr=0.0001] 
Steps:  18%|█▊        | 105/600 [07:53<24:59,  3.03s/it, loss=0.124, lr=0.0001]
Steps:  18%|█▊        | 106/600 [07:55<25:24,  3.09s/it, loss=0.124, lr=0.0001]
Steps:  18%|█▊        | 106/600 [07:55<25:24,  3.09s/it, loss=0.00773, lr=0.0001]
Steps:  18%|█▊        | 106/600 [07:56<25:24,  3.09s/it, loss=0.0208, lr=0.0001] 
Steps:  18%|█▊        | 107/600 [07:57<24:15,  2.95s/it, loss=0.0208, lr=0.0001]
Steps:  18%|█▊        | 107/600 [07:57<24:15,  2.95s/it, loss=0.0374, lr=0.0001]
Steps:  18%|█▊        | 108/600 [07:58<18:49,  2.30s/it, loss=0.0374, lr=0.0001]
Steps:  18%|█▊        | 108/600 [07:58<18:49,  2.30s/it, loss=0.134, lr=0.0001] 
Steps:  18%|█▊        | 108/600 [08:00<18:49,  2.30s/it, loss=0.0282, lr=0.0001]
Steps:  18%|█▊        | 109/600 [08:02<21:55,  2.68s/it, loss=0.0282, lr=0.0001]
Steps:  18%|█▊        | 109/600 [08:02<21:55,  2.68s/it, loss=0.142, lr=0.0001] 
Steps:  18%|█▊        | 109/600 [08:04<21:55,  2.68s/it, loss=0.127, lr=0.0001]
Steps:  18%|█▊        | 110/600 [08:05<24:12,  2.96s/it, loss=0.127, lr=0.0001]
Steps:  18%|█▊        | 110/600 [08:05<24:12,  2.96s/it, loss=0.00984, lr=0.0001]
Steps:  18%|█▊        | 110/600 [08:07<24:12,  2.96s/it, loss=0.155, lr=0.0001]  
Steps:  18%|█▊        | 111/600 [08:09<25:17,  3.10s/it, loss=0.155, lr=0.0001]
Steps:  18%|█▊        | 111/600 [08:09<25:17,  3.10s/it, loss=0.00988, lr=0.0001]
Steps:  18%|█▊        | 111/600 [08:10<25:17,  3.10s/it, loss=0.094, lr=0.0001]  
Steps:  19%|█▊        | 112/600 [08:12<24:57,  3.07s/it, loss=0.094, lr=0.0001]
Steps:  19%|█▊        | 112/600 [08:12<24:57,  3.07s/it, loss=0.125, lr=0.0001]
Steps:  19%|█▊        | 112/600 [08:14<24:57,  3.07s/it, loss=0.129, lr=0.0001]
Steps:  19%|█▉        | 113/600 [08:15<24:35,  3.03s/it, loss=0.129, lr=0.0001]
Steps:  19%|█▉        | 113/600 [08:15<24:35,  3.03s/it, loss=0.0309, lr=0.0001]
Steps:  19%|█▉        | 114/600 [08:16<19:03,  2.35s/it, loss=0.0309, lr=0.0001]
Steps:  19%|█▉        | 114/600 [08:16<19:03,  2.35s/it, loss=0.022, lr=0.0001] 
Steps:  19%|█▉        | 114/600 [08:18<19:03,  2.35s/it, loss=0.101, lr=0.0001]
Steps:  19%|█▉        | 115/600 [08:19<22:42,  2.81s/it, loss=0.101, lr=0.0001]
Steps:  19%|█▉        | 115/600 [08:19<22:42,  2.81s/it, loss=0.0848, lr=0.0001]
Steps:  19%|█▉        | 115/600 [08:21<22:42,  2.81s/it, loss=0.0154, lr=0.0001]
Steps:  19%|█▉        | 116/600 [08:23<24:02,  2.98s/it, loss=0.0154, lr=0.0001]
Steps:  19%|█▉        | 116/600 [08:23<24:02,  2.98s/it, loss=0.00691, lr=0.0001]
Steps:  19%|█▉        | 116/600 [08:24<24:02,  2.98s/it, loss=0.00646, lr=0.0001]
Steps:  20%|█▉        | 117/600 [08:26<23:43,  2.95s/it, loss=0.00646, lr=0.0001]
Steps:  20%|█▉        | 117/600 [08:26<23:43,  2.95s/it, loss=0.155, lr=0.0001]  
Steps:  20%|█▉        | 117/600 [08:27<23:43,  2.95s/it, loss=0.131, lr=0.0001]
Steps:  20%|█▉        | 118/600 [08:29<25:12,  3.14s/it, loss=0.131, lr=0.0001]
Steps:  20%|█▉        | 118/600 [08:29<25:12,  3.14s/it, loss=0.0987, lr=0.0001]
Steps:  20%|█▉        | 118/600 [08:31<25:12,  3.14s/it, loss=0.132, lr=0.0001] 
Steps:  20%|█▉        | 119/600 [08:32<24:07,  3.01s/it, loss=0.132, lr=0.0001]
Steps:  20%|█▉        | 119/600 [08:32<24:07,  3.01s/it, loss=0.0631, lr=0.0001]
Steps:  20%|██        | 120/600 [08:33<18:40,  2.33s/it, loss=0.0631, lr=0.0001]
Steps:  20%|██        | 120/600 [08:33<18:40,  2.33s/it, loss=0.0296, lr=0.0001]
Steps:  20%|██        | 120/600 [08:35<18:40,  2.33s/it, loss=0.0966, lr=0.0001]
Steps:  20%|██        | 121/600 [08:36<21:55,  2.75s/it, loss=0.0966, lr=0.0001]
Steps:  20%|██        | 121/600 [08:36<21:55,  2.75s/it, loss=0.0807, lr=0.0001]
Steps:  20%|██        | 121/600 [08:38<21:55,  2.75s/it, loss=0.259, lr=0.0001] 
Steps:  20%|██        | 122/600 [08:40<23:07,  2.90s/it, loss=0.259, lr=0.0001]
Steps:  20%|██        | 122/600 [08:40<23:07,  2.90s/it, loss=0.0107, lr=0.0001]
Steps:  20%|██        | 122/600 [08:41<23:07,  2.90s/it, loss=0.128, lr=0.0001] 
Steps:  20%|██        | 123/600 [08:43<24:08,  3.04s/it, loss=0.128, lr=0.0001]
Steps:  20%|██        | 123/600 [08:43<24:08,  3.04s/it, loss=0.0919, lr=0.0001]
Steps:  20%|██        | 123/600 [08:45<24:08,  3.04s/it, loss=0.169, lr=0.0001] 
Steps:  21%|██        | 124/600 [08:46<24:36,  3.10s/it, loss=0.169, lr=0.0001]
Steps:  21%|██        | 124/600 [08:46<24:36,  3.10s/it, loss=0.303, lr=0.0001]
Steps:  21%|██        | 124/600 [08:48<24:36,  3.10s/it, loss=0.0849, lr=0.0001]
Steps:  21%|██        | 125/600 [08:50<25:14,  3.19s/it, loss=0.0849, lr=0.0001]
Steps:  21%|██        | 125/600 [08:50<25:14,  3.19s/it, loss=0.0253, lr=0.0001]
Steps:  21%|██        | 126/600 [08:51<19:28,  2.47s/it, loss=0.0253, lr=0.0001]
Steps:  21%|██        | 126/600 [08:51<19:28,  2.47s/it, loss=0.0233, lr=0.0001]
Steps:  21%|██        | 126/600 [08:53<19:28,  2.47s/it, loss=0.0642, lr=0.0001]
Steps:  21%|██        | 127/600 [08:55<23:43,  3.01s/it, loss=0.0642, lr=0.0001]
Steps:  21%|██        | 127/600 [08:55<23:43,  3.01s/it, loss=0.133, lr=0.0001] 
Steps:  21%|██        | 127/600 [08:56<23:43,  3.01s/it, loss=0.0536, lr=0.0001]
Steps:  21%|██▏       | 128/600 [08:58<24:20,  3.09s/it, loss=0.0536, lr=0.0001]
Steps:  21%|██▏       | 128/600 [08:58<24:20,  3.09s/it, loss=0.0944, lr=0.0001]
Steps:  21%|██▏       | 128/600 [09:00<24:20,  3.09s/it, loss=0.0109, lr=0.0001]
Steps:  22%|██▏       | 129/600 [09:01<23:55,  3.05s/it, loss=0.0109, lr=0.0001]
Steps:  22%|██▏       | 129/600 [09:01<23:55,  3.05s/it, loss=0.0562, lr=0.0001]
Steps:  22%|██▏       | 129/600 [09:02<23:55,  3.05s/it, loss=0.0599, lr=0.0001]
Steps:  22%|██▏       | 130/600 [09:04<24:28,  3.13s/it, loss=0.0599, lr=0.0001]
Steps:  22%|██▏       | 130/600 [09:04<24:28,  3.13s/it, loss=0.0445, lr=0.0001]
Steps:  22%|██▏       | 130/600 [09:06<24:28,  3.13s/it, loss=0.137, lr=0.0001] 
Steps:  22%|██▏       | 131/600 [09:07<23:42,  3.03s/it, loss=0.137, lr=0.0001]
Steps:  22%|██▏       | 131/600 [09:07<23:42,  3.03s/it, loss=0.0679, lr=0.0001]
Steps:  22%|██▏       | 132/600 [09:08<18:20,  2.35s/it, loss=0.0679, lr=0.0001]
Steps:  22%|██▏       | 132/600 [09:08<18:20,  2.35s/it, loss=0.0106, lr=0.0001]
Steps:  22%|██▏       | 132/600 [09:10<18:20,  2.35s/it, loss=0.202, lr=0.0001] 
Steps:  22%|██▏       | 133/600 [09:12<21:53,  2.81s/it, loss=0.202, lr=0.0001]
Steps:  22%|██▏       | 133/600 [09:12<21:53,  2.81s/it, loss=0.0114, lr=0.0001]
Steps:  22%|██▏       | 133/600 [09:13<21:53,  2.81s/it, loss=0.142, lr=0.0001] 
Steps:  22%|██▏       | 134/600 [09:15<22:28,  2.89s/it, loss=0.142, lr=0.0001]
Steps:  22%|██▏       | 134/600 [09:15<22:28,  2.89s/it, loss=0.167, lr=0.0001]
Steps:  22%|██▏       | 134/600 [09:16<22:28,  2.89s/it, loss=0.125, lr=0.0001]
Steps:  22%|██▎       | 135/600 [09:18<23:12,  2.99s/it, loss=0.125, lr=0.0001]
Steps:  22%|██▎       | 135/600 [09:18<23:12,  2.99s/it, loss=0.273, lr=0.0001]
Steps:  22%|██▎       | 135/600 [09:20<23:12,  2.99s/it, loss=0.127, lr=0.0001]
Steps:  23%|██▎       | 136/600 [09:21<23:36,  3.05s/it, loss=0.127, lr=0.0001]
Steps:  23%|██▎       | 136/600 [09:21<23:36,  3.05s/it, loss=0.132, lr=0.0001]
Steps:  23%|██▎       | 136/600 [09:23<23:36,  3.05s/it, loss=0.199, lr=0.0001]
Steps:  23%|██▎       | 137/600 [09:24<23:48,  3.08s/it, loss=0.199, lr=0.0001]
Steps:  23%|██▎       | 137/600 [09:24<23:48,  3.08s/it, loss=0.189, lr=0.0001]
Steps:  23%|██▎       | 138/600 [09:25<18:25,  2.39s/it, loss=0.189, lr=0.0001]
Steps:  23%|██▎       | 138/600 [09:25<18:25,  2.39s/it, loss=0.0947, lr=0.0001]
Steps:  23%|██▎       | 138/600 [09:28<18:25,  2.39s/it, loss=0.16, lr=0.0001]  
Steps:  23%|██▎       | 139/600 [09:29<21:32,  2.80s/it, loss=0.16, lr=0.0001]
Steps:  23%|██▎       | 139/600 [09:29<21:32,  2.80s/it, loss=0.0801, lr=0.0001]
Steps:  23%|██▎       | 139/600 [09:31<21:32,  2.80s/it, loss=0.149, lr=0.0001] 
Steps:  23%|██▎       | 140/600 [09:32<22:35,  2.95s/it, loss=0.149, lr=0.0001]
Steps:  23%|██▎       | 140/600 [09:32<22:35,  2.95s/it, loss=0.141, lr=0.0001]
Steps:  23%|██▎       | 140/600 [09:34<22:35,  2.95s/it, loss=0.164, lr=0.0001]
Steps:  24%|██▎       | 141/600 [09:35<22:14,  2.91s/it, loss=0.164, lr=0.0001]
Steps:  24%|██▎       | 141/600 [09:35<22:14,  2.91s/it, loss=0.0141, lr=0.0001]
Steps:  24%|██▎       | 141/600 [09:37<22:14,  2.91s/it, loss=0.221, lr=0.0001] 
Steps:  24%|██▎       | 142/600 [09:39<23:26,  3.07s/it, loss=0.221, lr=0.0001]
Steps:  24%|██▎       | 142/600 [09:39<23:26,  3.07s/it, loss=0.0991, lr=0.0001]
Steps:  24%|██▎       | 142/600 [09:40<23:26,  3.07s/it, loss=0.0808, lr=0.0001]
Steps:  24%|██▍       | 143/600 [09:42<23:35,  3.10s/it, loss=0.0808, lr=0.0001]
Steps:  24%|██▍       | 143/600 [09:42<23:35,  3.10s/it, loss=0.0812, lr=0.0001]
Steps:  24%|██▍       | 144/600 [09:42<18:14,  2.40s/it, loss=0.0812, lr=0.0001]
Steps:  24%|██▍       | 144/600 [09:42<18:14,  2.40s/it, loss=0.35, lr=0.0001]  
Steps:  24%|██▍       | 144/600 [09:45<18:14,  2.40s/it, loss=0.03, lr=0.0001]
Steps:  24%|██▍       | 145/600 [09:47<22:42,  2.99s/it, loss=0.03, lr=0.0001]
Steps:  24%|██▍       | 145/600 [09:47<22:42,  2.99s/it, loss=0.143, lr=0.0001]
Steps:  24%|██▍       | 145/600 [09:49<22:42,  2.99s/it, loss=0.19, lr=0.0001] 
Steps:  24%|██▍       | 146/600 [09:50<23:19,  3.08s/it, loss=0.19, lr=0.0001]
Steps:  24%|██▍       | 146/600 [09:50<23:19,  3.08s/it, loss=0.187, lr=0.0001]
Steps:  24%|██▍       | 146/600 [09:51<23:19,  3.08s/it, loss=0.161, lr=0.0001]
Steps:  24%|██▍       | 147/600 [09:53<22:51,  3.03s/it, loss=0.161, lr=0.0001]
Steps:  24%|██▍       | 147/600 [09:53<22:51,  3.03s/it, loss=0.2, lr=0.0001]  
Steps:  24%|██▍       | 147/600 [09:54<22:51,  3.03s/it, loss=0.249, lr=0.0001]
Steps:  25%|██▍       | 148/600 [09:56<22:34,  3.00s/it, loss=0.249, lr=0.0001]
Steps:  25%|██▍       | 148/600 [09:56<22:34,  3.00s/it, loss=0.0318, lr=0.0001]
Steps:  25%|██▍       | 148/600 [09:58<22:34,  3.00s/it, loss=0.0207, lr=0.0001]
Steps:  25%|██▍       | 149/600 [09:59<22:22,  2.98s/it, loss=0.0207, lr=0.0001]
Steps:  25%|██▍       | 149/600 [09:59<22:22,  2.98s/it, loss=0.149, lr=0.0001] 
Steps:  25%|██▌       | 150/600 [10:00<17:22,  2.32s/it, loss=0.149, lr=0.0001]
Steps:  25%|██▌       | 150/600 [10:00<17:22,  2.32s/it, loss=0.0133, lr=0.0001]
Steps:  25%|██▌       | 150/600 [10:02<17:22,  2.32s/it, loss=0.196, lr=0.0001] 
Steps:  25%|██▌       | 151/600 [10:04<20:57,  2.80s/it, loss=0.196, lr=0.0001]
Steps:  25%|██▌       | 151/600 [10:04<20:57,  2.80s/it, loss=0.0144, lr=0.0001]
Steps:  25%|██▌       | 151/600 [10:05<20:57,  2.80s/it, loss=0.218, lr=0.0001] 
Steps:  25%|██▌       | 152/600 [10:07<22:33,  3.02s/it, loss=0.218, lr=0.0001]
Steps:  25%|██▌       | 152/600 [10:07<22:33,  3.02s/it, loss=0.315, lr=0.0001]
Steps:  25%|██▌       | 152/600 [10:09<22:33,  3.02s/it, loss=0.0255, lr=0.0001]
Steps:  26%|██▌       | 153/600 [10:10<22:04,  2.96s/it, loss=0.0255, lr=0.0001]
Steps:  26%|██▌       | 153/600 [10:10<22:04,  2.96s/it, loss=0.0647, lr=0.0001]
Steps:  26%|██▌       | 153/600 [10:12<22:04,  2.96s/it, loss=0.163, lr=0.0001] 
Steps:  26%|██▌       | 154/600 [10:13<22:29,  3.03s/it, loss=0.163, lr=0.0001]
Steps:  26%|██▌       | 154/600 [10:13<22:29,  3.03s/it, loss=0.14, lr=0.0001] 
Steps:  26%|██▌       | 154/600 [10:15<22:29,  3.03s/it, loss=0.132, lr=0.0001]
Steps:  26%|██▌       | 155/600 [10:16<22:23,  3.02s/it, loss=0.132, lr=0.0001]
Steps:  26%|██▌       | 155/600 [10:16<22:23,  3.02s/it, loss=0.176, lr=0.0001]
Steps:  26%|██▌       | 156/600 [10:17<17:20,  2.34s/it, loss=0.176, lr=0.0001]
Steps:  26%|██▌       | 156/600 [10:17<17:20,  2.34s/it, loss=0.131, lr=0.0001]
Steps:  26%|██▌       | 156/600 [10:19<17:20,  2.34s/it, loss=0.0265, lr=0.0001]
Steps:  26%|██▌       | 157/600 [10:21<20:43,  2.81s/it, loss=0.0265, lr=0.0001]
Steps:  26%|██▌       | 157/600 [10:21<20:43,  2.81s/it, loss=0.204, lr=0.0001] 
Steps:  26%|██▌       | 157/600 [10:23<20:43,  2.81s/it, loss=0.0259, lr=0.0001]
Steps:  26%|██▋       | 158/600 [10:24<21:59,  2.99s/it, loss=0.0259, lr=0.0001]
Steps:  26%|██▋       | 158/600 [10:24<21:59,  2.99s/it, loss=0.0266, lr=0.0001]
Steps:  26%|██▋       | 158/600 [10:26<21:59,  2.99s/it, loss=0.189, lr=0.0001] 
Steps:  26%|██▋       | 159/600 [10:27<21:28,  2.92s/it, loss=0.189, lr=0.0001]
Steps:  26%|██▋       | 159/600 [10:27<21:28,  2.92s/it, loss=0.022, lr=0.0001]
Steps:  26%|██▋       | 159/600 [10:29<21:28,  2.92s/it, loss=0.0579, lr=0.0001]
Steps:  27%|██▋       | 160/600 [10:30<22:33,  3.08s/it, loss=0.0579, lr=0.0001]
Steps:  27%|██▋       | 160/600 [10:30<22:33,  3.08s/it, loss=0.141, lr=0.0001] 
Steps:  27%|██▋       | 160/600 [10:32<22:33,  3.08s/it, loss=0.00925, lr=0.0001]
Steps:  27%|██▋       | 161/600 [10:34<22:42,  3.10s/it, loss=0.00925, lr=0.0001]
Steps:  27%|██▋       | 161/600 [10:34<22:42,  3.10s/it, loss=0.191, lr=0.0001]  
Steps:  27%|██▋       | 162/600 [10:34<17:31,  2.40s/it, loss=0.191, lr=0.0001]
Steps:  27%|██▋       | 162/600 [10:34<17:31,  2.40s/it, loss=0.318, lr=0.0001]
Steps:  27%|██▋       | 162/600 [10:37<17:31,  2.40s/it, loss=0.0161, lr=0.0001]
Steps:  27%|██▋       | 163/600 [10:38<20:57,  2.88s/it, loss=0.0161, lr=0.0001]
Steps:  27%|██▋       | 163/600 [10:38<20:57,  2.88s/it, loss=0.232, lr=0.0001] 
Steps:  27%|██▋       | 163/600 [10:40<20:57,  2.88s/it, loss=0.0162, lr=0.0001]
Steps:  27%|██▋       | 164/600 [10:42<22:13,  3.06s/it, loss=0.0162, lr=0.0001]
Steps:  27%|██▋       | 164/600 [10:42<22:13,  3.06s/it, loss=0.282, lr=0.0001] 
Steps:  27%|██▋       | 164/600 [10:43<22:13,  3.06s/it, loss=0.235, lr=0.0001]
Steps:  28%|██▊       | 165/600 [10:45<21:31,  2.97s/it, loss=0.235, lr=0.0001]
Steps:  28%|██▊       | 165/600 [10:45<21:31,  2.97s/it, loss=0.162, lr=0.0001]
Steps:  28%|██▊       | 165/600 [10:46<21:31,  2.97s/it, loss=0.217, lr=0.0001]
Steps:  28%|██▊       | 166/600 [10:48<22:48,  3.15s/it, loss=0.217, lr=0.0001]
Steps:  28%|██▊       | 166/600 [10:48<22:48,  3.15s/it, loss=0.216, lr=0.0001]
Steps:  28%|██▊       | 166/600 [10:50<22:48,  3.15s/it, loss=0.00354, lr=0.0001]
Steps:  28%|██▊       | 167/600 [10:51<21:57,  3.04s/it, loss=0.00354, lr=0.0001]
Steps:  28%|██▊       | 167/600 [10:51<21:57,  3.04s/it, loss=0.135, lr=0.0001]  
Steps:  28%|██▊       | 168/600 [10:52<17:00,  2.36s/it, loss=0.135, lr=0.0001]
Steps:  28%|██▊       | 168/600 [10:52<17:00,  2.36s/it, loss=0.29, lr=0.0001] 
Steps:  28%|██▊       | 168/600 [10:54<17:00,  2.36s/it, loss=0.211, lr=0.0001]
Steps:  28%|██▊       | 169/600 [10:55<19:57,  2.78s/it, loss=0.211, lr=0.0001]
Steps:  28%|██▊       | 169/600 [10:55<19:57,  2.78s/it, loss=0.16, lr=0.0001] 
Steps:  28%|██▊       | 169/600 [10:57<19:57,  2.78s/it, loss=0.102, lr=0.0001]
Steps:  28%|██▊       | 170/600 [10:59<20:52,  2.91s/it, loss=0.102, lr=0.0001]
Steps:  28%|██▊       | 170/600 [10:59<20:52,  2.91s/it, loss=0.0252, lr=0.0001]
Steps:  28%|██▊       | 170/600 [11:00<20:52,  2.91s/it, loss=0.162, lr=0.0001] 
Steps:  28%|██▊       | 171/600 [11:02<21:57,  3.07s/it, loss=0.162, lr=0.0001]
Steps:  28%|██▊       | 171/600 [11:02<21:57,  3.07s/it, loss=0.0715, lr=0.0001]
Steps:  28%|██▊       | 171/600 [11:04<21:57,  3.07s/it, loss=0.0117, lr=0.0001]
Steps:  29%|██▊       | 172/600 [11:05<22:23,  3.14s/it, loss=0.0117, lr=0.0001]
Steps:  29%|██▊       | 172/600 [11:05<22:23,  3.14s/it, loss=0.298, lr=0.0001] 
Steps:  29%|██▊       | 172/600 [11:07<22:23,  3.14s/it, loss=0.0478, lr=0.0001]
Steps:  29%|██▉       | 173/600 [11:08<21:33,  3.03s/it, loss=0.0478, lr=0.0001]
Steps:  29%|██▉       | 173/600 [11:08<21:33,  3.03s/it, loss=0.0442, lr=0.0001]
Steps:  29%|██▉       | 174/600 [11:09<16:42,  2.35s/it, loss=0.0442, lr=0.0001]
Steps:  29%|██▉       | 174/600 [11:09<16:42,  2.35s/it, loss=0.042, lr=0.0001] 
Steps:  29%|██▉       | 174/600 [11:11<16:42,  2.35s/it, loss=0.0123, lr=0.0001]
Steps:  29%|██▉       | 175/600 [11:13<20:18,  2.87s/it, loss=0.0123, lr=0.0001]
Steps:  29%|██▉       | 175/600 [11:13<20:18,  2.87s/it, loss=0.229, lr=0.0001] 
Steps:  29%|██▉       | 175/600 [11:14<20:18,  2.87s/it, loss=0.145, lr=0.0001]
Steps:  29%|██▉       | 176/600 [11:16<20:57,  2.97s/it, loss=0.145, lr=0.0001]
Steps:  29%|██▉       | 176/600 [11:16<20:57,  2.97s/it, loss=0.141, lr=0.0001]
Steps:  29%|██▉       | 176/600 [11:18<20:57,  2.97s/it, loss=0.229, lr=0.0001]
Steps:  30%|██▉       | 177/600 [11:20<21:56,  3.11s/it, loss=0.229, lr=0.0001]
Steps:  30%|██▉       | 177/600 [11:20<21:56,  3.11s/it, loss=0.229, lr=0.0001]
Steps:  30%|██▉       | 177/600 [11:21<21:56,  3.11s/it, loss=0.0892, lr=0.0001]
Steps:  30%|██▉       | 178/600 [11:23<21:46,  3.10s/it, loss=0.0892, lr=0.0001]
Steps:  30%|██▉       | 178/600 [11:23<21:46,  3.10s/it, loss=0.118, lr=0.0001] 
Steps:  30%|██▉       | 178/600 [11:24<21:46,  3.10s/it, loss=0.126, lr=0.0001]
Steps:  30%|██▉       | 179/600 [11:25<20:58,  2.99s/it, loss=0.126, lr=0.0001]
Steps:  30%|██▉       | 179/600 [11:25<20:58,  2.99s/it, loss=0.0288, lr=0.0001]
Steps:  30%|███       | 180/600 [11:26<16:16,  2.33s/it, loss=0.0288, lr=0.0001]
Steps:  30%|███       | 180/600 [11:26<16:16,  2.33s/it, loss=0.165, lr=0.0001] 
Steps:  30%|███       | 180/600 [11:28<16:16,  2.33s/it, loss=0.0204, lr=0.0001]
Steps:  30%|███       | 181/600 [11:30<19:33,  2.80s/it, loss=0.0204, lr=0.0001]
Steps:  30%|███       | 181/600 [11:30<19:33,  2.80s/it, loss=0.00333, lr=0.0001]
Steps:  30%|███       | 181/600 [11:32<19:33,  2.80s/it, loss=0.138, lr=0.0001]  
Steps:  30%|███       | 182/600 [11:34<21:11,  3.04s/it, loss=0.138, lr=0.0001]
Steps:  30%|███       | 182/600 [11:34<21:11,  3.04s/it, loss=0.19, lr=0.0001] 
Steps:  30%|███       | 182/600 [11:35<21:11,  3.04s/it, loss=0.129, lr=0.0001]
Steps:  30%|███       | 183/600 [11:37<21:45,  3.13s/it, loss=0.129, lr=0.0001]
Steps:  30%|███       | 183/600 [11:37<21:45,  3.13s/it, loss=0.0125, lr=0.0001]
Steps:  30%|███       | 183/600 [11:39<21:45,  3.13s/it, loss=0.0948, lr=0.0001]
Steps:  31%|███       | 184/600 [11:40<21:13,  3.06s/it, loss=0.0948, lr=0.0001]
Steps:  31%|███       | 184/600 [11:40<21:13,  3.06s/it, loss=0.156, lr=0.0001] 
Steps:  31%|███       | 184/600 [11:42<21:13,  3.06s/it, loss=0.124, lr=0.0001]
Steps:  31%|███       | 185/600 [11:43<20:32,  2.97s/it, loss=0.124, lr=0.0001]
Steps:  31%|███       | 185/600 [11:43<20:32,  2.97s/it, loss=0.151, lr=0.0001]
Steps:  31%|███       | 186/600 [11:44<15:56,  2.31s/it, loss=0.151, lr=0.0001]
Steps:  31%|███       | 186/600 [11:44<15:56,  2.31s/it, loss=0.193, lr=0.0001]
Steps:  31%|███       | 186/600 [11:46<15:56,  2.31s/it, loss=0.0457, lr=0.0001]
Steps:  31%|███       | 187/600 [11:47<18:40,  2.71s/it, loss=0.0457, lr=0.0001]
Steps:  31%|███       | 187/600 [11:47<18:40,  2.71s/it, loss=0.134, lr=0.0001] 
Steps:  31%|███       | 187/600 [11:49<18:40,  2.71s/it, loss=0.0621, lr=0.0001]
Steps:  31%|███▏      | 188/600 [11:50<19:43,  2.87s/it, loss=0.0621, lr=0.0001]
Steps:  31%|███▏      | 188/600 [11:50<19:43,  2.87s/it, loss=0.162, lr=0.0001] 
Steps:  31%|███▏      | 188/600 [11:52<19:43,  2.87s/it, loss=0.00654, lr=0.0001]
Steps:  32%|███▏      | 189/600 [11:54<20:04,  2.93s/it, loss=0.00654, lr=0.0001]
Steps:  32%|███▏      | 189/600 [11:54<20:04,  2.93s/it, loss=0.085, lr=0.0001]  
Steps:  32%|███▏      | 189/600 [11:55<20:04,  2.93s/it, loss=0.188, lr=0.0001]
Steps:  32%|███▏      | 190/600 [11:57<21:11,  3.10s/it, loss=0.188, lr=0.0001]
Steps:  32%|███▏      | 190/600 [11:57<21:11,  3.10s/it, loss=0.123, lr=0.0001]
Steps:  32%|███▏      | 190/600 [11:58<21:11,  3.10s/it, loss=0.27, lr=0.0001] 
Steps:  32%|███▏      | 191/600 [12:00<20:54,  3.07s/it, loss=0.27, lr=0.0001]
Steps:  32%|███▏      | 191/600 [12:00<20:54,  3.07s/it, loss=0.019, lr=0.0001]
Steps:  32%|███▏      | 192/600 [12:01<16:09,  2.38s/it, loss=0.019, lr=0.0001]
Steps:  32%|███▏      | 192/600 [12:01<16:09,  2.38s/it, loss=0.0672, lr=0.0001]
Steps:  32%|███▏      | 192/600 [12:03<16:09,  2.38s/it, loss=0.00335, lr=0.0001]
Steps:  32%|███▏      | 193/600 [12:05<19:30,  2.88s/it, loss=0.00335, lr=0.0001]
Steps:  32%|███▏      | 193/600 [12:05<19:30,  2.88s/it, loss=0.145, lr=0.0001]  
Steps:  32%|███▏      | 193/600 [12:06<19:30,  2.88s/it, loss=0.0918, lr=0.0001]
Steps:  32%|███▏      | 194/600 [12:08<20:39,  3.05s/it, loss=0.0918, lr=0.0001]
Steps:  32%|███▏      | 194/600 [12:08<20:39,  3.05s/it, loss=0.137, lr=0.0001] 
Steps:  32%|███▏      | 194/600 [12:10<20:39,  3.05s/it, loss=0.268, lr=0.0001]
Steps:  32%|███▎      | 195/600 [12:11<20:28,  3.03s/it, loss=0.268, lr=0.0001]
Steps:  32%|███▎      | 195/600 [12:11<20:28,  3.03s/it, loss=0.154, lr=0.0001]
Steps:  32%|███▎      | 195/600 [12:13<20:28,  3.03s/it, loss=0.17, lr=0.0001] 
Steps:  33%|███▎      | 196/600 [12:14<20:38,  3.07s/it, loss=0.17, lr=0.0001]
Steps:  33%|███▎      | 196/600 [12:14<20:38,  3.07s/it, loss=0.0742, lr=0.0001]
Steps:  33%|███▎      | 196/600 [12:16<20:38,  3.07s/it, loss=0.0355, lr=0.0001]
Steps:  33%|███▎      | 197/600 [12:17<20:19,  3.03s/it, loss=0.0355, lr=0.0001]
Steps:  33%|███▎      | 197/600 [12:17<20:19,  3.03s/it, loss=0.113, lr=0.0001] 
Steps:  33%|███▎      | 198/600 [12:18<15:43,  2.35s/it, loss=0.113, lr=0.0001]
Steps:  33%|███▎      | 198/600 [12:18<15:43,  2.35s/it, loss=0.0121, lr=0.0001]
Steps:  33%|███▎      | 198/600 [12:20<15:43,  2.35s/it, loss=0.132, lr=0.0001] 
Steps:  33%|███▎      | 199/600 [12:21<17:39,  2.64s/it, loss=0.132, lr=0.0001]
Steps:  33%|███▎      | 199/600 [12:21<17:39,  2.64s/it, loss=0.0526, lr=0.0001]
Steps:  33%|███▎      | 199/600 [12:23<17:39,  2.64s/it, loss=0.0236, lr=0.0001]
Steps:  33%|███▎      | 200/600 [12:25<19:18,  2.90s/it, loss=0.0236, lr=0.0001]
Steps:  33%|███▎      | 200/600 [12:25<19:18,  2.90s/it, loss=0.0539, lr=0.0001]
Steps:  33%|███▎      | 200/600 [12:27<19:18,  2.90s/it, loss=0.0459, lr=0.0001]
Steps:  34%|███▎      | 201/600 [12:29<20:44,  3.12s/it, loss=0.0459, lr=0.0001]
Steps:  34%|███▎      | 201/600 [12:29<20:44,  3.12s/it, loss=0.159, lr=0.0001] 
Steps:  34%|███▎      | 201/600 [12:30<20:44,  3.12s/it, loss=0.0925, lr=0.0001]
Steps:  34%|███▎      | 202/600 [12:32<20:25,  3.08s/it, loss=0.0925, lr=0.0001]
Steps:  34%|███▎      | 202/600 [12:32<20:25,  3.08s/it, loss=0.132, lr=0.0001] 
Steps:  34%|███▎      | 202/600 [12:33<20:25,  3.08s/it, loss=0.00794, lr=0.0001]
Steps:  34%|███▍      | 203/600 [12:35<20:14,  3.06s/it, loss=0.00794, lr=0.0001]
Steps:  34%|███▍      | 203/600 [12:35<20:14,  3.06s/it, loss=0.0301, lr=0.0001] 
Steps:  34%|███▍      | 204/600 [12:35<15:40,  2.37s/it, loss=0.0301, lr=0.0001]
Steps:  34%|███▍      | 204/600 [12:35<15:40,  2.37s/it, loss=0.026, lr=0.0001] 
Steps:  34%|███▍      | 204/600 [12:38<15:40,  2.37s/it, loss=0.103, lr=0.0001]
Steps:  34%|███▍      | 205/600 [12:39<19:00,  2.89s/it, loss=0.103, lr=0.0001]
Steps:  34%|███▍      | 205/600 [12:39<19:00,  2.89s/it, loss=0.106, lr=0.0001]
Steps:  34%|███▍      | 205/600 [12:41<19:00,  2.89s/it, loss=0.15, lr=0.0001] 
Steps:  34%|███▍      | 206/600 [12:42<19:04,  2.91s/it, loss=0.15, lr=0.0001]
Steps:  34%|███▍      | 206/600 [12:42<19:04,  2.91s/it, loss=0.127, lr=0.0001]
Steps:  34%|███▍      | 206/600 [12:44<19:04,  2.91s/it, loss=0.242, lr=0.0001]
Steps:  34%|███▍      | 207/600 [12:46<19:51,  3.03s/it, loss=0.242, lr=0.0001]
Steps:  34%|███▍      | 207/600 [12:46<19:51,  3.03s/it, loss=0.109, lr=0.0001]
Steps:  34%|███▍      | 207/600 [12:47<19:51,  3.03s/it, loss=0.0219, lr=0.0001]
Steps:  35%|███▍      | 208/600 [12:49<20:08,  3.08s/it, loss=0.0219, lr=0.0001]
Steps:  35%|███▍      | 208/600 [12:49<20:08,  3.08s/it, loss=0.245, lr=0.0001] 
Steps:  35%|███▍      | 208/600 [12:51<20:08,  3.08s/it, loss=0.0918, lr=0.0001]
Steps:  35%|███▍      | 209/600 [12:52<19:43,  3.03s/it, loss=0.0918, lr=0.0001]
Steps:  35%|███▍      | 209/600 [12:52<19:43,  3.03s/it, loss=0.0229, lr=0.0001]
Steps:  35%|███▌      | 210/600 [12:53<15:15,  2.35s/it, loss=0.0229, lr=0.0001]
Steps:  35%|███▌      | 210/600 [12:53<15:15,  2.35s/it, loss=0.228, lr=0.0001] 
Steps:  35%|███▌      | 210/600 [12:55<15:15,  2.35s/it, loss=0.00933, lr=0.0001]
Steps:  35%|███▌      | 211/600 [12:57<18:29,  2.85s/it, loss=0.00933, lr=0.0001]
Steps:  35%|███▌      | 211/600 [12:57<18:29,  2.85s/it, loss=0.0826, lr=0.0001] 
Steps:  35%|███▌      | 211/600 [12:58<18:29,  2.85s/it, loss=0.128, lr=0.0001] 
Steps:  35%|███▌      | 212/600 [13:00<19:00,  2.94s/it, loss=0.128, lr=0.0001]
Steps:  35%|███▌      | 212/600 [13:00<19:00,  2.94s/it, loss=0.0218, lr=0.0001]
Steps:  35%|███▌      | 212/600 [13:01<19:00,  2.94s/it, loss=0.258, lr=0.0001] 
Steps:  36%|███▌      | 213/600 [13:03<19:13,  2.98s/it, loss=0.258, lr=0.0001]
Steps:  36%|███▌      | 213/600 [13:03<19:13,  2.98s/it, loss=0.181, lr=0.0001]
Steps:  36%|███▌      | 213/600 [13:04<19:13,  2.98s/it, loss=0.0263, lr=0.0001]
Steps:  36%|███▌      | 214/600 [13:06<19:31,  3.03s/it, loss=0.0263, lr=0.0001]
Steps:  36%|███▌      | 214/600 [13:06<19:31,  3.03s/it, loss=0.0495, lr=0.0001]
Steps:  36%|███▌      | 214/600 [13:07<19:31,  3.03s/it, loss=0.139, lr=0.0001] 
Steps:  36%|███▌      | 215/600 [13:09<19:19,  3.01s/it, loss=0.139, lr=0.0001]
Steps:  36%|███▌      | 215/600 [13:09<19:19,  3.01s/it, loss=0.269, lr=0.0001]
Steps:  36%|███▌      | 216/600 [13:10<14:56,  2.33s/it, loss=0.269, lr=0.0001]
Steps:  36%|███▌      | 216/600 [13:10<14:56,  2.33s/it, loss=0.211, lr=0.0001]
Steps:  36%|███▌      | 216/600 [13:12<14:56,  2.33s/it, loss=0.00261, lr=0.0001]
Steps:  36%|███▌      | 217/600 [13:14<17:47,  2.79s/it, loss=0.00261, lr=0.0001]
Steps:  36%|███▌      | 217/600 [13:14<17:47,  2.79s/it, loss=0.0638, lr=0.0001] 
Steps:  36%|███▌      | 217/600 [13:15<17:47,  2.79s/it, loss=0.0368, lr=0.0001]
Steps:  36%|███▋      | 218/600 [13:17<18:25,  2.89s/it, loss=0.0368, lr=0.0001]
Steps:  36%|███▋      | 218/600 [13:17<18:25,  2.89s/it, loss=0.071, lr=0.0001] 
Steps:  36%|███▋      | 218/600 [13:18<18:25,  2.89s/it, loss=0.0395, lr=0.0001]
Steps:  36%|███▋      | 219/600 [13:20<19:11,  3.02s/it, loss=0.0395, lr=0.0001]
Steps:  36%|███▋      | 219/600 [13:20<19:11,  3.02s/it, loss=0.152, lr=0.0001] 
Steps:  36%|███▋      | 219/600 [13:22<19:11,  3.02s/it, loss=0.067, lr=0.0001]
Steps:  37%|███▋      | 220/600 [13:23<19:22,  3.06s/it, loss=0.067, lr=0.0001]
Steps:  37%|███▋      | 220/600 [13:23<19:22,  3.06s/it, loss=0.193, lr=0.0001]
Steps:  37%|███▋      | 220/600 [13:25<19:22,  3.06s/it, loss=0.224, lr=0.0001]
Steps:  37%|███▋      | 221/600 [13:26<19:08,  3.03s/it, loss=0.224, lr=0.0001]
Steps:  37%|███▋      | 221/600 [13:26<19:08,  3.03s/it, loss=0.195, lr=0.0001]
Steps:  37%|███▋      | 222/600 [13:27<14:48,  2.35s/it, loss=0.195, lr=0.0001]
Steps:  37%|███▋      | 222/600 [13:27<14:48,  2.35s/it, loss=0.00994, lr=0.0001]
Steps:  37%|███▋      | 222/600 [13:29<14:48,  2.35s/it, loss=0.0716, lr=0.0001] 
Steps:  37%|███▋      | 223/600 [13:31<17:21,  2.76s/it, loss=0.0716, lr=0.0001]
Steps:  37%|███▋      | 223/600 [13:31<17:21,  2.76s/it, loss=0.245, lr=0.0001] 
Steps:  37%|███▋      | 223/600 [13:32<17:21,  2.76s/it, loss=0.132, lr=0.0001]
Steps:  37%|███▋      | 224/600 [13:34<18:14,  2.91s/it, loss=0.132, lr=0.0001]
Steps:  37%|███▋      | 224/600 [13:34<18:14,  2.91s/it, loss=0.133, lr=0.0001]
Steps:  37%|███▋      | 224/600 [13:35<18:14,  2.91s/it, loss=0.203, lr=0.0001]
Steps:  38%|███▊      | 225/600 [13:37<19:01,  3.04s/it, loss=0.203, lr=0.0001]
Steps:  38%|███▊      | 225/600 [13:37<19:01,  3.04s/it, loss=0.0219, lr=0.0001]
Steps:  38%|███▊      | 225/600 [13:39<19:01,  3.04s/it, loss=0.00653, lr=0.0001]
Steps:  38%|███▊      | 226/600 [13:40<18:54,  3.03s/it, loss=0.00653, lr=0.0001]
Steps:  38%|███▊      | 226/600 [13:40<18:54,  3.03s/it, loss=0.101, lr=0.0001]  
Steps:  38%|███▊      | 226/600 [13:42<18:54,  3.03s/it, loss=0.0888, lr=0.0001]
Steps:  38%|███▊      | 227/600 [13:43<18:51,  3.03s/it, loss=0.0888, lr=0.0001]
Steps:  38%|███▊      | 227/600 [13:43<18:51,  3.03s/it, loss=0.163, lr=0.0001] 
Steps:  38%|███▊      | 228/600 [13:44<14:34,  2.35s/it, loss=0.163, lr=0.0001]
Steps:  38%|███▊      | 228/600 [13:44<14:34,  2.35s/it, loss=0.0398, lr=0.0001]
Steps:  38%|███▊      | 228/600 [13:46<14:34,  2.35s/it, loss=0.0412, lr=0.0001]
Steps:  38%|███▊      | 229/600 [13:48<17:22,  2.81s/it, loss=0.0412, lr=0.0001]
Steps:  38%|███▊      | 229/600 [13:48<17:22,  2.81s/it, loss=0.0141, lr=0.0001]
Steps:  38%|███▊      | 229/600 [13:50<17:22,  2.81s/it, loss=0.0729, lr=0.0001]
Steps:  38%|███▊      | 230/600 [13:51<17:41,  2.87s/it, loss=0.0729, lr=0.0001]
Steps:  38%|███▊      | 230/600 [13:51<17:41,  2.87s/it, loss=0.31, lr=0.0001]  
Steps:  38%|███▊      | 230/600 [13:53<17:41,  2.87s/it, loss=0.15, lr=0.0001]
Steps:  38%|███▊      | 231/600 [13:54<18:34,  3.02s/it, loss=0.15, lr=0.0001]
Steps:  38%|███▊      | 231/600 [13:54<18:34,  3.02s/it, loss=0.178, lr=0.0001]
Steps:  38%|███▊      | 231/600 [13:56<18:34,  3.02s/it, loss=0.128, lr=0.0001]
Steps:  39%|███▊      | 232/600 [13:58<19:02,  3.10s/it, loss=0.128, lr=0.0001]
Steps:  39%|███▊      | 232/600 [13:58<19:02,  3.10s/it, loss=0.0297, lr=0.0001]
Steps:  39%|███▊      | 232/600 [13:59<19:02,  3.10s/it, loss=0.214, lr=0.0001] 
Steps:  39%|███▉      | 233/600 [14:01<18:42,  3.06s/it, loss=0.214, lr=0.0001]
Steps:  39%|███▉      | 233/600 [14:01<18:42,  3.06s/it, loss=0.0208, lr=0.0001]
Steps:  39%|███▉      | 234/600 [14:01<14:27,  2.37s/it, loss=0.0208, lr=0.0001]
Steps:  39%|███▉      | 234/600 [14:01<14:27,  2.37s/it, loss=0.251, lr=0.0001] 
Steps:  39%|███▉      | 234/600 [14:03<14:27,  2.37s/it, loss=0.114, lr=0.0001]
Steps:  39%|███▉      | 235/600 [14:05<17:21,  2.85s/it, loss=0.114, lr=0.0001]
Steps:  39%|███▉      | 235/600 [14:05<17:21,  2.85s/it, loss=0.17, lr=0.0001] 
Steps:  39%|███▉      | 235/600 [14:07<17:21,  2.85s/it, loss=0.117, lr=0.0001]
Steps:  39%|███▉      | 236/600 [14:08<17:50,  2.94s/it, loss=0.117, lr=0.0001]
Steps:  39%|███▉      | 236/600 [14:08<17:50,  2.94s/it, loss=0.047, lr=0.0001]
Steps:  39%|███▉      | 236/600 [14:10<17:50,  2.94s/it, loss=0.0206, lr=0.0001]
Steps:  40%|███▉      | 237/600 [14:12<18:32,  3.06s/it, loss=0.0206, lr=0.0001]
Steps:  40%|███▉      | 237/600 [14:12<18:32,  3.06s/it, loss=0.13, lr=0.0001]  
Steps:  40%|███▉      | 237/600 [14:13<18:32,  3.06s/it, loss=0.04, lr=0.0001]
Steps:  40%|███▉      | 238/600 [14:15<18:43,  3.10s/it, loss=0.04, lr=0.0001]
Steps:  40%|███▉      | 238/600 [14:15<18:43,  3.10s/it, loss=0.0817, lr=0.0001]
Steps:  40%|███▉      | 238/600 [14:16<18:43,  3.10s/it, loss=0.0492, lr=0.0001]
Steps:  40%|███▉      | 239/600 [14:18<18:02,  3.00s/it, loss=0.0492, lr=0.0001]
Steps:  40%|███▉      | 239/600 [14:18<18:02,  3.00s/it, loss=0.028, lr=0.0001] 
Steps:  40%|████      | 240/600 [14:18<13:58,  2.33s/it, loss=0.028, lr=0.0001]
Steps:  40%|████      | 240/600 [14:18<13:58,  2.33s/it, loss=0.0307, lr=0.0001]
Steps:  40%|████      | 240/600 [14:21<13:58,  2.33s/it, loss=0.159, lr=0.0001] 
Steps:  40%|████      | 241/600 [14:23<17:01,  2.85s/it, loss=0.159, lr=0.0001]
Steps:  40%|████      | 241/600 [14:23<17:01,  2.85s/it, loss=0.0396, lr=0.0001]
Steps:  40%|████      | 241/600 [14:24<17:01,  2.85s/it, loss=0.152, lr=0.0001] 
Steps:  40%|████      | 242/600 [14:26<17:14,  2.89s/it, loss=0.152, lr=0.0001]
Steps:  40%|████      | 242/600 [14:26<17:14,  2.89s/it, loss=0.0925, lr=0.0001]
Steps:  40%|████      | 242/600 [14:27<17:14,  2.89s/it, loss=0.011, lr=0.0001] 
Steps:  40%|████      | 243/600 [14:29<17:38,  2.97s/it, loss=0.011, lr=0.0001]
Steps:  40%|████      | 243/600 [14:29<17:38,  2.97s/it, loss=0.155, lr=0.0001]
Steps:  40%|████      | 243/600 [14:30<17:38,  2.97s/it, loss=0.0708, lr=0.0001]
Steps:  41%|████      | 244/600 [14:32<18:07,  3.06s/it, loss=0.0708, lr=0.0001]
Steps:  41%|████      | 244/600 [14:32<18:07,  3.06s/it, loss=0.0444, lr=0.0001]
Steps:  41%|████      | 244/600 [14:34<18:07,  3.06s/it, loss=0.0949, lr=0.0001]
Steps:  41%|████      | 245/600 [14:35<18:00,  3.04s/it, loss=0.0949, lr=0.0001]
Steps:  41%|████      | 245/600 [14:35<18:00,  3.04s/it, loss=0.00901, lr=0.0001]
Steps:  41%|████      | 246/600 [14:36<13:55,  2.36s/it, loss=0.00901, lr=0.0001]
Steps:  41%|████      | 246/600 [14:36<13:55,  2.36s/it, loss=0.248, lr=0.0001]  
Steps:  41%|████      | 246/600 [14:38<13:55,  2.36s/it, loss=0.0154, lr=0.0001]
Steps:  41%|████      | 247/600 [14:40<16:49,  2.86s/it, loss=0.0154, lr=0.0001]
Steps:  41%|████      | 247/600 [14:40<16:49,  2.86s/it, loss=0.098, lr=0.0001] 
Steps:  41%|████      | 247/600 [14:41<16:49,  2.86s/it, loss=0.0533, lr=0.0001]
Steps:  41%|████▏     | 248/600 [14:43<17:00,  2.90s/it, loss=0.0533, lr=0.0001]
Steps:  41%|████▏     | 248/600 [14:43<17:00,  2.90s/it, loss=0.165, lr=0.0001] 
Steps:  41%|████▏     | 248/600 [14:44<17:00,  2.90s/it, loss=0.136, lr=0.0001]
Steps:  42%|████▏     | 249/600 [14:46<17:16,  2.95s/it, loss=0.136, lr=0.0001]
Steps:  42%|████▏     | 249/600 [14:46<17:16,  2.95s/it, loss=0.12, lr=0.0001] 
Steps:  42%|████▏     | 249/600 [14:48<17:16,  2.95s/it, loss=0.098, lr=0.0001]
Steps:  42%|████▏     | 250/600 [14:49<17:22,  2.98s/it, loss=0.098, lr=0.0001]
Steps:  42%|████▏     | 250/600 [14:49<17:22,  2.98s/it, loss=0.176, lr=0.0001]
Steps:  42%|████▏     | 250/600 [14:51<17:22,  2.98s/it, loss=0.00723, lr=0.0001]
Steps:  42%|████▏     | 251/600 [14:52<17:53,  3.08s/it, loss=0.00723, lr=0.0001]
Steps:  42%|████▏     | 251/600 [14:52<17:53,  3.08s/it, loss=0.138, lr=0.0001]  
Steps:  42%|████▏     | 252/600 [14:53<13:48,  2.38s/it, loss=0.138, lr=0.0001]
Steps:  42%|████▏     | 252/600 [14:53<13:48,  2.38s/it, loss=0.00315, lr=0.0001]
Steps:  42%|████▏     | 252/600 [14:55<13:48,  2.38s/it, loss=0.031, lr=0.0001]  
Steps:  42%|████▏     | 253/600 [14:57<16:43,  2.89s/it, loss=0.031, lr=0.0001]
Steps:  42%|████▏     | 253/600 [14:57<16:43,  2.89s/it, loss=0.142, lr=0.0001]
Steps:  42%|████▏     | 253/600 [14:58<16:43,  2.89s/it, loss=0.0148, lr=0.0001]
Steps:  42%|████▏     | 254/600 [15:00<16:36,  2.88s/it, loss=0.0148, lr=0.0001]
Steps:  42%|████▏     | 254/600 [15:00<16:36,  2.88s/it, loss=0.208, lr=0.0001] 
Steps:  42%|████▏     | 254/600 [15:01<16:36,  2.88s/it, loss=0.0158, lr=0.0001]
Steps:  42%|████▎     | 255/600 [15:03<17:07,  2.98s/it, loss=0.0158, lr=0.0001]
Steps:  42%|████▎     | 255/600 [15:03<17:07,  2.98s/it, loss=0.00383, lr=0.0001]
Steps:  42%|████▎     | 255/600 [15:04<17:07,  2.98s/it, loss=0.111, lr=0.0001]  
Steps:  43%|████▎     | 256/600 [15:06<17:25,  3.04s/it, loss=0.111, lr=0.0001]
Steps:  43%|████▎     | 256/600 [15:06<17:25,  3.04s/it, loss=0.0165, lr=0.0001]
Steps:  43%|████▎     | 256/600 [15:08<17:25,  3.04s/it, loss=0.0756, lr=0.0001]
Steps:  43%|████▎     | 257/600 [15:09<17:26,  3.05s/it, loss=0.0756, lr=0.0001]
Steps:  43%|████▎     | 257/600 [15:09<17:26,  3.05s/it, loss=0.0393, lr=0.0001]
Steps:  43%|████▎     | 258/600 [15:10<13:28,  2.36s/it, loss=0.0393, lr=0.0001]
Steps:  43%|████▎     | 258/600 [15:10<13:28,  2.36s/it, loss=0.118, lr=0.0001] 
Steps:  43%|████▎     | 258/600 [15:12<13:28,  2.36s/it, loss=0.202, lr=0.0001]
Steps:  43%|████▎     | 259/600 [15:14<15:44,  2.77s/it, loss=0.202, lr=0.0001]
Steps:  43%|████▎     | 259/600 [15:14<15:44,  2.77s/it, loss=0.187, lr=0.0001]
Steps:  43%|████▎     | 259/600 [15:15<15:44,  2.77s/it, loss=0.133, lr=0.0001]
Steps:  43%|████▎     | 260/600 [15:17<15:52,  2.80s/it, loss=0.133, lr=0.0001]
Steps:  43%|████▎     | 260/600 [15:17<15:52,  2.80s/it, loss=0.0465, lr=0.0001]
Steps:  43%|████▎     | 260/600 [15:18<15:52,  2.80s/it, loss=0.0103, lr=0.0001]
Steps:  44%|████▎     | 261/600 [15:20<17:02,  3.02s/it, loss=0.0103, lr=0.0001]
Steps:  44%|████▎     | 261/600 [15:20<17:02,  3.02s/it, loss=0.164, lr=0.0001] 
Steps:  44%|████▎     | 261/600 [15:22<17:02,  3.02s/it, loss=0.0243, lr=0.0001]
Steps:  44%|████▎     | 262/600 [15:23<17:18,  3.07s/it, loss=0.0243, lr=0.0001]
Steps:  44%|████▎     | 262/600 [15:23<17:18,  3.07s/it, loss=0.142, lr=0.0001] 
Steps:  44%|████▎     | 262/600 [15:25<17:18,  3.07s/it, loss=0.0641, lr=0.0001]
Steps:  44%|████▍     | 263/600 [15:26<17:15,  3.07s/it, loss=0.0641, lr=0.0001]
Steps:  44%|████▍     | 263/600 [15:26<17:15,  3.07s/it, loss=0.00837, lr=0.0001]
Steps:  44%|████▍     | 264/600 [15:27<13:20,  2.38s/it, loss=0.00837, lr=0.0001]
Steps:  44%|████▍     | 264/600 [15:27<13:20,  2.38s/it, loss=0.119, lr=0.0001]  
Steps:  44%|████▍     | 264/600 [15:30<13:20,  2.38s/it, loss=0.0171, lr=0.0001]
Steps:  44%|████▍     | 265/600 [15:31<15:52,  2.84s/it, loss=0.0171, lr=0.0001]
Steps:  44%|████▍     | 265/600 [15:31<15:52,  2.84s/it, loss=0.0395, lr=0.0001]
Steps:  44%|████▍     | 265/600 [15:33<15:52,  2.84s/it, loss=0.0928, lr=0.0001]
Steps:  44%|████▍     | 266/600 [15:35<17:09,  3.08s/it, loss=0.0928, lr=0.0001]
Steps:  44%|████▍     | 266/600 [15:35<17:09,  3.08s/it, loss=0.0936, lr=0.0001]
Steps:  44%|████▍     | 266/600 [15:36<17:09,  3.08s/it, loss=0.0704, lr=0.0001]
Steps:  44%|████▍     | 267/600 [15:38<16:55,  3.05s/it, loss=0.0704, lr=0.0001]
Steps:  44%|████▍     | 267/600 [15:38<16:55,  3.05s/it, loss=0.286, lr=0.0001] 
Steps:  44%|████▍     | 267/600 [15:39<16:55,  3.05s/it, loss=0.387, lr=0.0001]
Steps:  45%|████▍     | 268/600 [15:41<16:26,  2.97s/it, loss=0.387, lr=0.0001]
Steps:  45%|████▍     | 268/600 [15:41<16:26,  2.97s/it, loss=0.0203, lr=0.0001]
Steps:  45%|████▍     | 268/600 [15:42<16:26,  2.97s/it, loss=0.0894, lr=0.0001]
Steps:  45%|████▍     | 269/600 [15:44<17:11,  3.12s/it, loss=0.0894, lr=0.0001]
Steps:  45%|████▍     | 269/600 [15:44<17:11,  3.12s/it, loss=0.101, lr=0.0001] 
Steps:  45%|████▌     | 270/600 [15:45<13:16,  2.41s/it, loss=0.101, lr=0.0001]
Steps:  45%|████▌     | 270/600 [15:45<13:16,  2.41s/it, loss=0.113, lr=0.0001]
Steps:  45%|████▌     | 270/600 [15:47<13:16,  2.41s/it, loss=0.237, lr=0.0001]
Steps:  45%|████▌     | 271/600 [15:49<16:12,  2.96s/it, loss=0.237, lr=0.0001]
Steps:  45%|████▌     | 271/600 [15:49<16:12,  2.96s/it, loss=0.206, lr=0.0001]
Steps:  45%|████▌     | 271/600 [15:50<16:12,  2.96s/it, loss=0.0532, lr=0.0001]
Steps:  45%|████▌     | 272/600 [15:52<16:12,  2.96s/it, loss=0.0532, lr=0.0001]
Steps:  45%|████▌     | 272/600 [15:52<16:12,  2.96s/it, loss=0.172, lr=0.0001] 
Steps:  45%|████▌     | 272/600 [15:54<16:12,  2.96s/it, loss=0.00503, lr=0.0001]
Steps:  46%|████▌     | 273/600 [15:55<16:36,  3.05s/it, loss=0.00503, lr=0.0001]
Steps:  46%|████▌     | 273/600 [15:55<16:36,  3.05s/it, loss=0.097, lr=0.0001]  
Steps:  46%|████▌     | 273/600 [15:57<16:36,  3.05s/it, loss=0.259, lr=0.0001]
Steps:  46%|████▌     | 274/600 [15:58<16:56,  3.12s/it, loss=0.259, lr=0.0001]
Steps:  46%|████▌     | 274/600 [15:58<16:56,  3.12s/it, loss=0.106, lr=0.0001]
Steps:  46%|████▌     | 274/600 [16:00<16:56,  3.12s/it, loss=0.026, lr=0.0001]
Steps:  46%|████▌     | 275/600 [16:01<16:16,  3.00s/it, loss=0.026, lr=0.0001]
Steps:  46%|████▌     | 275/600 [16:01<16:16,  3.00s/it, loss=0.155, lr=0.0001]
Steps:  46%|████▌     | 276/600 [16:02<12:35,  2.33s/it, loss=0.155, lr=0.0001]
Steps:  46%|████▌     | 276/600 [16:02<12:35,  2.33s/it, loss=0.0109, lr=0.0001]
Steps:  46%|████▌     | 276/600 [16:04<12:35,  2.33s/it, loss=0.0178, lr=0.0001]
Steps:  46%|████▌     | 277/600 [16:06<14:39,  2.72s/it, loss=0.0178, lr=0.0001]
Steps:  46%|████▌     | 277/600 [16:06<14:39,  2.72s/it, loss=0.097, lr=0.0001] 
Steps:  46%|████▌     | 277/600 [16:07<14:39,  2.72s/it, loss=0.15, lr=0.0001] 
Steps:  46%|████▋     | 278/600 [16:09<15:19,  2.86s/it, loss=0.15, lr=0.0001]
Steps:  46%|████▋     | 278/600 [16:09<15:19,  2.86s/it, loss=0.0149, lr=0.0001]
Steps:  46%|████▋     | 278/600 [16:10<15:19,  2.86s/it, loss=0.0432, lr=0.0001]
Steps:  46%|████▋     | 279/600 [16:12<16:13,  3.03s/it, loss=0.0432, lr=0.0001]
Steps:  46%|████▋     | 279/600 [16:12<16:13,  3.03s/it, loss=0.261, lr=0.0001] 
Steps:  46%|████▋     | 279/600 [16:14<16:13,  3.03s/it, loss=0.0937, lr=0.0001]
Steps:  47%|████▋     | 280/600 [16:15<16:28,  3.09s/it, loss=0.0937, lr=0.0001]
Steps:  47%|████▋     | 280/600 [16:15<16:28,  3.09s/it, loss=0.0157, lr=0.0001]
Steps:  47%|████▋     | 280/600 [16:17<16:28,  3.09s/it, loss=0.283, lr=0.0001] 
Steps:  47%|████▋     | 281/600 [16:18<16:15,  3.06s/it, loss=0.283, lr=0.0001]
Steps:  47%|████▋     | 281/600 [16:18<16:15,  3.06s/it, loss=0.24, lr=0.0001] 
Steps:  47%|████▋     | 282/600 [16:19<12:32,  2.37s/it, loss=0.24, lr=0.0001]
Steps:  47%|████▋     | 282/600 [16:19<12:32,  2.37s/it, loss=0.0067, lr=0.0001]
Steps:  47%|████▋     | 282/600 [16:22<12:32,  2.37s/it, loss=0.252, lr=0.0001] 
Steps:  47%|████▋     | 283/600 [16:23<14:48,  2.80s/it, loss=0.252, lr=0.0001]
Steps:  47%|████▋     | 283/600 [16:23<14:48,  2.80s/it, loss=0.119, lr=0.0001]
Steps:  47%|████▋     | 283/600 [16:24<14:48,  2.80s/it, loss=0.0278, lr=0.0001]
Steps:  47%|████▋     | 284/600 [16:26<15:24,  2.93s/it, loss=0.0278, lr=0.0001]
Steps:  47%|████▋     | 284/600 [16:26<15:24,  2.93s/it, loss=0.00584, lr=0.0001]
Steps:  47%|████▋     | 284/600 [16:28<15:24,  2.93s/it, loss=0.044, lr=0.0001]  
Steps:  48%|████▊     | 285/600 [16:29<15:40,  2.98s/it, loss=0.044, lr=0.0001]
Steps:  48%|████▊     | 285/600 [16:29<15:40,  2.98s/it, loss=0.326, lr=0.0001]
Steps:  48%|████▊     | 285/600 [16:31<15:40,  2.98s/it, loss=0.118, lr=0.0001]
Steps:  48%|████▊     | 286/600 [16:33<15:53,  3.04s/it, loss=0.118, lr=0.0001]
Steps:  48%|████▊     | 286/600 [16:33<15:53,  3.04s/it, loss=0.0398, lr=0.0001]
Steps:  48%|████▊     | 286/600 [16:34<15:53,  3.04s/it, loss=0.00733, lr=0.0001]
Steps:  48%|████▊     | 287/600 [16:36<16:03,  3.08s/it, loss=0.00733, lr=0.0001]
Steps:  48%|████▊     | 287/600 [16:36<16:03,  3.08s/it, loss=0.193, lr=0.0001]  
Steps:  48%|████▊     | 288/600 [16:36<12:23,  2.38s/it, loss=0.193, lr=0.0001]
Steps:  48%|████▊     | 288/600 [16:36<12:23,  2.38s/it, loss=0.0957, lr=0.0001]
Steps:  48%|████▊     | 288/600 [16:38<12:23,  2.38s/it, loss=0.148, lr=0.0001] 
Steps:  48%|████▊     | 289/600 [16:40<13:49,  2.67s/it, loss=0.148, lr=0.0001]
Steps:  48%|████▊     | 289/600 [16:40<13:49,  2.67s/it, loss=0.026, lr=0.0001]
Steps:  48%|████▊     | 289/600 [16:42<13:49,  2.67s/it, loss=0.133, lr=0.0001]
Steps:  48%|████▊     | 290/600 [16:43<14:46,  2.86s/it, loss=0.133, lr=0.0001]
Steps:  48%|████▊     | 290/600 [16:43<14:46,  2.86s/it, loss=0.155, lr=0.0001]
Steps:  48%|████▊     | 290/600 [16:45<14:46,  2.86s/it, loss=0.0234, lr=0.0001]
Steps:  48%|████▊     | 291/600 [16:46<15:18,  2.97s/it, loss=0.0234, lr=0.0001]
Steps:  48%|████▊     | 291/600 [16:46<15:18,  2.97s/it, loss=0.0489, lr=0.0001]
Steps:  48%|████▊     | 291/600 [16:48<15:18,  2.97s/it, loss=0.143, lr=0.0001] 
Steps:  49%|████▊     | 292/600 [16:50<15:37,  3.04s/it, loss=0.143, lr=0.0001]
Steps:  49%|████▊     | 292/600 [16:50<15:37,  3.04s/it, loss=0.221, lr=0.0001]
Steps:  49%|████▊     | 292/600 [16:51<15:37,  3.04s/it, loss=0.106, lr=0.0001]
Steps:  49%|████▉     | 293/600 [16:53<15:58,  3.12s/it, loss=0.106, lr=0.0001]
Steps:  49%|████▉     | 293/600 [16:53<15:58,  3.12s/it, loss=0.285, lr=0.0001]
Steps:  49%|████▉     | 294/600 [16:54<12:18,  2.41s/it, loss=0.285, lr=0.0001]
Steps:  49%|████▉     | 294/600 [16:54<12:18,  2.41s/it, loss=0.369, lr=0.0001]
Steps:  49%|████▉     | 294/600 [16:56<12:18,  2.41s/it, loss=0.0174, lr=0.0001]
Steps:  49%|████▉     | 295/600 [16:58<14:41,  2.89s/it, loss=0.0174, lr=0.0001]
Steps:  49%|████▉     | 295/600 [16:58<14:41,  2.89s/it, loss=0.0181, lr=0.0001]
Steps:  49%|████▉     | 295/600 [16:59<14:41,  2.89s/it, loss=0.0105, lr=0.0001]
Steps:  49%|████▉     | 296/600 [17:00<14:32,  2.87s/it, loss=0.0105, lr=0.0001]
Steps:  49%|████▉     | 296/600 [17:00<14:32,  2.87s/it, loss=0.0936, lr=0.0001]
Steps:  49%|████▉     | 296/600 [17:02<14:32,  2.87s/it, loss=0.0239, lr=0.0001]
Steps:  50%|████▉     | 297/600 [17:03<14:38,  2.90s/it, loss=0.0239, lr=0.0001]
Steps:  50%|████▉     | 297/600 [17:03<14:38,  2.90s/it, loss=0.242, lr=0.0001] 
Steps:  50%|████▉     | 297/600 [17:05<14:38,  2.90s/it, loss=0.114, lr=0.0001]
Steps:  50%|████▉     | 298/600 [17:07<15:20,  3.05s/it, loss=0.114, lr=0.0001]
Steps:  50%|████▉     | 298/600 [17:07<15:20,  3.05s/it, loss=0.045, lr=0.0001]
Steps:  50%|████▉     | 298/600 [17:09<15:20,  3.05s/it, loss=0.034, lr=0.0001]
Steps:  50%|████▉     | 299/600 [17:10<15:27,  3.08s/it, loss=0.034, lr=0.0001]
Steps:  50%|████▉     | 299/600 [17:10<15:27,  3.08s/it, loss=0.287, lr=0.0001]
Steps:  50%|█████     | 300/600 [17:11<11:55,  2.38s/it, loss=0.287, lr=0.0001]
Steps:  50%|█████     | 300/600 [17:11<11:55,  2.38s/it, loss=0.0259, lr=0.0001]
Steps:  50%|█████     | 300/600 [17:13<11:55,  2.38s/it, loss=0.124, lr=0.0001] 
Steps:  50%|█████     | 301/600 [17:15<14:05,  2.83s/it, loss=0.124, lr=0.0001]
Steps:  50%|█████     | 301/600 [17:15<14:05,  2.83s/it, loss=0.263, lr=0.0001]
Steps:  50%|█████     | 301/600 [17:16<14:05,  2.83s/it, loss=0.143, lr=0.0001]
Steps:  50%|█████     | 302/600 [17:18<14:23,  2.90s/it, loss=0.143, lr=0.0001]
Steps:  50%|█████     | 302/600 [17:18<14:23,  2.90s/it, loss=0.162, lr=0.0001]
Steps:  50%|█████     | 302/600 [17:19<14:23,  2.90s/it, loss=0.125, lr=0.0001]
Steps:  50%|█████     | 303/600 [17:21<14:48,  2.99s/it, loss=0.125, lr=0.0001]
Steps:  50%|█████     | 303/600 [17:21<14:48,  2.99s/it, loss=0.0977, lr=0.0001]
Steps:  50%|█████     | 303/600 [17:22<14:48,  2.99s/it, loss=0.315, lr=0.0001] 
Steps:  51%|█████     | 304/600 [17:24<15:15,  3.09s/it, loss=0.315, lr=0.0001]
Steps:  51%|█████     | 304/600 [17:24<15:15,  3.09s/it, loss=0.0955, lr=0.0001]
Steps:  51%|█████     | 304/600 [17:26<15:15,  3.09s/it, loss=0.038, lr=0.0001] 
Steps:  51%|█████     | 305/600 [17:27<14:56,  3.04s/it, loss=0.038, lr=0.0001]
Steps:  51%|█████     | 305/600 [17:27<14:56,  3.04s/it, loss=0.0235, lr=0.0001]
Steps:  51%|█████     | 306/600 [17:28<11:33,  2.36s/it, loss=0.0235, lr=0.0001]
Steps:  51%|█████     | 306/600 [17:28<11:33,  2.36s/it, loss=0.165, lr=0.0001] 10/12/2023 11:27:59 - INFO - __main__ - Running validation... 
 Generating 4 images with prompts: "a photo of Brad Pitt in a suit and sunglasses showing <thumbs_up> thumbs up", "a photo of Barack Obama wearing a vest showing <thumbs_up> thumbs up", "a photo of a black man at the beach showing <thumbs_up> thumbs up".


Loading pipeline components...:   0%|          | 0/7 [00:00<?, ?it/s]Loaded tokenizer as CLIPTokenizer from `tokenizer` subfolder of stabilityai/stable-diffusion-xl-base-1.0.
Loaded scheduler as EulerDiscreteScheduler from `scheduler` subfolder of stabilityai/stable-diffusion-xl-base-1.0.
Loaded tokenizer_2 as CLIPTokenizer from `tokenizer_2` subfolder of stabilityai/stable-diffusion-xl-base-1.0.

Loading pipeline components...: 100%|██████████| 7/7 [00:00<00:00, 70.19it/s]
{'dynamic_thresholding_ratio', 'solver_order', 'lower_order_final', 'lambda_min_clipped', 'solver_type', 'thresholding', 'algorithm_type', 'variance_type'} was not found in config. Values will be initialized to default values.
10/12/2023 11:28:56 - INFO - __main__ - Image features shape: torch.Size([5, 75648])
10/12/2023 11:29:46 - INFO - __main__ - Image features shape: torch.Size([5, 75648])
10/12/2023 11:30:36 - INFO - __main__ - Image features shape: torch.Size([5, 75648])

Steps:  51%|█████     | 306/600 [20:14<11:33,  2.36s/it, loss=0.16, lr=0.0001] wandb: WARNING (User provided step: 306 is less than current step: 307. Dropping entry: {'loss': 0.15953482687473297, 'lr': 0.0001, '_timestamp': 1697110245.3259637}).

Steps:  51%|█████     | 307/600 [20:16<4:14:24, 52.10s/it, loss=0.16, lr=0.0001]
Steps:  51%|█████     | 307/600 [20:16<4:14:24, 52.10s/it, loss=0.0196, lr=0.0001]
Steps:  51%|█████     | 307/600 [20:18<4:14:24, 52.10s/it, loss=0.12, lr=0.0001]  
Steps:  51%|█████▏    | 308/600 [20:19<3:02:27, 37.49s/it, loss=0.12, lr=0.0001]
Steps:  51%|█████▏    | 308/600 [20:19<3:02:27, 37.49s/it, loss=0.0669, lr=0.0001]
Steps:  51%|█████▏    | 308/600 [20:21<3:02:27, 37.49s/it, loss=0.112, lr=0.0001] 
Steps:  52%|█████▏    | 309/600 [20:23<2:12:06, 27.24s/it, loss=0.112, lr=0.0001]
Steps:  52%|█████▏    | 309/600 [20:23<2:12:06, 27.24s/it, loss=0.0423, lr=0.0001]
Steps:  52%|█████▏    | 309/600 [20:24<2:12:06, 27.24s/it, loss=0.0195, lr=0.0001]
Steps:  52%|█████▏    | 310/600 [20:26<1:36:15, 19.91s/it, loss=0.0195, lr=0.0001]
Steps:  52%|█████▏    | 310/600 [20:26<1:36:15, 19.91s/it, loss=0.203, lr=0.0001] 
Steps:  52%|█████▏    | 310/600 [20:27<1:36:15, 19.91s/it, loss=0.136, lr=0.0001]
Steps:  52%|█████▏    | 311/600 [20:29<1:11:38, 14.87s/it, loss=0.136, lr=0.0001]
Steps:  52%|█████▏    | 311/600 [20:29<1:11:38, 14.87s/it, loss=0.176, lr=0.0001]
Steps:  52%|█████▏    | 312/600 [20:29<51:04, 10.64s/it, loss=0.176, lr=0.0001]  
Steps:  52%|█████▏    | 312/600 [20:29<51:04, 10.64s/it, loss=0.00403, lr=0.0001]
Steps:  52%|█████▏    | 312/600 [20:32<51:04, 10.64s/it, loss=0.00243, lr=0.0001]
Steps:  52%|█████▏    | 313/600 [20:33<41:11,  8.61s/it, loss=0.00243, lr=0.0001]
Steps:  52%|█████▏    | 313/600 [20:33<41:11,  8.61s/it, loss=0.0751, lr=0.0001] 
Steps:  52%|█████▏    | 313/600 [20:35<41:11,  8.61s/it, loss=0.00996, lr=0.0001]
Steps:  52%|█████▏    | 314/600 [20:37<33:21,  7.00s/it, loss=0.00996, lr=0.0001]
Steps:  52%|█████▏    | 314/600 [20:37<33:21,  7.00s/it, loss=0.0432, lr=0.0001] 
Steps:  52%|█████▏    | 314/600 [20:38<33:21,  7.00s/it, loss=0.00686, lr=0.0001]
Steps:  52%|█████▎    | 315/600 [20:40<28:09,  5.93s/it, loss=0.00686, lr=0.0001]
Steps:  52%|█████▎    | 315/600 [20:40<28:09,  5.93s/it, loss=0.292, lr=0.0001]  
Steps:  52%|█████▎    | 315/600 [20:42<28:09,  5.93s/it, loss=0.0404, lr=0.0001]
Steps:  53%|█████▎    | 316/600 [20:43<24:18,  5.14s/it, loss=0.0404, lr=0.0001]
Steps:  53%|█████▎    | 316/600 [20:43<24:18,  5.14s/it, loss=0.253, lr=0.0001] 
Steps:  53%|█████▎    | 316/600 [20:45<24:18,  5.14s/it, loss=0.207, lr=0.0001]
Steps:  53%|█████▎    | 317/600 [20:46<20:38,  4.38s/it, loss=0.207, lr=0.0001]
Steps:  53%|█████▎    | 317/600 [20:46<20:38,  4.38s/it, loss=0.216, lr=0.0001]
Steps:  53%|█████▎    | 318/600 [20:47<15:28,  3.29s/it, loss=0.216, lr=0.0001]
Steps:  53%|█████▎    | 318/600 [20:47<15:28,  3.29s/it, loss=0.239, lr=0.0001]
Steps:  53%|█████▎    | 318/600 [20:49<15:28,  3.29s/it, loss=0.186, lr=0.0001]
Steps:  53%|█████▎    | 319/600 [20:51<16:35,  3.54s/it, loss=0.186, lr=0.0001]
Steps:  53%|█████▎    | 319/600 [20:51<16:35,  3.54s/it, loss=0.211, lr=0.0001]
Steps:  53%|█████▎    | 319/600 [20:52<16:35,  3.54s/it, loss=0.0181, lr=0.0001]
Steps:  53%|█████▎    | 320/600 [20:54<16:03,  3.44s/it, loss=0.0181, lr=0.0001]
Steps:  53%|█████▎    | 320/600 [20:54<16:03,  3.44s/it, loss=0.129, lr=0.0001] 
Steps:  53%|█████▎    | 320/600 [20:56<16:03,  3.44s/it, loss=0.0939, lr=0.0001]
Steps:  54%|█████▎    | 321/600 [20:57<15:33,  3.35s/it, loss=0.0939, lr=0.0001]
Steps:  54%|█████▎    | 321/600 [20:57<15:33,  3.35s/it, loss=0.0152, lr=0.0001]
Steps:  54%|█████▎    | 321/600 [20:59<15:33,  3.35s/it, loss=0.052, lr=0.0001] 
Steps:  54%|█████▎    | 322/600 [21:00<15:17,  3.30s/it, loss=0.052, lr=0.0001]
Steps:  54%|█████▎    | 322/600 [21:00<15:17,  3.30s/it, loss=0.0475, lr=0.0001]
Steps:  54%|█████▎    | 322/600 [21:02<15:17,  3.30s/it, loss=0.0792, lr=0.0001]
Steps:  54%|█████▍    | 323/600 [21:03<14:35,  3.16s/it, loss=0.0792, lr=0.0001]
Steps:  54%|█████▍    | 323/600 [21:03<14:35,  3.16s/it, loss=0.135, lr=0.0001] 
Steps:  54%|█████▍    | 324/600 [21:04<11:14,  2.44s/it, loss=0.135, lr=0.0001]
Steps:  54%|█████▍    | 324/600 [21:04<11:14,  2.44s/it, loss=0.00361, lr=0.0001]
Steps:  54%|█████▍    | 324/600 [21:06<11:14,  2.44s/it, loss=0.3, lr=0.0001]    
Steps:  54%|█████▍    | 325/600 [21:08<13:03,  2.85s/it, loss=0.3, lr=0.0001]
Steps:  54%|█████▍    | 325/600 [21:08<13:03,  2.85s/it, loss=0.144, lr=0.0001]
Steps:  54%|█████▍    | 325/600 [21:10<13:03,  2.85s/it, loss=0.152, lr=0.0001]
Steps:  54%|█████▍    | 326/600 [21:11<13:57,  3.06s/it, loss=0.152, lr=0.0001]
Steps:  54%|█████▍    | 326/600 [21:11<13:57,  3.06s/it, loss=0.163, lr=0.0001]
Steps:  54%|█████▍    | 326/600 [21:13<13:57,  3.06s/it, loss=0.0989, lr=0.0001]
Steps:  55%|█████▍    | 327/600 [21:14<13:51,  3.04s/it, loss=0.0989, lr=0.0001]
Steps:  55%|█████▍    | 327/600 [21:14<13:51,  3.04s/it, loss=0.0679, lr=0.0001]
Steps:  55%|█████▍    | 327/600 [21:16<13:51,  3.04s/it, loss=0.0178, lr=0.0001]
Steps:  55%|█████▍    | 328/600 [21:18<14:17,  3.15s/it, loss=0.0178, lr=0.0001]
Steps:  55%|█████▍    | 328/600 [21:18<14:17,  3.15s/it, loss=0.0105, lr=0.0001]
Steps:  55%|█████▍    | 328/600 [21:19<14:17,  3.15s/it, loss=0.223, lr=0.0001] 
Steps:  55%|█████▍    | 329/600 [21:20<13:42,  3.03s/it, loss=0.223, lr=0.0001]
Steps:  55%|█████▍    | 329/600 [21:20<13:42,  3.03s/it, loss=0.119, lr=0.0001]
Steps:  55%|█████▌    | 330/600 [21:21<10:36,  2.36s/it, loss=0.119, lr=0.0001]
Steps:  55%|█████▌    | 330/600 [21:21<10:36,  2.36s/it, loss=0.0131, lr=0.0001]
Steps:  55%|█████▌    | 330/600 [21:23<10:36,  2.36s/it, loss=0.0274, lr=0.0001]
Steps:  55%|█████▌    | 331/600 [21:25<12:42,  2.84s/it, loss=0.0274, lr=0.0001]
Steps:  55%|█████▌    | 331/600 [21:25<12:42,  2.84s/it, loss=0.133, lr=0.0001] 
Steps:  55%|█████▌    | 331/600 [21:27<12:42,  2.84s/it, loss=0.0634, lr=0.0001]
Steps:  55%|█████▌    | 332/600 [21:29<13:27,  3.01s/it, loss=0.0634, lr=0.0001]
Steps:  55%|█████▌    | 332/600 [21:29<13:27,  3.01s/it, loss=0.268, lr=0.0001] 
Steps:  55%|█████▌    | 332/600 [21:30<13:27,  3.01s/it, loss=0.113, lr=0.0001]
Steps:  56%|█████▌    | 333/600 [21:32<13:21,  3.00s/it, loss=0.113, lr=0.0001]
Steps:  56%|█████▌    | 333/600 [21:32<13:21,  3.00s/it, loss=0.0514, lr=0.0001]
Steps:  56%|█████▌    | 333/600 [21:33<13:21,  3.00s/it, loss=0.192, lr=0.0001] 
Steps:  56%|█████▌    | 334/600 [21:35<13:45,  3.10s/it, loss=0.192, lr=0.0001]
Steps:  56%|█████▌    | 334/600 [21:35<13:45,  3.10s/it, loss=0.117, lr=0.0001]
Steps:  56%|█████▌    | 334/600 [21:37<13:45,  3.10s/it, loss=0.015, lr=0.0001]
Steps:  56%|█████▌    | 335/600 [21:38<13:13,  3.00s/it, loss=0.015, lr=0.0001]
Steps:  56%|█████▌    | 335/600 [21:38<13:13,  3.00s/it, loss=0.0604, lr=0.0001]
Steps:  56%|█████▌    | 336/600 [21:38<10:13,  2.33s/it, loss=0.0604, lr=0.0001]
Steps:  56%|█████▌    | 336/600 [21:38<10:13,  2.33s/it, loss=0.234, lr=0.0001] 
Steps:  56%|█████▌    | 336/600 [21:41<10:13,  2.33s/it, loss=0.0411, lr=0.0001]
Steps:  56%|█████▌    | 337/600 [21:42<12:25,  2.84s/it, loss=0.0411, lr=0.0001]
Steps:  56%|█████▌    | 337/600 [21:42<12:25,  2.84s/it, loss=0.244, lr=0.0001] 
Steps:  56%|█████▌    | 337/600 [21:44<12:25,  2.84s/it, loss=0.153, lr=0.0001]
Steps:  56%|█████▋    | 338/600 [21:46<12:44,  2.92s/it, loss=0.153, lr=0.0001]
Steps:  56%|█████▋    | 338/600 [21:46<12:44,  2.92s/it, loss=0.149, lr=0.0001]
Steps:  56%|█████▋    | 338/600 [21:47<12:44,  2.92s/it, loss=0.00353, lr=0.0001]
Steps:  56%|█████▋    | 339/600 [21:48<12:43,  2.93s/it, loss=0.00353, lr=0.0001]
Steps:  56%|█████▋    | 339/600 [21:48<12:43,  2.93s/it, loss=0.131, lr=0.0001]  
Steps:  56%|█████▋    | 339/600 [21:50<12:43,  2.93s/it, loss=0.0146, lr=0.0001]
Steps:  57%|█████▋    | 340/600 [21:52<13:02,  3.01s/it, loss=0.0146, lr=0.0001]
Steps:  57%|█████▋    | 340/600 [21:52<13:02,  3.01s/it, loss=0.0425, lr=0.0001]
Steps:  57%|█████▋    | 340/600 [21:54<13:02,  3.01s/it, loss=0.0653, lr=0.0001]
Steps:  57%|█████▋    | 341/600 [21:55<13:10,  3.05s/it, loss=0.0653, lr=0.0001]
Steps:  57%|█████▋    | 341/600 [21:55<13:10,  3.05s/it, loss=0.0503, lr=0.0001]
Steps:  57%|█████▋    | 342/600 [21:56<10:11,  2.37s/it, loss=0.0503, lr=0.0001]
Steps:  57%|█████▋    | 342/600 [21:56<10:11,  2.37s/it, loss=0.0187, lr=0.0001]
Steps:  57%|█████▋    | 342/600 [21:58<10:11,  2.37s/it, loss=0.0438, lr=0.0001]
Steps:  57%|█████▋    | 343/600 [21:59<11:38,  2.72s/it, loss=0.0438, lr=0.0001]
Steps:  57%|█████▋    | 343/600 [21:59<11:38,  2.72s/it, loss=0.143, lr=0.0001] 
Steps:  57%|█████▋    | 343/600 [22:01<11:38,  2.72s/it, loss=0.104, lr=0.0001]
Steps:  57%|█████▋    | 344/600 [22:02<12:14,  2.87s/it, loss=0.104, lr=0.0001]
Steps:  57%|█████▋    | 344/600 [22:02<12:14,  2.87s/it, loss=0.145, lr=0.0001]
Steps:  57%|█████▋    | 344/600 [22:04<12:14,  2.87s/it, loss=0.105, lr=0.0001]
Steps:  57%|█████▊    | 345/600 [22:06<13:02,  3.07s/it, loss=0.105, lr=0.0001]
Steps:  57%|█████▊    | 345/600 [22:06<13:02,  3.07s/it, loss=0.0481, lr=0.0001]
Steps:  57%|█████▊    | 345/600 [22:07<13:02,  3.07s/it, loss=0.0996, lr=0.0001]
Steps:  58%|█████▊    | 346/600 [22:09<13:21,  3.16s/it, loss=0.0996, lr=0.0001]
Steps:  58%|█████▊    | 346/600 [22:09<13:21,  3.16s/it, loss=0.0948, lr=0.0001]
Steps:  58%|█████▊    | 346/600 [22:11<13:21,  3.16s/it, loss=0.175, lr=0.0001] 
Steps:  58%|█████▊    | 347/600 [22:12<12:55,  3.07s/it, loss=0.175, lr=0.0001]
Steps:  58%|█████▊    | 347/600 [22:12<12:55,  3.07s/it, loss=0.00821, lr=0.0001]
Steps:  58%|█████▊    | 348/600 [22:13<09:59,  2.38s/it, loss=0.00821, lr=0.0001]
Steps:  58%|█████▊    | 348/600 [22:13<09:59,  2.38s/it, loss=0.489, lr=0.0001]  
Steps:  58%|█████▊    | 348/600 [22:15<09:59,  2.38s/it, loss=0.00491, lr=0.0001]
Steps:  58%|█████▊    | 349/600 [22:17<12:00,  2.87s/it, loss=0.00491, lr=0.0001]
Steps:  58%|█████▊    | 349/600 [22:17<12:00,  2.87s/it, loss=0.168, lr=0.0001]  
Steps:  58%|█████▊    | 349/600 [22:19<12:00,  2.87s/it, loss=0.291, lr=0.0001]
Steps:  58%|█████▊    | 350/600 [22:20<11:57,  2.87s/it, loss=0.291, lr=0.0001]
Steps:  58%|█████▊    | 350/600 [22:20<11:57,  2.87s/it, loss=0.0374, lr=0.0001]
Steps:  58%|█████▊    | 350/600 [22:21<11:57,  2.87s/it, loss=0.155, lr=0.0001] 
Steps:  58%|█████▊    | 351/600 [22:23<12:33,  3.03s/it, loss=0.155, lr=0.0001]
Steps:  58%|█████▊    | 351/600 [22:23<12:33,  3.03s/it, loss=0.0625, lr=0.0001]
Steps:  58%|█████▊    | 351/600 [22:25<12:33,  3.03s/it, loss=0.195, lr=0.0001] 
Steps:  59%|█████▊    | 352/600 [22:26<12:51,  3.11s/it, loss=0.195, lr=0.0001]
Steps:  59%|█████▊    | 352/600 [22:26<12:51,  3.11s/it, loss=0.0581, lr=0.0001]
Steps:  59%|█████▊    | 352/600 [22:28<12:51,  3.11s/it, loss=0.063, lr=0.0001] 
Steps:  59%|█████▉    | 353/600 [22:29<12:35,  3.06s/it, loss=0.063, lr=0.0001]
Steps:  59%|█████▉    | 353/600 [22:29<12:35,  3.06s/it, loss=0.314, lr=0.0001]
Steps:  59%|█████▉    | 354/600 [22:30<09:45,  2.38s/it, loss=0.314, lr=0.0001]
Steps:  59%|█████▉    | 354/600 [22:30<09:45,  2.38s/it, loss=0.00601, lr=0.0001]
Steps:  59%|█████▉    | 354/600 [22:33<09:45,  2.38s/it, loss=0.0868, lr=0.0001] 
Steps:  59%|█████▉    | 355/600 [22:34<11:54,  2.92s/it, loss=0.0868, lr=0.0001]
Steps:  59%|█████▉    | 355/600 [22:34<11:54,  2.92s/it, loss=0.148, lr=0.0001] 
Steps:  59%|█████▉    | 355/600 [22:36<11:54,  2.92s/it, loss=0.0187, lr=0.0001]
Steps:  59%|█████▉    | 356/600 [22:38<12:16,  3.02s/it, loss=0.0187, lr=0.0001]
Steps:  59%|█████▉    | 356/600 [22:38<12:16,  3.02s/it, loss=0.219, lr=0.0001] 
Steps:  59%|█████▉    | 356/600 [22:40<12:16,  3.02s/it, loss=0.0225, lr=0.0001]
Steps:  60%|█████▉    | 357/600 [22:41<12:56,  3.20s/it, loss=0.0225, lr=0.0001]
Steps:  60%|█████▉    | 357/600 [22:41<12:56,  3.20s/it, loss=0.00665, lr=0.0001]
Steps:  60%|█████▉    | 357/600 [22:43<12:56,  3.20s/it, loss=0.177, lr=0.0001]  
Steps:  60%|█████▉    | 358/600 [22:44<12:46,  3.17s/it, loss=0.177, lr=0.0001]
Steps:  60%|█████▉    | 358/600 [22:44<12:46,  3.17s/it, loss=0.00905, lr=0.0001]
Steps:  60%|█████▉    | 358/600 [22:46<12:46,  3.17s/it, loss=0.183, lr=0.0001]  
Steps:  60%|█████▉    | 359/600 [22:47<12:15,  3.05s/it, loss=0.183, lr=0.0001]
Steps:  60%|█████▉    | 359/600 [22:47<12:15,  3.05s/it, loss=0.0796, lr=0.0001]
Steps:  60%|██████    | 360/600 [22:48<09:28,  2.37s/it, loss=0.0796, lr=0.0001]
Steps:  60%|██████    | 360/600 [22:48<09:28,  2.37s/it, loss=0.268, lr=0.0001] 
Steps:  60%|██████    | 360/600 [22:50<09:28,  2.37s/it, loss=0.0485, lr=0.0001]
Steps:  60%|██████    | 361/600 [22:52<11:20,  2.85s/it, loss=0.0485, lr=0.0001]
Steps:  60%|██████    | 361/600 [22:52<11:20,  2.85s/it, loss=0.176, lr=0.0001] 
Steps:  60%|██████    | 361/600 [22:53<11:20,  2.85s/it, loss=0.198, lr=0.0001]
Steps:  60%|██████    | 362/600 [22:55<11:50,  2.98s/it, loss=0.198, lr=0.0001]
Steps:  60%|██████    | 362/600 [22:55<11:50,  2.98s/it, loss=0.0587, lr=0.0001]
Steps:  60%|██████    | 362/600 [22:57<11:50,  2.98s/it, loss=0.0045, lr=0.0001]
Steps:  60%|██████    | 363/600 [22:59<12:23,  3.14s/it, loss=0.0045, lr=0.0001]
Steps:  60%|██████    | 363/600 [22:59<12:23,  3.14s/it, loss=0.133, lr=0.0001] 
Steps:  60%|██████    | 363/600 [23:00<12:23,  3.14s/it, loss=0.142, lr=0.0001]
Steps:  61%|██████    | 364/600 [23:02<12:20,  3.14s/it, loss=0.142, lr=0.0001]
Steps:  61%|██████    | 364/600 [23:02<12:20,  3.14s/it, loss=0.134, lr=0.0001]
Steps:  61%|██████    | 364/600 [23:03<12:20,  3.14s/it, loss=0.107, lr=0.0001]
Steps:  61%|██████    | 365/600 [23:05<11:50,  3.02s/it, loss=0.107, lr=0.0001]
Steps:  61%|██████    | 365/600 [23:05<11:50,  3.02s/it, loss=0.0475, lr=0.0001]
Steps:  61%|██████    | 366/600 [23:05<09:09,  2.35s/it, loss=0.0475, lr=0.0001]
Steps:  61%|██████    | 366/600 [23:05<09:09,  2.35s/it, loss=0.131, lr=0.0001] 
Steps:  61%|██████    | 366/600 [23:08<09:09,  2.35s/it, loss=0.196, lr=0.0001]
Steps:  61%|██████    | 367/600 [23:09<11:00,  2.84s/it, loss=0.196, lr=0.0001]
Steps:  61%|██████    | 367/600 [23:09<11:00,  2.84s/it, loss=0.0517, lr=0.0001]
Steps:  61%|██████    | 367/600 [23:11<11:00,  2.84s/it, loss=0.126, lr=0.0001] 
Steps:  61%|██████▏   | 368/600 [23:13<11:38,  3.01s/it, loss=0.126, lr=0.0001]
Steps:  61%|██████▏   | 368/600 [23:13<11:38,  3.01s/it, loss=0.0126, lr=0.0001]
Steps:  61%|██████▏   | 368/600 [23:15<11:38,  3.01s/it, loss=0.117, lr=0.0001] 
Steps:  62%|██████▏   | 369/600 [23:16<12:06,  3.14s/it, loss=0.117, lr=0.0001]
Steps:  62%|██████▏   | 369/600 [23:16<12:06,  3.14s/it, loss=0.0599, lr=0.0001]
Steps:  62%|██████▏   | 369/600 [23:18<12:06,  3.14s/it, loss=0.148, lr=0.0001] 
Steps:  62%|██████▏   | 370/600 [23:19<11:45,  3.07s/it, loss=0.148, lr=0.0001]
Steps:  62%|██████▏   | 370/600 [23:19<11:45,  3.07s/it, loss=0.0791, lr=0.0001]
Steps:  62%|██████▏   | 370/600 [23:21<11:45,  3.07s/it, loss=0.15, lr=0.0001]  
Steps:  62%|██████▏   | 371/600 [23:22<11:32,  3.02s/it, loss=0.15, lr=0.0001]
Steps:  62%|██████▏   | 371/600 [23:22<11:32,  3.02s/it, loss=0.178, lr=0.0001]
Steps:  62%|██████▏   | 372/600 [23:23<08:56,  2.35s/it, loss=0.178, lr=0.0001]
Steps:  62%|██████▏   | 372/600 [23:23<08:56,  2.35s/it, loss=0.259, lr=0.0001]
Steps:  62%|██████▏   | 372/600 [23:25<08:56,  2.35s/it, loss=0.0553, lr=0.0001]
Steps:  62%|██████▏   | 373/600 [23:27<11:01,  2.91s/it, loss=0.0553, lr=0.0001]
Steps:  62%|██████▏   | 373/600 [23:27<11:01,  2.91s/it, loss=0.0168, lr=0.0001]
Steps:  62%|██████▏   | 373/600 [23:29<11:01,  2.91s/it, loss=0.228, lr=0.0001] 
Steps:  62%|██████▏   | 374/600 [23:30<11:29,  3.05s/it, loss=0.228, lr=0.0001]
Steps:  62%|██████▏   | 374/600 [23:30<11:29,  3.05s/it, loss=0.0413, lr=0.0001]
Steps:  62%|██████▏   | 374/600 [23:32<11:29,  3.05s/it, loss=0.11, lr=0.0001]  
Steps:  62%|██████▎   | 375/600 [23:34<11:41,  3.12s/it, loss=0.11, lr=0.0001]
Steps:  62%|██████▎   | 375/600 [23:34<11:41,  3.12s/it, loss=0.161, lr=0.0001]
Steps:  62%|██████▎   | 375/600 [23:35<11:41,  3.12s/it, loss=0.0929, lr=0.0001]
Steps:  63%|██████▎   | 376/600 [23:37<11:34,  3.10s/it, loss=0.0929, lr=0.0001]
Steps:  63%|██████▎   | 376/600 [23:37<11:34,  3.10s/it, loss=0.122, lr=0.0001] 
Steps:  63%|██████▎   | 376/600 [23:38<11:34,  3.10s/it, loss=0.198, lr=0.0001]
Steps:  63%|██████▎   | 377/600 [23:39<11:01,  2.96s/it, loss=0.198, lr=0.0001]
Steps:  63%|██████▎   | 377/600 [23:39<11:01,  2.96s/it, loss=0.164, lr=0.0001]
Steps:  63%|██████▎   | 378/600 [23:40<08:31,  2.31s/it, loss=0.164, lr=0.0001]
Steps:  63%|██████▎   | 378/600 [23:40<08:31,  2.31s/it, loss=0.0268, lr=0.0001]
Steps:  63%|██████▎   | 378/600 [23:42<08:31,  2.31s/it, loss=0.13, lr=0.0001]  
Steps:  63%|██████▎   | 379/600 [23:44<10:00,  2.72s/it, loss=0.13, lr=0.0001]
Steps:  63%|██████▎   | 379/600 [23:44<10:00,  2.72s/it, loss=0.0725, lr=0.0001]
Steps:  63%|██████▎   | 379/600 [23:45<10:00,  2.72s/it, loss=0.0344, lr=0.0001]
Steps:  63%|██████▎   | 380/600 [23:47<10:30,  2.86s/it, loss=0.0344, lr=0.0001]
Steps:  63%|██████▎   | 380/600 [23:47<10:30,  2.86s/it, loss=0.0442, lr=0.0001]
Steps:  63%|██████▎   | 380/600 [23:49<10:30,  2.86s/it, loss=0.23, lr=0.0001]  
Steps:  64%|██████▎   | 381/600 [23:51<11:12,  3.07s/it, loss=0.23, lr=0.0001]
Steps:  64%|██████▎   | 381/600 [23:51<11:12,  3.07s/it, loss=0.127, lr=0.0001]
Steps:  64%|██████▎   | 381/600 [23:52<11:12,  3.07s/it, loss=0.163, lr=0.0001]
Steps:  64%|██████▎   | 382/600 [23:54<11:25,  3.15s/it, loss=0.163, lr=0.0001]
Steps:  64%|██████▎   | 382/600 [23:54<11:25,  3.15s/it, loss=0.0517, lr=0.0001]
Steps:  64%|██████▎   | 382/600 [23:55<11:25,  3.15s/it, loss=0.024, lr=0.0001] 
Steps:  64%|██████▍   | 383/600 [23:57<10:58,  3.03s/it, loss=0.024, lr=0.0001]
Steps:  64%|██████▍   | 383/600 [23:57<10:58,  3.03s/it, loss=0.112, lr=0.0001]
Steps:  64%|██████▍   | 384/600 [23:57<08:28,  2.36s/it, loss=0.112, lr=0.0001]
Steps:  64%|██████▍   | 384/600 [23:57<08:28,  2.36s/it, loss=0.137, lr=0.0001]
Steps:  64%|██████▍   | 384/600 [24:00<08:28,  2.36s/it, loss=0.0133, lr=0.0001]
Steps:  64%|██████▍   | 385/600 [24:01<10:12,  2.85s/it, loss=0.0133, lr=0.0001]
Steps:  64%|██████▍   | 385/600 [24:01<10:12,  2.85s/it, loss=0.164, lr=0.0001] 
Steps:  64%|██████▍   | 385/600 [24:03<10:12,  2.85s/it, loss=0.228, lr=0.0001]
Steps:  64%|██████▍   | 386/600 [24:05<11:03,  3.10s/it, loss=0.228, lr=0.0001]
Steps:  64%|██████▍   | 386/600 [24:05<11:03,  3.10s/it, loss=0.179, lr=0.0001]
Steps:  64%|██████▍   | 386/600 [24:06<11:03,  3.10s/it, loss=0.156, lr=0.0001]
Steps:  64%|██████▍   | 387/600 [24:08<10:53,  3.07s/it, loss=0.156, lr=0.0001]
Steps:  64%|██████▍   | 387/600 [24:08<10:53,  3.07s/it, loss=0.202, lr=0.0001]
Steps:  64%|██████▍   | 387/600 [24:10<10:53,  3.07s/it, loss=0.0455, lr=0.0001]
Steps:  65%|██████▍   | 388/600 [24:11<10:50,  3.07s/it, loss=0.0455, lr=0.0001]
Steps:  65%|██████▍   | 388/600 [24:11<10:50,  3.07s/it, loss=0.164, lr=0.0001] 
Steps:  65%|██████▍   | 388/600 [24:13<10:50,  3.07s/it, loss=0.209, lr=0.0001]
Steps:  65%|██████▍   | 389/600 [24:14<10:42,  3.04s/it, loss=0.209, lr=0.0001]
Steps:  65%|██████▍   | 389/600 [24:14<10:42,  3.04s/it, loss=0.0736, lr=0.0001]
Steps:  65%|██████▌   | 390/600 [24:15<08:15,  2.36s/it, loss=0.0736, lr=0.0001]
Steps:  65%|██████▌   | 390/600 [24:15<08:15,  2.36s/it, loss=0.00672, lr=0.0001]
Steps:  65%|██████▌   | 390/600 [24:17<08:15,  2.36s/it, loss=0.127, lr=0.0001]  
Steps:  65%|██████▌   | 391/600 [24:19<09:55,  2.85s/it, loss=0.127, lr=0.0001]
Steps:  65%|██████▌   | 391/600 [24:19<09:55,  2.85s/it, loss=0.0593, lr=0.0001]
Steps:  65%|██████▌   | 391/600 [24:21<09:55,  2.85s/it, loss=0.0345, lr=0.0001]
Steps:  65%|██████▌   | 392/600 [24:22<10:09,  2.93s/it, loss=0.0345, lr=0.0001]
Steps:  65%|██████▌   | 392/600 [24:22<10:09,  2.93s/it, loss=0.115, lr=0.0001] 
Steps:  65%|██████▌   | 392/600 [24:24<10:09,  2.93s/it, loss=0.00934, lr=0.0001]
Steps:  66%|██████▌   | 393/600 [24:26<10:55,  3.17s/it, loss=0.00934, lr=0.0001]
Steps:  66%|██████▌   | 393/600 [24:26<10:55,  3.17s/it, loss=0.00906, lr=0.0001]
Steps:  66%|██████▌   | 393/600 [24:27<10:55,  3.17s/it, loss=0.111, lr=0.0001]  
Steps:  66%|██████▌   | 394/600 [24:29<11:02,  3.22s/it, loss=0.111, lr=0.0001]
Steps:  66%|██████▌   | 394/600 [24:29<11:02,  3.22s/it, loss=0.177, lr=0.0001]
Steps:  66%|██████▌   | 394/600 [24:31<11:02,  3.22s/it, loss=0.0211, lr=0.0001]
Steps:  66%|██████▌   | 395/600 [24:32<10:27,  3.06s/it, loss=0.0211, lr=0.0001]
Steps:  66%|██████▌   | 395/600 [24:32<10:27,  3.06s/it, loss=0.184, lr=0.0001] 
Steps:  66%|██████▌   | 396/600 [24:33<08:03,  2.37s/it, loss=0.184, lr=0.0001]
Steps:  66%|██████▌   | 396/600 [24:33<08:03,  2.37s/it, loss=0.0139, lr=0.0001]
Steps:  66%|██████▌   | 396/600 [24:35<08:03,  2.37s/it, loss=0.166, lr=0.0001] 
Steps:  66%|██████▌   | 397/600 [24:36<09:22,  2.77s/it, loss=0.166, lr=0.0001]
Steps:  66%|██████▌   | 397/600 [24:36<09:22,  2.77s/it, loss=0.155, lr=0.0001]
Steps:  66%|██████▌   | 397/600 [24:38<09:22,  2.77s/it, loss=0.2, lr=0.0001]  
Steps:  66%|██████▋   | 398/600 [24:40<10:04,  2.99s/it, loss=0.2, lr=0.0001]
Steps:  66%|██████▋   | 398/600 [24:40<10:04,  2.99s/it, loss=0.111, lr=0.0001]
Steps:  66%|██████▋   | 398/600 [24:41<10:04,  2.99s/it, loss=0.147, lr=0.0001]
Steps:  66%|██████▋   | 399/600 [24:43<10:21,  3.09s/it, loss=0.147, lr=0.0001]
Steps:  66%|██████▋   | 399/600 [24:43<10:21,  3.09s/it, loss=0.0844, lr=0.0001]
Steps:  66%|██████▋   | 399/600 [24:45<10:21,  3.09s/it, loss=0.0488, lr=0.0001]
Steps:  67%|██████▋   | 400/600 [24:46<10:13,  3.07s/it, loss=0.0488, lr=0.0001]
Steps:  67%|██████▋   | 400/600 [24:46<10:13,  3.07s/it, loss=0.14, lr=0.0001]  
Steps:  67%|██████▋   | 400/600 [24:48<10:13,  3.07s/it, loss=0.0947, lr=0.0001]
Steps:  67%|██████▋   | 401/600 [24:50<10:33,  3.18s/it, loss=0.0947, lr=0.0001]
Steps:  67%|██████▋   | 401/600 [24:50<10:33,  3.18s/it, loss=0.00607, lr=0.0001]
Steps:  67%|██████▋   | 402/600 [24:50<08:06,  2.46s/it, loss=0.00607, lr=0.0001]
Steps:  67%|██████▋   | 402/600 [24:50<08:06,  2.46s/it, loss=0.0524, lr=0.0001] 
Steps:  67%|██████▋   | 402/600 [24:53<08:06,  2.46s/it, loss=0.195, lr=0.0001] 
Steps:  67%|██████▋   | 403/600 [24:54<09:43,  2.96s/it, loss=0.195, lr=0.0001]
Steps:  67%|██████▋   | 403/600 [24:54<09:43,  2.96s/it, loss=0.186, lr=0.0001]
Steps:  67%|██████▋   | 403/600 [24:56<09:43,  2.96s/it, loss=0.0417, lr=0.0001]
Steps:  67%|██████▋   | 404/600 [24:58<09:51,  3.02s/it, loss=0.0417, lr=0.0001]
Steps:  67%|██████▋   | 404/600 [24:58<09:51,  3.02s/it, loss=0.0558, lr=0.0001]
Steps:  67%|██████▋   | 404/600 [24:59<09:51,  3.02s/it, loss=0.174, lr=0.0001] 
Steps:  68%|██████▊   | 405/600 [25:01<09:53,  3.05s/it, loss=0.174, lr=0.0001]
Steps:  68%|██████▊   | 405/600 [25:01<09:53,  3.05s/it, loss=0.229, lr=0.0001]
Steps:  68%|██████▊   | 405/600 [25:02<09:53,  3.05s/it, loss=0.162, lr=0.0001]
Steps:  68%|██████▊   | 406/600 [25:04<10:16,  3.18s/it, loss=0.162, lr=0.0001]
Steps:  68%|██████▊   | 406/600 [25:04<10:16,  3.18s/it, loss=0.229, lr=0.0001]
Steps:  68%|██████▊   | 406/600 [25:06<10:16,  3.18s/it, loss=0.0346, lr=0.0001]
Steps:  68%|██████▊   | 407/600 [25:07<09:53,  3.08s/it, loss=0.0346, lr=0.0001]
Steps:  68%|██████▊   | 407/600 [25:07<09:53,  3.08s/it, loss=0.00984, lr=0.0001]
Steps:  68%|██████▊   | 408/600 [25:08<07:37,  2.38s/it, loss=0.00984, lr=0.0001]
Steps:  68%|██████▊   | 408/600 [25:08<07:37,  2.38s/it, loss=0.146, lr=0.0001]  
Steps:  68%|██████▊   | 408/600 [25:10<07:37,  2.38s/it, loss=0.313, lr=0.0001]
Steps:  68%|██████▊   | 409/600 [25:12<09:28,  2.97s/it, loss=0.313, lr=0.0001]
Steps:  68%|██████▊   | 409/600 [25:12<09:28,  2.97s/it, loss=0.133, lr=0.0001]
Steps:  68%|██████▊   | 409/600 [25:13<09:28,  2.97s/it, loss=0.0158, lr=0.0001]
Steps:  68%|██████▊   | 410/600 [25:15<09:18,  2.94s/it, loss=0.0158, lr=0.0001]
Steps:  68%|██████▊   | 410/600 [25:15<09:18,  2.94s/it, loss=0.0388, lr=0.0001]
Steps:  68%|██████▊   | 410/600 [25:17<09:18,  2.94s/it, loss=0.0305, lr=0.0001]
Steps:  68%|██████▊   | 411/600 [25:18<09:26,  3.00s/it, loss=0.0305, lr=0.0001]
Steps:  68%|██████▊   | 411/600 [25:18<09:26,  3.00s/it, loss=0.123, lr=0.0001] 
Steps:  68%|██████▊   | 411/600 [25:20<09:26,  3.00s/it, loss=0.203, lr=0.0001]
Steps:  69%|██████▊   | 412/600 [25:21<09:39,  3.08s/it, loss=0.203, lr=0.0001]
Steps:  69%|██████▊   | 412/600 [25:21<09:39,  3.08s/it, loss=0.116, lr=0.0001]
Steps:  69%|██████▊   | 412/600 [25:23<09:39,  3.08s/it, loss=0.0435, lr=0.0001]
Steps:  69%|██████▉   | 413/600 [25:25<09:35,  3.08s/it, loss=0.0435, lr=0.0001]
Steps:  69%|██████▉   | 413/600 [25:25<09:35,  3.08s/it, loss=0.0486, lr=0.0001]
Steps:  69%|██████▉   | 414/600 [25:25<07:23,  2.38s/it, loss=0.0486, lr=0.0001]
Steps:  69%|██████▉   | 414/600 [25:25<07:23,  2.38s/it, loss=0.0604, lr=0.0001]
Steps:  69%|██████▉   | 414/600 [25:28<07:23,  2.38s/it, loss=0.226, lr=0.0001] 
Steps:  69%|██████▉   | 415/600 [25:29<08:57,  2.90s/it, loss=0.226, lr=0.0001]
Steps:  69%|██████▉   | 415/600 [25:29<08:57,  2.90s/it, loss=0.189, lr=0.0001]
Steps:  69%|██████▉   | 415/600 [25:31<08:57,  2.90s/it, loss=0.0087, lr=0.0001]
Steps:  69%|██████▉   | 416/600 [25:32<09:02,  2.95s/it, loss=0.0087, lr=0.0001]
Steps:  69%|██████▉   | 416/600 [25:32<09:02,  2.95s/it, loss=0.178, lr=0.0001] 
Steps:  69%|██████▉   | 416/600 [25:34<09:02,  2.95s/it, loss=0.0359, lr=0.0001]
Steps:  70%|██████▉   | 417/600 [25:36<09:27,  3.10s/it, loss=0.0359, lr=0.0001]
Steps:  70%|██████▉   | 417/600 [25:36<09:27,  3.10s/it, loss=0.175, lr=0.0001] 
Steps:  70%|██████▉   | 417/600 [25:38<09:27,  3.10s/it, loss=0.0775, lr=0.0001]
Steps:  70%|██████▉   | 418/600 [25:39<09:38,  3.18s/it, loss=0.0775, lr=0.0001]
Steps:  70%|██████▉   | 418/600 [25:39<09:38,  3.18s/it, loss=0.0697, lr=0.0001]
Steps:  70%|██████▉   | 418/600 [25:41<09:38,  3.18s/it, loss=0.18, lr=0.0001]  
Steps:  70%|██████▉   | 419/600 [25:42<09:01,  2.99s/it, loss=0.18, lr=0.0001]
Steps:  70%|██████▉   | 419/600 [25:42<09:01,  2.99s/it, loss=0.0377, lr=0.0001]
Steps:  70%|███████   | 420/600 [25:43<06:59,  2.33s/it, loss=0.0377, lr=0.0001]
Steps:  70%|███████   | 420/600 [25:43<06:59,  2.33s/it, loss=0.238, lr=0.0001] 
Steps:  70%|███████   | 420/600 [25:45<06:59,  2.33s/it, loss=0.0763, lr=0.0001]
Steps:  70%|███████   | 421/600 [25:47<08:27,  2.84s/it, loss=0.0763, lr=0.0001]
Steps:  70%|███████   | 421/600 [25:47<08:27,  2.84s/it, loss=0.0165, lr=0.0001]
Steps:  70%|███████   | 421/600 [25:48<08:27,  2.84s/it, loss=0.0653, lr=0.0001]
Steps:  70%|███████   | 422/600 [25:50<08:59,  3.03s/it, loss=0.0653, lr=0.0001]
Steps:  70%|███████   | 422/600 [25:50<08:59,  3.03s/it, loss=0.0468, lr=0.0001]
Steps:  70%|███████   | 422/600 [25:52<08:59,  3.03s/it, loss=0.173, lr=0.0001] 
Steps:  70%|███████   | 423/600 [25:53<08:56,  3.03s/it, loss=0.173, lr=0.0001]
Steps:  70%|███████   | 423/600 [25:53<08:56,  3.03s/it, loss=0.169, lr=0.0001]
Steps:  70%|███████   | 423/600 [25:55<08:56,  3.03s/it, loss=0.0201, lr=0.0001]
Steps:  71%|███████   | 424/600 [25:57<09:18,  3.17s/it, loss=0.0201, lr=0.0001]
Steps:  71%|███████   | 424/600 [25:57<09:18,  3.17s/it, loss=0.181, lr=0.0001] 
Steps:  71%|███████   | 424/600 [25:58<09:18,  3.17s/it, loss=0.0856, lr=0.0001]
Steps:  71%|███████   | 425/600 [25:59<08:39,  2.97s/it, loss=0.0856, lr=0.0001]
Steps:  71%|███████   | 425/600 [25:59<08:39,  2.97s/it, loss=0.011, lr=0.0001] 
Steps:  71%|███████   | 426/600 [26:00<06:42,  2.31s/it, loss=0.011, lr=0.0001]
Steps:  71%|███████   | 426/600 [26:00<06:42,  2.31s/it, loss=0.00305, lr=0.0001]
Steps:  71%|███████   | 426/600 [26:02<06:42,  2.31s/it, loss=0.0355, lr=0.0001] 
Steps:  71%|███████   | 427/600 [26:03<07:37,  2.65s/it, loss=0.0355, lr=0.0001]
Steps:  71%|███████   | 427/600 [26:03<07:37,  2.65s/it, loss=0.0586, lr=0.0001]
Steps:  71%|███████   | 427/600 [26:05<07:37,  2.65s/it, loss=0.0247, lr=0.0001]
Steps:  71%|███████▏  | 428/600 [26:07<08:17,  2.89s/it, loss=0.0247, lr=0.0001]
Steps:  71%|███████▏  | 428/600 [26:07<08:17,  2.89s/it, loss=0.34, lr=0.0001]  
Steps:  71%|███████▏  | 428/600 [26:09<08:17,  2.89s/it, loss=0.138, lr=0.0001]
Steps:  72%|███████▏  | 429/600 [26:10<08:55,  3.13s/it, loss=0.138, lr=0.0001]
Steps:  72%|███████▏  | 429/600 [26:10<08:55,  3.13s/it, loss=0.269, lr=0.0001]
Steps:  72%|███████▏  | 429/600 [26:12<08:55,  3.13s/it, loss=0.154, lr=0.0001]
Steps:  72%|███████▏  | 430/600 [26:14<08:54,  3.14s/it, loss=0.154, lr=0.0001]
Steps:  72%|███████▏  | 430/600 [26:14<08:54,  3.14s/it, loss=0.113, lr=0.0001]
Steps:  72%|███████▏  | 430/600 [26:15<08:54,  3.14s/it, loss=0.0248, lr=0.0001]
Steps:  72%|███████▏  | 431/600 [26:17<08:39,  3.07s/it, loss=0.0248, lr=0.0001]
Steps:  72%|███████▏  | 431/600 [26:17<08:39,  3.07s/it, loss=0.14, lr=0.0001]  
Steps:  72%|███████▏  | 432/600 [26:17<06:40,  2.38s/it, loss=0.14, lr=0.0001]
Steps:  72%|███████▏  | 432/600 [26:17<06:40,  2.38s/it, loss=0.3, lr=0.0001] 
Steps:  72%|███████▏  | 432/600 [26:19<06:40,  2.38s/it, loss=0.276, lr=0.0001]
Steps:  72%|███████▏  | 433/600 [26:21<07:41,  2.76s/it, loss=0.276, lr=0.0001]
Steps:  72%|███████▏  | 433/600 [26:21<07:41,  2.76s/it, loss=0.0508, lr=0.0001]
Steps:  72%|███████▏  | 433/600 [26:22<07:41,  2.76s/it, loss=0.0166, lr=0.0001]
Steps:  72%|███████▏  | 434/600 [26:24<07:52,  2.85s/it, loss=0.0166, lr=0.0001]
Steps:  72%|███████▏  | 434/600 [26:24<07:52,  2.85s/it, loss=0.0412, lr=0.0001]
Steps:  72%|███████▏  | 434/600 [26:26<07:52,  2.85s/it, loss=0.144, lr=0.0001] 
Steps:  72%|███████▎  | 435/600 [26:28<08:22,  3.04s/it, loss=0.144, lr=0.0001]
Steps:  72%|███████▎  | 435/600 [26:28<08:22,  3.04s/it, loss=0.292, lr=0.0001]
Steps:  72%|███████▎  | 435/600 [26:29<08:22,  3.04s/it, loss=0.157, lr=0.0001]
Steps:  73%|███████▎  | 436/600 [26:31<08:26,  3.09s/it, loss=0.157, lr=0.0001]
Steps:  73%|███████▎  | 436/600 [26:31<08:26,  3.09s/it, loss=0.23, lr=0.0001] 
Steps:  73%|███████▎  | 436/600 [26:32<08:26,  3.09s/it, loss=0.0614, lr=0.0001]
Steps:  73%|███████▎  | 437/600 [26:34<08:25,  3.10s/it, loss=0.0614, lr=0.0001]
Steps:  73%|███████▎  | 437/600 [26:34<08:25,  3.10s/it, loss=0.0948, lr=0.0001]
Steps:  73%|███████▎  | 438/600 [26:35<06:29,  2.40s/it, loss=0.0948, lr=0.0001]
Steps:  73%|███████▎  | 438/600 [26:35<06:29,  2.40s/it, loss=0.0766, lr=0.0001]
Steps:  73%|███████▎  | 438/600 [26:37<06:29,  2.40s/it, loss=0.0121, lr=0.0001]
Steps:  73%|███████▎  | 439/600 [26:38<07:21,  2.74s/it, loss=0.0121, lr=0.0001]
Steps:  73%|███████▎  | 439/600 [26:38<07:21,  2.74s/it, loss=0.121, lr=0.0001] 
Steps:  73%|███████▎  | 439/600 [26:40<07:21,  2.74s/it, loss=0.138, lr=0.0001]
Steps:  73%|███████▎  | 440/600 [26:42<07:56,  2.98s/it, loss=0.138, lr=0.0001]
Steps:  73%|███████▎  | 440/600 [26:42<07:56,  2.98s/it, loss=0.165, lr=0.0001]
Steps:  73%|███████▎  | 440/600 [26:43<07:56,  2.98s/it, loss=0.0403, lr=0.0001]
Steps:  74%|███████▎  | 441/600 [26:45<07:57,  3.00s/it, loss=0.0403, lr=0.0001]
Steps:  74%|███████▎  | 441/600 [26:45<07:57,  3.00s/it, loss=0.045, lr=0.0001] 
Steps:  74%|███████▎  | 441/600 [26:46<07:57,  3.00s/it, loss=0.233, lr=0.0001]
Steps:  74%|███████▎  | 442/600 [26:48<08:04,  3.07s/it, loss=0.233, lr=0.0001]
Steps:  74%|███████▎  | 442/600 [26:48<08:04,  3.07s/it, loss=0.194, lr=0.0001]
Steps:  74%|███████▎  | 442/600 [26:50<08:04,  3.07s/it, loss=0.125, lr=0.0001]
Steps:  74%|███████▍  | 443/600 [26:51<08:02,  3.07s/it, loss=0.125, lr=0.0001]
Steps:  74%|███████▍  | 443/600 [26:51<08:02,  3.07s/it, loss=0.0115, lr=0.0001]
Steps:  74%|███████▍  | 444/600 [26:52<06:11,  2.38s/it, loss=0.0115, lr=0.0001]
Steps:  74%|███████▍  | 444/600 [26:52<06:11,  2.38s/it, loss=0.196, lr=0.0001] 
Steps:  74%|███████▍  | 444/600 [26:54<06:11,  2.38s/it, loss=0.0519, lr=0.0001]
Steps:  74%|███████▍  | 445/600 [26:56<07:15,  2.81s/it, loss=0.0519, lr=0.0001]
Steps:  74%|███████▍  | 445/600 [26:56<07:15,  2.81s/it, loss=0.123, lr=0.0001] 
Steps:  74%|███████▍  | 445/600 [26:57<07:15,  2.81s/it, loss=0.0067, lr=0.0001]
Steps:  74%|███████▍  | 446/600 [26:59<07:25,  2.89s/it, loss=0.0067, lr=0.0001]
Steps:  74%|███████▍  | 446/600 [26:59<07:25,  2.89s/it, loss=0.0214, lr=0.0001]
Steps:  74%|███████▍  | 446/600 [27:00<07:25,  2.89s/it, loss=0.0404, lr=0.0001]
Steps:  74%|███████▍  | 447/600 [27:02<07:37,  2.99s/it, loss=0.0404, lr=0.0001]
Steps:  74%|███████▍  | 447/600 [27:02<07:37,  2.99s/it, loss=0.112, lr=0.0001] 
Steps:  74%|███████▍  | 447/600 [27:04<07:37,  2.99s/it, loss=0.0661, lr=0.0001]
Steps:  75%|███████▍  | 448/600 [27:05<07:52,  3.11s/it, loss=0.0661, lr=0.0001]
Steps:  75%|███████▍  | 448/600 [27:05<07:52,  3.11s/it, loss=0.151, lr=0.0001] 
Steps:  75%|███████▍  | 448/600 [27:07<07:52,  3.11s/it, loss=0.0417, lr=0.0001]
Steps:  75%|███████▍  | 449/600 [27:08<07:48,  3.10s/it, loss=0.0417, lr=0.0001]
Steps:  75%|███████▍  | 449/600 [27:08<07:48,  3.10s/it, loss=0.271, lr=0.0001] 
Steps:  75%|███████▌  | 450/600 [27:09<06:00,  2.40s/it, loss=0.271, lr=0.0001]
Steps:  75%|███████▌  | 450/600 [27:09<06:00,  2.40s/it, loss=0.0121, lr=0.0001]
Steps:  75%|███████▌  | 450/600 [27:12<06:00,  2.40s/it, loss=0.18, lr=0.0001]  
Steps:  75%|███████▌  | 451/600 [27:13<07:08,  2.87s/it, loss=0.18, lr=0.0001]
Steps:  75%|███████▌  | 451/600 [27:13<07:08,  2.87s/it, loss=0.0983, lr=0.0001]
Steps:  75%|███████▌  | 451/600 [27:15<07:08,  2.87s/it, loss=0.14, lr=0.0001]  
Steps:  75%|███████▌  | 452/600 [27:16<07:23,  3.00s/it, loss=0.14, lr=0.0001]
Steps:  75%|███████▌  | 452/600 [27:16<07:23,  3.00s/it, loss=0.101, lr=0.0001]
Steps:  75%|███████▌  | 452/600 [27:18<07:23,  3.00s/it, loss=0.0466, lr=0.0001]
Steps:  76%|███████▌  | 453/600 [27:19<07:21,  3.00s/it, loss=0.0466, lr=0.0001]
Steps:  76%|███████▌  | 453/600 [27:19<07:21,  3.00s/it, loss=0.0158, lr=0.0001]
Steps:  76%|███████▌  | 453/600 [27:21<07:21,  3.00s/it, loss=0.17, lr=0.0001]  
Steps:  76%|███████▌  | 454/600 [27:23<07:30,  3.08s/it, loss=0.17, lr=0.0001]
Steps:  76%|███████▌  | 454/600 [27:23<07:30,  3.08s/it, loss=0.191, lr=0.0001]
Steps:  76%|███████▌  | 454/600 [27:24<07:30,  3.08s/it, loss=0.155, lr=0.0001]
Steps:  76%|███████▌  | 455/600 [27:26<07:16,  3.01s/it, loss=0.155, lr=0.0001]
Steps:  76%|███████▌  | 455/600 [27:26<07:16,  3.01s/it, loss=0.00915, lr=0.0001]
Steps:  76%|███████▌  | 456/600 [27:26<05:36,  2.33s/it, loss=0.00915, lr=0.0001]
Steps:  76%|███████▌  | 456/600 [27:26<05:36,  2.33s/it, loss=0.00596, lr=0.0001]
Steps:  76%|███████▌  | 456/600 [27:28<05:36,  2.33s/it, loss=0.235, lr=0.0001]  
Steps:  76%|███████▌  | 457/600 [27:30<06:38,  2.79s/it, loss=0.235, lr=0.0001]
Steps:  76%|███████▌  | 457/600 [27:30<06:38,  2.79s/it, loss=0.144, lr=0.0001]
Steps:  76%|███████▌  | 457/600 [27:32<06:38,  2.79s/it, loss=0.0893, lr=0.0001]
Steps:  76%|███████▋  | 458/600 [27:34<07:05,  3.00s/it, loss=0.0893, lr=0.0001]
Steps:  76%|███████▋  | 458/600 [27:34<07:05,  3.00s/it, loss=0.0258, lr=0.0001]
Steps:  76%|███████▋  | 458/600 [27:35<07:05,  3.00s/it, loss=0.0642, lr=0.0001]
Steps:  76%|███████▋  | 459/600 [27:37<07:10,  3.05s/it, loss=0.0642, lr=0.0001]
Steps:  76%|███████▋  | 459/600 [27:37<07:10,  3.05s/it, loss=0.0806, lr=0.0001]
Steps:  76%|███████▋  | 459/600 [27:38<07:10,  3.05s/it, loss=0.174, lr=0.0001] 
Steps:  77%|███████▋  | 460/600 [27:40<07:08,  3.06s/it, loss=0.174, lr=0.0001]
Steps:  77%|███████▋  | 460/600 [27:40<07:08,  3.06s/it, loss=0.154, lr=0.0001]
Steps:  77%|███████▋  | 460/600 [27:41<07:08,  3.06s/it, loss=0.0942, lr=0.0001]
Steps:  77%|███████▋  | 461/600 [27:43<07:00,  3.03s/it, loss=0.0942, lr=0.0001]
Steps:  77%|███████▋  | 461/600 [27:43<07:00,  3.03s/it, loss=0.0305, lr=0.0001]
Steps:  77%|███████▋  | 462/600 [27:44<05:23,  2.35s/it, loss=0.0305, lr=0.0001]
Steps:  77%|███████▋  | 462/600 [27:44<05:23,  2.35s/it, loss=0.0651, lr=0.0001]
Steps:  77%|███████▋  | 462/600 [27:46<05:23,  2.35s/it, loss=0.257, lr=0.0001] 
Steps:  77%|███████▋  | 463/600 [27:48<06:28,  2.83s/it, loss=0.257, lr=0.0001]
Steps:  77%|███████▋  | 463/600 [27:48<06:28,  2.83s/it, loss=0.145, lr=0.0001]
Steps:  77%|███████▋  | 463/600 [27:49<06:28,  2.83s/it, loss=0.0136, lr=0.0001]
Steps:  77%|███████▋  | 464/600 [27:51<06:45,  2.98s/it, loss=0.0136, lr=0.0001]
Steps:  77%|███████▋  | 464/600 [27:51<06:45,  2.98s/it, loss=0.157, lr=0.0001] 
Steps:  77%|███████▋  | 464/600 [27:52<06:45,  2.98s/it, loss=0.0468, lr=0.0001]
Steps:  78%|███████▊  | 465/600 [27:54<06:41,  2.98s/it, loss=0.0468, lr=0.0001]
Steps:  78%|███████▊  | 465/600 [27:54<06:41,  2.98s/it, loss=0.203, lr=0.0001] 
Steps:  78%|███████▊  | 465/600 [27:55<06:41,  2.98s/it, loss=0.127, lr=0.0001]
Steps:  78%|███████▊  | 466/600 [27:57<06:44,  3.02s/it, loss=0.127, lr=0.0001]
Steps:  78%|███████▊  | 466/600 [27:57<06:44,  3.02s/it, loss=0.272, lr=0.0001]
Steps:  78%|███████▊  | 466/600 [27:59<06:44,  3.02s/it, loss=0.0133, lr=0.0001]
Steps:  78%|███████▊  | 467/600 [28:00<06:44,  3.04s/it, loss=0.0133, lr=0.0001]
Steps:  78%|███████▊  | 467/600 [28:00<06:44,  3.04s/it, loss=0.195, lr=0.0001] 
Steps:  78%|███████▊  | 468/600 [28:01<05:11,  2.36s/it, loss=0.195, lr=0.0001]
Steps:  78%|███████▊  | 468/600 [28:01<05:11,  2.36s/it, loss=0.104, lr=0.0001]
Steps:  78%|███████▊  | 468/600 [28:03<05:11,  2.36s/it, loss=0.171, lr=0.0001]
Steps:  78%|███████▊  | 469/600 [28:05<06:16,  2.87s/it, loss=0.171, lr=0.0001]
Steps:  78%|███████▊  | 469/600 [28:05<06:16,  2.87s/it, loss=0.028, lr=0.0001]
Steps:  78%|███████▊  | 469/600 [28:06<06:16,  2.87s/it, loss=0.021, lr=0.0001]
Steps:  78%|███████▊  | 470/600 [28:08<06:20,  2.93s/it, loss=0.021, lr=0.0001]
Steps:  78%|███████▊  | 470/600 [28:08<06:20,  2.93s/it, loss=0.11, lr=0.0001] 
Steps:  78%|███████▊  | 470/600 [28:09<06:20,  2.93s/it, loss=0.19, lr=0.0001]
Steps:  78%|███████▊  | 471/600 [28:11<06:25,  2.99s/it, loss=0.19, lr=0.0001]
Steps:  78%|███████▊  | 471/600 [28:11<06:25,  2.99s/it, loss=0.172, lr=0.0001]
Steps:  78%|███████▊  | 471/600 [28:13<06:25,  2.99s/it, loss=0.0644, lr=0.0001]
Steps:  79%|███████▊  | 472/600 [28:14<06:30,  3.05s/it, loss=0.0644, lr=0.0001]
Steps:  79%|███████▊  | 472/600 [28:14<06:30,  3.05s/it, loss=0.287, lr=0.0001] 
Steps:  79%|███████▊  | 472/600 [28:16<06:30,  3.05s/it, loss=0.118, lr=0.0001]
Steps:  79%|███████▉  | 473/600 [28:17<06:27,  3.05s/it, loss=0.118, lr=0.0001]
Steps:  79%|███████▉  | 473/600 [28:17<06:27,  3.05s/it, loss=0.0193, lr=0.0001]
Steps:  79%|███████▉  | 474/600 [28:18<04:58,  2.37s/it, loss=0.0193, lr=0.0001]
Steps:  79%|███████▉  | 474/600 [28:18<04:58,  2.37s/it, loss=0.109, lr=0.0001] 
Steps:  79%|███████▉  | 474/600 [28:20<04:58,  2.37s/it, loss=0.031, lr=0.0001]
Steps:  79%|███████▉  | 475/600 [28:22<05:51,  2.81s/it, loss=0.031, lr=0.0001]
Steps:  79%|███████▉  | 475/600 [28:22<05:51,  2.81s/it, loss=0.134, lr=0.0001]
Steps:  79%|███████▉  | 475/600 [28:24<05:51,  2.81s/it, loss=0.0812, lr=0.0001]
Steps:  79%|███████▉  | 476/600 [28:25<06:11,  2.99s/it, loss=0.0812, lr=0.0001]
Steps:  79%|███████▉  | 476/600 [28:25<06:11,  2.99s/it, loss=0.054, lr=0.0001] 
Steps:  79%|███████▉  | 476/600 [28:27<06:11,  2.99s/it, loss=0.101, lr=0.0001]
Steps:  80%|███████▉  | 477/600 [28:29<06:11,  3.02s/it, loss=0.101, lr=0.0001]
Steps:  80%|███████▉  | 477/600 [28:29<06:11,  3.02s/it, loss=0.0783, lr=0.0001]
Steps:  80%|███████▉  | 477/600 [28:30<06:11,  3.02s/it, loss=0.0139, lr=0.0001]
Steps:  80%|███████▉  | 478/600 [28:32<06:21,  3.13s/it, loss=0.0139, lr=0.0001]
Steps:  80%|███████▉  | 478/600 [28:32<06:21,  3.13s/it, loss=0.161, lr=0.0001] 
Steps:  80%|███████▉  | 478/600 [28:33<06:21,  3.13s/it, loss=0.118, lr=0.0001]
Steps:  80%|███████▉  | 479/600 [28:35<06:08,  3.04s/it, loss=0.118, lr=0.0001]
Steps:  80%|███████▉  | 479/600 [28:35<06:08,  3.04s/it, loss=0.0334, lr=0.0001]
Steps:  80%|████████  | 480/600 [28:36<04:43,  2.36s/it, loss=0.0334, lr=0.0001]
Steps:  80%|████████  | 480/600 [28:36<04:43,  2.36s/it, loss=0.00538, lr=0.0001]
Steps:  80%|████████  | 480/600 [28:38<04:43,  2.36s/it, loss=0.103, lr=0.0001]  
Steps:  80%|████████  | 481/600 [28:39<05:39,  2.85s/it, loss=0.103, lr=0.0001]
Steps:  80%|████████  | 481/600 [28:39<05:39,  2.85s/it, loss=0.0385, lr=0.0001]
Steps:  80%|████████  | 481/600 [28:41<05:39,  2.85s/it, loss=0.116, lr=0.0001] 
Steps:  80%|████████  | 482/600 [28:43<05:54,  3.00s/it, loss=0.116, lr=0.0001]
Steps:  80%|████████  | 482/600 [28:43<05:54,  3.00s/it, loss=0.138, lr=0.0001]
Steps:  80%|████████  | 482/600 [28:44<05:54,  3.00s/it, loss=0.0592, lr=0.0001]
Steps:  80%|████████  | 483/600 [28:46<05:53,  3.02s/it, loss=0.0592, lr=0.0001]
Steps:  80%|████████  | 483/600 [28:46<05:53,  3.02s/it, loss=0.247, lr=0.0001] 
Steps:  80%|████████  | 483/600 [28:48<05:53,  3.02s/it, loss=0.121, lr=0.0001]
Steps:  81%|████████  | 484/600 [28:49<05:53,  3.04s/it, loss=0.121, lr=0.0001]
Steps:  81%|████████  | 484/600 [28:49<05:53,  3.04s/it, loss=0.134, lr=0.0001]
Steps:  81%|████████  | 484/600 [28:51<05:53,  3.04s/it, loss=0.184, lr=0.0001]
Steps:  81%|████████  | 485/600 [28:52<05:47,  3.03s/it, loss=0.184, lr=0.0001]
Steps:  81%|████████  | 485/600 [28:52<05:47,  3.03s/it, loss=0.0988, lr=0.0001]
Steps:  81%|████████  | 486/600 [28:53<04:27,  2.35s/it, loss=0.0988, lr=0.0001]
Steps:  81%|████████  | 486/600 [28:53<04:27,  2.35s/it, loss=0.011, lr=0.0001] 
Steps:  81%|████████  | 486/600 [28:55<04:27,  2.35s/it, loss=0.113, lr=0.0001]
Steps:  81%|████████  | 487/600 [28:57<05:18,  2.82s/it, loss=0.113, lr=0.0001]
Steps:  81%|████████  | 487/600 [28:57<05:18,  2.82s/it, loss=0.272, lr=0.0001]
Steps:  81%|████████  | 487/600 [28:58<05:18,  2.82s/it, loss=0.185, lr=0.0001]
Steps:  81%|████████▏ | 488/600 [29:00<05:33,  2.98s/it, loss=0.185, lr=0.0001]
Steps:  81%|████████▏ | 488/600 [29:00<05:33,  2.98s/it, loss=0.00689, lr=0.0001]
Steps:  81%|████████▏ | 488/600 [29:02<05:33,  2.98s/it, loss=0.0969, lr=0.0001] 
Steps:  82%|████████▏ | 489/600 [29:03<05:42,  3.09s/it, loss=0.0969, lr=0.0001]
Steps:  82%|████████▏ | 489/600 [29:03<05:42,  3.09s/it, loss=0.119, lr=0.0001] 
Steps:  82%|████████▏ | 489/600 [29:05<05:42,  3.09s/it, loss=0.00816, lr=0.0001]
Steps:  82%|████████▏ | 490/600 [29:07<05:41,  3.10s/it, loss=0.00816, lr=0.0001]
Steps:  82%|████████▏ | 490/600 [29:07<05:41,  3.10s/it, loss=0.176, lr=0.0001]  
Steps:  82%|████████▏ | 490/600 [29:08<05:41,  3.10s/it, loss=0.0127, lr=0.0001]
Steps:  82%|████████▏ | 491/600 [29:09<05:21,  2.95s/it, loss=0.0127, lr=0.0001]
Steps:  82%|████████▏ | 491/600 [29:09<05:21,  2.95s/it, loss=0.193, lr=0.0001] 
Steps:  82%|████████▏ | 492/600 [29:10<04:07,  2.29s/it, loss=0.193, lr=0.0001]
Steps:  82%|████████▏ | 492/600 [29:10<04:07,  2.29s/it, loss=0.0471, lr=0.0001]
Steps:  82%|████████▏ | 492/600 [29:12<04:07,  2.29s/it, loss=0.102, lr=0.0001] 
Steps:  82%|████████▏ | 493/600 [29:14<05:00,  2.81s/it, loss=0.102, lr=0.0001]
Steps:  82%|████████▏ | 493/600 [29:14<05:00,  2.81s/it, loss=0.264, lr=0.0001]
Steps:  82%|████████▏ | 493/600 [29:16<05:00,  2.81s/it, loss=0.139, lr=0.0001]
Steps:  82%|████████▏ | 494/600 [29:17<05:11,  2.94s/it, loss=0.139, lr=0.0001]
Steps:  82%|████████▏ | 494/600 [29:17<05:11,  2.94s/it, loss=0.123, lr=0.0001]
Steps:  82%|████████▏ | 494/600 [29:18<05:11,  2.94s/it, loss=0.162, lr=0.0001]
Steps:  82%|████████▎ | 495/600 [29:20<05:14,  2.99s/it, loss=0.162, lr=0.0001]
Steps:  82%|████████▎ | 495/600 [29:20<05:14,  2.99s/it, loss=0.152, lr=0.0001]
Steps:  82%|████████▎ | 495/600 [29:22<05:14,  2.99s/it, loss=0.105, lr=0.0001]
Steps:  83%|████████▎ | 496/600 [29:23<05:17,  3.05s/it, loss=0.105, lr=0.0001]
Steps:  83%|████████▎ | 496/600 [29:23<05:17,  3.05s/it, loss=0.0443, lr=0.0001]
Steps:  83%|████████▎ | 496/600 [29:25<05:17,  3.05s/it, loss=0.171, lr=0.0001] 
Steps:  83%|████████▎ | 497/600 [29:26<05:09,  3.00s/it, loss=0.171, lr=0.0001]
Steps:  83%|████████▎ | 497/600 [29:26<05:09,  3.00s/it, loss=0.0754, lr=0.0001]
Steps:  83%|████████▎ | 498/600 [29:27<03:57,  2.33s/it, loss=0.0754, lr=0.0001]
Steps:  83%|████████▎ | 498/600 [29:27<03:57,  2.33s/it, loss=0.0299, lr=0.0001]
Steps:  83%|████████▎ | 498/600 [29:29<03:57,  2.33s/it, loss=0.157, lr=0.0001] 
Steps:  83%|████████▎ | 499/600 [29:31<04:42,  2.80s/it, loss=0.157, lr=0.0001]
Steps:  83%|████████▎ | 499/600 [29:31<04:42,  2.80s/it, loss=0.247, lr=0.0001]
Steps:  83%|████████▎ | 499/600 [29:32<04:42,  2.80s/it, loss=0.199, lr=0.0001]
Steps:  83%|████████▎ | 500/600 [29:34<04:49,  2.89s/it, loss=0.199, lr=0.0001]10/12/2023 11:40:05 - INFO - accelerate.accelerator - Saving current state to logs/sweep_full_1_20231012111005/checkpoint-500
Model weights saved in logs/sweep_full_1_20231012111005/checkpoint-500/pytorch_lora_weights.safetensors
10/12/2023 11:40:06 - INFO - accelerate.checkpointing - Optimizer state saved in logs/sweep_full_1_20231012111005/checkpoint-500/optimizer.bin
10/12/2023 11:40:06 - INFO - accelerate.checkpointing - Scheduler state saved in logs/sweep_full_1_20231012111005/checkpoint-500/scheduler.bin
10/12/2023 11:40:06 - INFO - accelerate.checkpointing - Gradient scaler state saved in logs/sweep_full_1_20231012111005/checkpoint-500/scaler.pt
10/12/2023 11:40:06 - INFO - accelerate.checkpointing - Random states saved in logs/sweep_full_1_20231012111005/checkpoint-500/random_states_0.pkl
10/12/2023 11:40:06 - INFO - __main__ - Saved state to logs/sweep_full_1_20231012111005/checkpoint-500

Steps:  83%|████████▎ | 500/600 [29:35<04:49,  2.89s/it, loss=0.00583, lr=0.0001]
Steps:  83%|████████▎ | 500/600 [29:37<04:49,  2.89s/it, loss=0.163, lr=0.0001]  
Steps:  84%|████████▎ | 501/600 [29:38<05:28,  3.32s/it, loss=0.163, lr=0.0001]
Steps:  84%|████████▎ | 501/600 [29:38<05:28,  3.32s/it, loss=0.0607, lr=0.0001]
Steps:  84%|████████▎ | 501/600 [29:40<05:28,  3.32s/it, loss=0.146, lr=0.0001] 
Steps:  84%|████████▎ | 502/600 [29:42<05:19,  3.26s/it, loss=0.146, lr=0.0001]
Steps:  84%|████████▎ | 502/600 [29:42<05:19,  3.26s/it, loss=0.264, lr=0.0001]
Steps:  84%|████████▎ | 502/600 [29:43<05:19,  3.26s/it, loss=0.0609, lr=0.0001]
Steps:  84%|████████▍ | 503/600 [29:45<05:11,  3.21s/it, loss=0.0609, lr=0.0001]
Steps:  84%|████████▍ | 503/600 [29:45<05:11,  3.21s/it, loss=0.0979, lr=0.0001]
Steps:  84%|████████▍ | 504/600 [29:45<03:58,  2.48s/it, loss=0.0979, lr=0.0001]
Steps:  84%|████████▍ | 504/600 [29:45<03:58,  2.48s/it, loss=0.00293, lr=0.0001]
Steps:  84%|████████▍ | 504/600 [29:48<03:58,  2.48s/it, loss=0.17, lr=0.0001]   
Steps:  84%|████████▍ | 505/600 [29:49<04:33,  2.88s/it, loss=0.17, lr=0.0001]
Steps:  84%|████████▍ | 505/600 [29:49<04:33,  2.88s/it, loss=0.00444, lr=0.0001]
Steps:  84%|████████▍ | 505/600 [29:51<04:33,  2.88s/it, loss=0.12, lr=0.0001]   
Steps:  84%|████████▍ | 506/600 [29:53<04:43,  3.02s/it, loss=0.12, lr=0.0001]
Steps:  84%|████████▍ | 506/600 [29:53<04:43,  3.02s/it, loss=0.0495, lr=0.0001]
Steps:  84%|████████▍ | 506/600 [29:54<04:43,  3.02s/it, loss=0.164, lr=0.0001] 
Steps:  84%|████████▍ | 507/600 [29:56<04:45,  3.07s/it, loss=0.164, lr=0.0001]
Steps:  84%|████████▍ | 507/600 [29:56<04:45,  3.07s/it, loss=0.0124, lr=0.0001]
Steps:  84%|████████▍ | 507/600 [29:57<04:45,  3.07s/it, loss=0.0897, lr=0.0001]
Steps:  85%|████████▍ | 508/600 [29:59<04:41,  3.06s/it, loss=0.0897, lr=0.0001]
Steps:  85%|████████▍ | 508/600 [29:59<04:41,  3.06s/it, loss=0.158, lr=0.0001] 
Steps:  85%|████████▍ | 508/600 [30:00<04:41,  3.06s/it, loss=0.15, lr=0.0001] 
Steps:  85%|████████▍ | 509/600 [30:02<04:39,  3.07s/it, loss=0.15, lr=0.0001]
Steps:  85%|████████▍ | 509/600 [30:02<04:39,  3.07s/it, loss=0.0312, lr=0.0001]
Steps:  85%|████████▌ | 510/600 [30:03<03:34,  2.38s/it, loss=0.0312, lr=0.0001]
Steps:  85%|████████▌ | 510/600 [30:03<03:34,  2.38s/it, loss=0.122, lr=0.0001] 
Steps:  85%|████████▌ | 510/600 [30:05<03:34,  2.38s/it, loss=0.112, lr=0.0001]
Steps:  85%|████████▌ | 511/600 [30:07<04:12,  2.83s/it, loss=0.112, lr=0.0001]
Steps:  85%|████████▌ | 511/600 [30:07<04:12,  2.83s/it, loss=0.0764, lr=0.0001]
Steps:  85%|████████▌ | 511/600 [30:08<04:12,  2.83s/it, loss=0.143, lr=0.0001] 
Steps:  85%|████████▌ | 512/600 [30:10<04:17,  2.93s/it, loss=0.143, lr=0.0001]
Steps:  85%|████████▌ | 512/600 [30:10<04:17,  2.93s/it, loss=0.163, lr=0.0001]
Steps:  85%|████████▌ | 512/600 [30:11<04:17,  2.93s/it, loss=0.159, lr=0.0001]
Steps:  86%|████████▌ | 513/600 [30:13<04:27,  3.07s/it, loss=0.159, lr=0.0001]
Steps:  86%|████████▌ | 513/600 [30:13<04:27,  3.07s/it, loss=0.193, lr=0.0001]
Steps:  86%|████████▌ | 513/600 [30:15<04:27,  3.07s/it, loss=0.0811, lr=0.0001]
Steps:  86%|████████▌ | 514/600 [30:17<04:36,  3.22s/it, loss=0.0811, lr=0.0001]
Steps:  86%|████████▌ | 514/600 [30:17<04:36,  3.22s/it, loss=0.116, lr=0.0001] 
Steps:  86%|████████▌ | 514/600 [30:18<04:36,  3.22s/it, loss=0.169, lr=0.0001]
Steps:  86%|████████▌ | 515/600 [30:19<04:15,  3.01s/it, loss=0.169, lr=0.0001]
Steps:  86%|████████▌ | 515/600 [30:19<04:15,  3.01s/it, loss=0.0907, lr=0.0001]
Steps:  86%|████████▌ | 516/600 [30:20<03:16,  2.34s/it, loss=0.0907, lr=0.0001]
Steps:  86%|████████▌ | 516/600 [30:20<03:16,  2.34s/it, loss=0.122, lr=0.0001] 
Steps:  86%|████████▌ | 516/600 [30:22<03:16,  2.34s/it, loss=0.0368, lr=0.0001]
Steps:  86%|████████▌ | 517/600 [30:24<03:54,  2.83s/it, loss=0.0368, lr=0.0001]
Steps:  86%|████████▌ | 517/600 [30:24<03:54,  2.83s/it, loss=0.031, lr=0.0001] 
Steps:  86%|████████▌ | 517/600 [30:25<03:54,  2.83s/it, loss=0.0296, lr=0.0001]
Steps:  86%|████████▋ | 518/600 [30:27<04:01,  2.94s/it, loss=0.0296, lr=0.0001]
Steps:  86%|████████▋ | 518/600 [30:27<04:01,  2.94s/it, loss=0.0129, lr=0.0001]
Steps:  86%|████████▋ | 518/600 [30:29<04:01,  2.94s/it, loss=0.157, lr=0.0001] 
Steps:  86%|████████▋ | 519/600 [30:31<04:10,  3.09s/it, loss=0.157, lr=0.0001]
Steps:  86%|████████▋ | 519/600 [30:31<04:10,  3.09s/it, loss=0.0878, lr=0.0001]
Steps:  86%|████████▋ | 519/600 [30:32<04:10,  3.09s/it, loss=0.168, lr=0.0001] 
Steps:  87%|████████▋ | 520/600 [30:34<04:06,  3.08s/it, loss=0.168, lr=0.0001]
Steps:  87%|████████▋ | 520/600 [30:34<04:06,  3.08s/it, loss=0.0334, lr=0.0001]
Steps:  87%|████████▋ | 520/600 [30:35<04:06,  3.08s/it, loss=0.139, lr=0.0001] 
Steps:  87%|████████▋ | 521/600 [30:36<03:57,  3.00s/it, loss=0.139, lr=0.0001]
Steps:  87%|████████▋ | 521/600 [30:36<03:57,  3.00s/it, loss=0.17, lr=0.0001] 
Steps:  87%|████████▋ | 522/600 [30:37<03:01,  2.33s/it, loss=0.17, lr=0.0001]
Steps:  87%|████████▋ | 522/600 [30:37<03:01,  2.33s/it, loss=0.0291, lr=0.0001]
Steps:  87%|████████▋ | 522/600 [30:40<03:01,  2.33s/it, loss=0.105, lr=0.0001] 
Steps:  87%|████████▋ | 523/600 [30:41<03:39,  2.85s/it, loss=0.105, lr=0.0001]
Steps:  87%|████████▋ | 523/600 [30:41<03:39,  2.85s/it, loss=0.138, lr=0.0001]
Steps:  87%|████████▋ | 523/600 [30:43<03:39,  2.85s/it, loss=0.281, lr=0.0001]
Steps:  87%|████████▋ | 524/600 [30:45<03:48,  3.01s/it, loss=0.281, lr=0.0001]
Steps:  87%|████████▋ | 524/600 [30:45<03:48,  3.01s/it, loss=0.149, lr=0.0001]
Steps:  87%|████████▋ | 524/600 [30:46<03:48,  3.01s/it, loss=0.00434, lr=0.0001]
Steps:  88%|████████▊ | 525/600 [30:48<03:51,  3.08s/it, loss=0.00434, lr=0.0001]
Steps:  88%|████████▊ | 525/600 [30:48<03:51,  3.08s/it, loss=0.153, lr=0.0001]  
Steps:  88%|████████▊ | 525/600 [30:49<03:51,  3.08s/it, loss=0.193, lr=0.0001]
Steps:  88%|████████▊ | 526/600 [30:51<03:47,  3.08s/it, loss=0.193, lr=0.0001]
Steps:  88%|████████▊ | 526/600 [30:51<03:47,  3.08s/it, loss=0.0219, lr=0.0001]
Steps:  88%|████████▊ | 526/600 [30:52<03:47,  3.08s/it, loss=0.00755, lr=0.0001]
Steps:  88%|████████▊ | 527/600 [30:54<03:33,  2.93s/it, loss=0.00755, lr=0.0001]
Steps:  88%|████████▊ | 527/600 [30:54<03:33,  2.93s/it, loss=0.157, lr=0.0001]  
Steps:  88%|████████▊ | 528/600 [30:54<02:44,  2.28s/it, loss=0.157, lr=0.0001]
Steps:  88%|████████▊ | 528/600 [30:54<02:44,  2.28s/it, loss=0.0498, lr=0.0001]
Steps:  88%|████████▊ | 528/600 [30:57<02:44,  2.28s/it, loss=0.171, lr=0.0001] 
Steps:  88%|████████▊ | 529/600 [30:58<03:18,  2.79s/it, loss=0.171, lr=0.0001]
Steps:  88%|████████▊ | 529/600 [30:58<03:18,  2.79s/it, loss=0.0634, lr=0.0001]
Steps:  88%|████████▊ | 529/600 [31:00<03:18,  2.79s/it, loss=0.225, lr=0.0001] 
Steps:  88%|████████▊ | 530/600 [31:01<03:22,  2.89s/it, loss=0.225, lr=0.0001]
Steps:  88%|████████▊ | 530/600 [31:01<03:22,  2.89s/it, loss=0.0683, lr=0.0001]
Steps:  88%|████████▊ | 530/600 [31:03<03:22,  2.89s/it, loss=0.154, lr=0.0001] 
Steps:  88%|████████▊ | 531/600 [31:04<03:22,  2.94s/it, loss=0.154, lr=0.0001]
Steps:  88%|████████▊ | 531/600 [31:04<03:22,  2.94s/it, loss=0.192, lr=0.0001]
Steps:  88%|████████▊ | 531/600 [31:06<03:22,  2.94s/it, loss=0.0523, lr=0.0001]
Steps:  89%|████████▊ | 532/600 [31:08<03:28,  3.07s/it, loss=0.0523, lr=0.0001]
Steps:  89%|████████▊ | 532/600 [31:08<03:28,  3.07s/it, loss=0.0315, lr=0.0001]
Steps:  89%|████████▊ | 532/600 [31:09<03:28,  3.07s/it, loss=0.102, lr=0.0001] 
Steps:  89%|████████▉ | 533/600 [31:11<03:23,  3.04s/it, loss=0.102, lr=0.0001]
Steps:  89%|████████▉ | 533/600 [31:11<03:23,  3.04s/it, loss=0.0414, lr=0.0001]
Steps:  89%|████████▉ | 534/600 [31:12<02:35,  2.36s/it, loss=0.0414, lr=0.0001]
Steps:  89%|████████▉ | 534/600 [31:12<02:35,  2.36s/it, loss=0.0111, lr=0.0001]
Steps:  89%|████████▉ | 534/600 [31:14<02:35,  2.36s/it, loss=0.0114, lr=0.0001]
Steps:  89%|████████▉ | 535/600 [31:15<02:59,  2.77s/it, loss=0.0114, lr=0.0001]
Steps:  89%|████████▉ | 535/600 [31:15<02:59,  2.77s/it, loss=0.142, lr=0.0001] 
Steps:  89%|████████▉ | 535/600 [31:17<02:59,  2.77s/it, loss=0.158, lr=0.0001]
Steps:  89%|████████▉ | 536/600 [31:19<03:08,  2.95s/it, loss=0.158, lr=0.0001]
Steps:  89%|████████▉ | 536/600 [31:19<03:08,  2.95s/it, loss=0.223, lr=0.0001]
Steps:  89%|████████▉ | 536/600 [31:20<03:08,  2.95s/it, loss=0.107, lr=0.0001]
Steps:  90%|████████▉ | 537/600 [31:22<03:11,  3.05s/it, loss=0.107, lr=0.0001]
Steps:  90%|████████▉ | 537/600 [31:22<03:11,  3.05s/it, loss=0.128, lr=0.0001]
Steps:  90%|████████▉ | 537/600 [31:24<03:11,  3.05s/it, loss=0.0725, lr=0.0001]
Steps:  90%|████████▉ | 538/600 [31:25<03:10,  3.07s/it, loss=0.0725, lr=0.0001]
Steps:  90%|████████▉ | 538/600 [31:25<03:10,  3.07s/it, loss=0.0174, lr=0.0001]
Steps:  90%|████████▉ | 538/600 [31:27<03:10,  3.07s/it, loss=0.00654, lr=0.0001]
Steps:  90%|████████▉ | 539/600 [31:28<03:07,  3.08s/it, loss=0.00654, lr=0.0001]
Steps:  90%|████████▉ | 539/600 [31:28<03:07,  3.08s/it, loss=0.143, lr=0.0001]  
Steps:  90%|█████████ | 540/600 [31:29<02:22,  2.38s/it, loss=0.143, lr=0.0001]
Steps:  90%|█████████ | 540/600 [31:29<02:22,  2.38s/it, loss=0.037, lr=0.0001]
Steps:  90%|█████████ | 540/600 [31:31<02:22,  2.38s/it, loss=0.037, lr=0.0001]
Steps:  90%|█████████ | 541/600 [31:33<02:50,  2.88s/it, loss=0.037, lr=0.0001]
Steps:  90%|█████████ | 541/600 [31:33<02:50,  2.88s/it, loss=0.0258, lr=0.0001]
Steps:  90%|█████████ | 541/600 [31:34<02:50,  2.88s/it, loss=0.0943, lr=0.0001]
Steps:  90%|█████████ | 542/600 [31:36<02:49,  2.93s/it, loss=0.0943, lr=0.0001]
Steps:  90%|█████████ | 542/600 [31:36<02:49,  2.93s/it, loss=0.132, lr=0.0001] 
Steps:  90%|█████████ | 542/600 [31:38<02:49,  2.93s/it, loss=0.00318, lr=0.0001]
Steps:  90%|█████████ | 543/600 [31:40<02:57,  3.11s/it, loss=0.00318, lr=0.0001]
Steps:  90%|█████████ | 543/600 [31:40<02:57,  3.11s/it, loss=0.111, lr=0.0001]  
Steps:  90%|█████████ | 543/600 [31:41<02:57,  3.11s/it, loss=0.0121, lr=0.0001]
Steps:  91%|█████████ | 544/600 [31:43<02:56,  3.14s/it, loss=0.0121, lr=0.0001]
Steps:  91%|█████████ | 544/600 [31:43<02:56,  3.14s/it, loss=0.168, lr=0.0001] 
Steps:  91%|█████████ | 544/600 [31:44<02:56,  3.14s/it, loss=0.229, lr=0.0001]
Steps:  91%|█████████ | 545/600 [31:46<02:49,  3.09s/it, loss=0.229, lr=0.0001]
Steps:  91%|█████████ | 545/600 [31:46<02:49,  3.09s/it, loss=0.242, lr=0.0001]
Steps:  91%|█████████ | 546/600 [31:46<02:09,  2.39s/it, loss=0.242, lr=0.0001]
Steps:  91%|█████████ | 546/600 [31:46<02:09,  2.39s/it, loss=0.131, lr=0.0001]
Steps:  91%|█████████ | 546/600 [31:49<02:09,  2.39s/it, loss=0.272, lr=0.0001]
Steps:  91%|█████████ | 547/600 [31:50<02:31,  2.86s/it, loss=0.272, lr=0.0001]
Steps:  91%|█████████ | 547/600 [31:50<02:31,  2.86s/it, loss=0.0912, lr=0.0001]
Steps:  91%|█████████ | 547/600 [31:52<02:31,  2.86s/it, loss=0.115, lr=0.0001] 
Steps:  91%|█████████▏| 548/600 [31:54<02:35,  3.00s/it, loss=0.115, lr=0.0001]
Steps:  91%|█████████▏| 548/600 [31:54<02:35,  3.00s/it, loss=0.0357, lr=0.0001]
Steps:  91%|█████████▏| 548/600 [31:55<02:35,  3.00s/it, loss=0.164, lr=0.0001] 
Steps:  92%|█████████▏| 549/600 [31:57<02:39,  3.13s/it, loss=0.164, lr=0.0001]
Steps:  92%|█████████▏| 549/600 [31:57<02:39,  3.13s/it, loss=0.0656, lr=0.0001]
Steps:  92%|█████████▏| 549/600 [31:59<02:39,  3.13s/it, loss=0.0775, lr=0.0001]
Steps:  92%|█████████▏| 550/600 [32:00<02:31,  3.04s/it, loss=0.0775, lr=0.0001]
Steps:  92%|█████████▏| 550/600 [32:00<02:31,  3.04s/it, loss=0.115, lr=0.0001] 
Steps:  92%|█████████▏| 550/600 [32:02<02:31,  3.04s/it, loss=0.197, lr=0.0001]
Steps:  92%|█████████▏| 551/600 [32:03<02:29,  3.05s/it, loss=0.197, lr=0.0001]
Steps:  92%|█████████▏| 551/600 [32:03<02:29,  3.05s/it, loss=0.0554, lr=0.0001]
Steps:  92%|█████████▏| 552/600 [32:04<01:53,  2.37s/it, loss=0.0554, lr=0.0001]
Steps:  92%|█████████▏| 552/600 [32:04<01:53,  2.37s/it, loss=0.00706, lr=0.0001]
Steps:  92%|█████████▏| 552/600 [32:06<01:53,  2.37s/it, loss=0.182, lr=0.0001]  
Steps:  92%|█████████▏| 553/600 [32:07<02:06,  2.70s/it, loss=0.182, lr=0.0001]
Steps:  92%|█████████▏| 553/600 [32:07<02:06,  2.70s/it, loss=0.0952, lr=0.0001]
Steps:  92%|█████████▏| 553/600 [32:09<02:06,  2.70s/it, loss=0.0851, lr=0.0001]
Steps:  92%|█████████▏| 554/600 [32:11<02:15,  2.95s/it, loss=0.0851, lr=0.0001]
Steps:  92%|█████████▏| 554/600 [32:11<02:15,  2.95s/it, loss=0.198, lr=0.0001] 
Steps:  92%|█████████▏| 554/600 [32:13<02:15,  2.95s/it, loss=0.165, lr=0.0001]
Steps:  92%|█████████▎| 555/600 [32:14<02:19,  3.11s/it, loss=0.165, lr=0.0001]
Steps:  92%|█████████▎| 555/600 [32:14<02:19,  3.11s/it, loss=0.108, lr=0.0001]
Steps:  92%|█████████▎| 555/600 [32:16<02:19,  3.11s/it, loss=0.159, lr=0.0001]
Steps:  93%|█████████▎| 556/600 [32:17<02:16,  3.10s/it, loss=0.159, lr=0.0001]
Steps:  93%|█████████▎| 556/600 [32:17<02:16,  3.10s/it, loss=0.0584, lr=0.0001]
Steps:  93%|█████████▎| 556/600 [32:19<02:16,  3.10s/it, loss=0.0272, lr=0.0001]
Steps:  93%|█████████▎| 557/600 [32:20<02:10,  3.04s/it, loss=0.0272, lr=0.0001]
Steps:  93%|█████████▎| 557/600 [32:20<02:10,  3.04s/it, loss=0.00855, lr=0.0001]
Steps:  93%|█████████▎| 558/600 [32:21<01:39,  2.36s/it, loss=0.00855, lr=0.0001]
Steps:  93%|█████████▎| 558/600 [32:21<01:39,  2.36s/it, loss=0.126, lr=0.0001]  
Steps:  93%|█████████▎| 558/600 [32:23<01:39,  2.36s/it, loss=0.0966, lr=0.0001]
Steps:  93%|█████████▎| 559/600 [32:25<01:57,  2.87s/it, loss=0.0966, lr=0.0001]
Steps:  93%|█████████▎| 559/600 [32:25<01:57,  2.87s/it, loss=0.194, lr=0.0001] 
Steps:  93%|█████████▎| 559/600 [32:27<01:57,  2.87s/it, loss=0.109, lr=0.0001]
Steps:  93%|█████████▎| 560/600 [32:28<01:56,  2.90s/it, loss=0.109, lr=0.0001]
Steps:  93%|█████████▎| 560/600 [32:28<01:56,  2.90s/it, loss=0.0121, lr=0.0001]
Steps:  93%|█████████▎| 560/600 [32:30<01:56,  2.90s/it, loss=0.214, lr=0.0001] 
Steps:  94%|█████████▎| 561/600 [32:31<01:55,  2.96s/it, loss=0.214, lr=0.0001]
Steps:  94%|█████████▎| 561/600 [32:31<01:55,  2.96s/it, loss=0.109, lr=0.0001]
Steps:  94%|█████████▎| 561/600 [32:33<01:55,  2.96s/it, loss=0.0349, lr=0.0001]
Steps:  94%|█████████▎| 562/600 [32:35<02:00,  3.16s/it, loss=0.0349, lr=0.0001]
Steps:  94%|█████████▎| 562/600 [32:35<02:00,  3.16s/it, loss=0.113, lr=0.0001] 
Steps:  94%|█████████▎| 562/600 [32:36<02:00,  3.16s/it, loss=0.0175, lr=0.0001]
Steps:  94%|█████████▍| 563/600 [32:38<01:51,  3.01s/it, loss=0.0175, lr=0.0001]
Steps:  94%|█████████▍| 563/600 [32:38<01:51,  3.01s/it, loss=0.112, lr=0.0001] 
Steps:  94%|█████████▍| 564/600 [32:38<01:24,  2.34s/it, loss=0.112, lr=0.0001]
Steps:  94%|█████████▍| 564/600 [32:38<01:24,  2.34s/it, loss=0.00318, lr=0.0001]
Steps:  94%|█████████▍| 564/600 [32:40<01:24,  2.34s/it, loss=0.00633, lr=0.0001]
Steps:  94%|█████████▍| 565/600 [32:42<01:39,  2.83s/it, loss=0.00633, lr=0.0001]
Steps:  94%|█████████▍| 565/600 [32:42<01:39,  2.83s/it, loss=0.127, lr=0.0001]  
Steps:  94%|█████████▍| 565/600 [32:44<01:39,  2.83s/it, loss=0.0313, lr=0.0001]
Steps:  94%|█████████▍| 566/600 [32:45<01:39,  2.94s/it, loss=0.0313, lr=0.0001]
Steps:  94%|█████████▍| 566/600 [32:45<01:39,  2.94s/it, loss=0.121, lr=0.0001] 
Steps:  94%|█████████▍| 566/600 [32:47<01:39,  2.94s/it, loss=0.132, lr=0.0001]
Steps:  94%|█████████▍| 567/600 [32:49<01:40,  3.06s/it, loss=0.132, lr=0.0001]
Steps:  94%|█████████▍| 567/600 [32:49<01:40,  3.06s/it, loss=0.0486, lr=0.0001]
Steps:  94%|█████████▍| 567/600 [32:50<01:40,  3.06s/it, loss=0.0941, lr=0.0001]
Steps:  95%|█████████▍| 568/600 [32:52<01:37,  3.06s/it, loss=0.0941, lr=0.0001]
Steps:  95%|█████████▍| 568/600 [32:52<01:37,  3.06s/it, loss=0.141, lr=0.0001] 
Steps:  95%|█████████▍| 568/600 [32:53<01:37,  3.06s/it, loss=0.158, lr=0.0001]
Steps:  95%|█████████▍| 569/600 [32:55<01:33,  3.00s/it, loss=0.158, lr=0.0001]
Steps:  95%|█████████▍| 569/600 [32:55<01:33,  3.00s/it, loss=0.0147, lr=0.0001]
Steps:  95%|█████████▌| 570/600 [32:56<01:10,  2.33s/it, loss=0.0147, lr=0.0001]
Steps:  95%|█████████▌| 570/600 [32:56<01:10,  2.33s/it, loss=0.0541, lr=0.0001]
Steps:  95%|█████████▌| 570/600 [32:58<01:10,  2.33s/it, loss=0.152, lr=0.0001] 
Steps:  95%|█████████▌| 571/600 [32:59<01:21,  2.81s/it, loss=0.152, lr=0.0001]
Steps:  95%|█████████▌| 571/600 [32:59<01:21,  2.81s/it, loss=0.0919, lr=0.0001]
Steps:  95%|█████████▌| 571/600 [33:01<01:21,  2.81s/it, loss=0.182, lr=0.0001] 
Steps:  95%|█████████▌| 572/600 [33:03<01:23,  2.97s/it, loss=0.182, lr=0.0001]
Steps:  95%|█████████▌| 572/600 [33:03<01:23,  2.97s/it, loss=0.261, lr=0.0001]
Steps:  95%|█████████▌| 572/600 [33:04<01:23,  2.97s/it, loss=0.155, lr=0.0001]
Steps:  96%|█████████▌| 573/600 [33:06<01:19,  2.96s/it, loss=0.155, lr=0.0001]
Steps:  96%|█████████▌| 573/600 [33:06<01:19,  2.96s/it, loss=0.158, lr=0.0001]
Steps:  96%|█████████▌| 573/600 [33:07<01:19,  2.96s/it, loss=0.00502, lr=0.0001]
Steps:  96%|█████████▌| 574/600 [33:09<01:20,  3.10s/it, loss=0.00502, lr=0.0001]
Steps:  96%|█████████▌| 574/600 [33:09<01:20,  3.10s/it, loss=0.0951, lr=0.0001] 
Steps:  96%|█████████▌| 574/600 [33:11<01:20,  3.10s/it, loss=0.0412, lr=0.0001]
Steps:  96%|█████████▌| 575/600 [33:12<01:15,  3.02s/it, loss=0.0412, lr=0.0001]
Steps:  96%|█████████▌| 575/600 [33:12<01:15,  3.02s/it, loss=0.112, lr=0.0001] 
Steps:  96%|█████████▌| 576/600 [33:13<00:56,  2.35s/it, loss=0.112, lr=0.0001]
Steps:  96%|█████████▌| 576/600 [33:13<00:56,  2.35s/it, loss=0.00259, lr=0.0001]
Steps:  96%|█████████▌| 576/600 [33:15<00:56,  2.35s/it, loss=0.0537, lr=0.0001] 
Steps:  96%|█████████▌| 577/600 [33:17<01:05,  2.84s/it, loss=0.0537, lr=0.0001]
Steps:  96%|█████████▌| 577/600 [33:17<01:05,  2.84s/it, loss=0.144, lr=0.0001] 
Steps:  96%|█████████▌| 577/600 [33:18<01:05,  2.84s/it, loss=0.144, lr=0.0001]
Steps:  96%|█████████▋| 578/600 [33:20<01:04,  2.95s/it, loss=0.144, lr=0.0001]
Steps:  96%|█████████▋| 578/600 [33:20<01:04,  2.95s/it, loss=0.168, lr=0.0001]
Steps:  96%|█████████▋| 578/600 [33:22<01:04,  2.95s/it, loss=0.0829, lr=0.0001]
Steps:  96%|█████████▋| 579/600 [33:23<01:03,  3.04s/it, loss=0.0829, lr=0.0001]
Steps:  96%|█████████▋| 579/600 [33:23<01:03,  3.04s/it, loss=0.0108, lr=0.0001]
Steps:  96%|█████████▋| 579/600 [33:25<01:03,  3.04s/it, loss=0.263, lr=0.0001] 
Steps:  97%|█████████▋| 580/600 [33:26<01:01,  3.09s/it, loss=0.263, lr=0.0001]
Steps:  97%|█████████▋| 580/600 [33:26<01:01,  3.09s/it, loss=0.167, lr=0.0001]
Steps:  97%|█████████▋| 580/600 [33:28<01:01,  3.09s/it, loss=0.0834, lr=0.0001]
Steps:  97%|█████████▋| 581/600 [33:29<00:57,  3.02s/it, loss=0.0834, lr=0.0001]
Steps:  97%|█████████▋| 581/600 [33:29<00:57,  3.02s/it, loss=0.057, lr=0.0001] 
Steps:  97%|█████████▋| 582/600 [33:30<00:42,  2.35s/it, loss=0.057, lr=0.0001]
Steps:  97%|█████████▋| 582/600 [33:30<00:42,  2.35s/it, loss=0.0853, lr=0.0001]
Steps:  97%|█████████▋| 582/600 [33:32<00:42,  2.35s/it, loss=0.148, lr=0.0001] 
Steps:  97%|█████████▋| 583/600 [33:34<00:48,  2.86s/it, loss=0.148, lr=0.0001]
Steps:  97%|█████████▋| 583/600 [33:34<00:48,  2.86s/it, loss=0.063, lr=0.0001]
Steps:  97%|█████████▋| 583/600 [33:36<00:48,  2.86s/it, loss=0.0792, lr=0.0001]
Steps:  97%|█████████▋| 584/600 [33:38<00:48,  3.04s/it, loss=0.0792, lr=0.0001]
Steps:  97%|█████████▋| 584/600 [33:38<00:48,  3.04s/it, loss=0.0945, lr=0.0001]
Steps:  97%|█████████▋| 584/600 [33:39<00:48,  3.04s/it, loss=0.137, lr=0.0001] 
Steps:  98%|█████████▊| 585/600 [33:41<00:46,  3.09s/it, loss=0.137, lr=0.0001]
Steps:  98%|█████████▊| 585/600 [33:41<00:46,  3.09s/it, loss=0.0431, lr=0.0001]
Steps:  98%|█████████▊| 585/600 [33:43<00:46,  3.09s/it, loss=0.113, lr=0.0001] 
Steps:  98%|█████████▊| 586/600 [33:44<00:43,  3.11s/it, loss=0.113, lr=0.0001]
Steps:  98%|█████████▊| 586/600 [33:44<00:43,  3.11s/it, loss=0.0322, lr=0.0001]
Steps:  98%|█████████▊| 586/600 [33:45<00:43,  3.11s/it, loss=0.243, lr=0.0001] 
Steps:  98%|█████████▊| 587/600 [33:47<00:38,  2.97s/it, loss=0.243, lr=0.0001]
Steps:  98%|█████████▊| 587/600 [33:47<00:38,  2.97s/it, loss=0.0259, lr=0.0001]
Steps:  98%|█████████▊| 588/600 [33:47<00:27,  2.31s/it, loss=0.0259, lr=0.0001]
Steps:  98%|█████████▊| 588/600 [33:47<00:27,  2.31s/it, loss=0.161, lr=0.0001] 
Steps:  98%|█████████▊| 588/600 [33:49<00:27,  2.31s/it, loss=0.156, lr=0.0001]
Steps:  98%|█████████▊| 589/600 [33:51<00:29,  2.66s/it, loss=0.156, lr=0.0001]
Steps:  98%|█████████▊| 589/600 [33:51<00:29,  2.66s/it, loss=0.0241, lr=0.0001]
Steps:  98%|█████████▊| 589/600 [33:52<00:29,  2.66s/it, loss=0.217, lr=0.0001] 
Steps:  98%|█████████▊| 590/600 [33:54<00:29,  2.91s/it, loss=0.217, lr=0.0001]
Steps:  98%|█████████▊| 590/600 [33:54<00:29,  2.91s/it, loss=0.0712, lr=0.0001]
Steps:  98%|█████████▊| 590/600 [33:56<00:29,  2.91s/it, loss=0.165, lr=0.0001] 
Steps:  98%|█████████▊| 591/600 [33:58<00:27,  3.02s/it, loss=0.165, lr=0.0001]
Steps:  98%|█████████▊| 591/600 [33:58<00:27,  3.02s/it, loss=0.114, lr=0.0001]
Steps:  98%|█████████▊| 591/600 [33:59<00:27,  3.02s/it, loss=0.0601, lr=0.0001]
Steps:  99%|█████████▊| 592/600 [34:01<00:25,  3.14s/it, loss=0.0601, lr=0.0001]
Steps:  99%|█████████▊| 592/600 [34:01<00:25,  3.14s/it, loss=0.047, lr=0.0001] 
Steps:  99%|█████████▊| 592/600 [34:02<00:25,  3.14s/it, loss=0.181, lr=0.0001]
Steps:  99%|█████████▉| 593/600 [34:04<00:21,  3.01s/it, loss=0.181, lr=0.0001]
Steps:  99%|█████████▉| 593/600 [34:04<00:21,  3.01s/it, loss=0.176, lr=0.0001]
Steps:  99%|█████████▉| 594/600 [34:04<00:14,  2.34s/it, loss=0.176, lr=0.0001]
Steps:  99%|█████████▉| 594/600 [34:04<00:14,  2.34s/it, loss=0.0567, lr=0.0001]
Steps:  99%|█████████▉| 594/600 [34:07<00:14,  2.34s/it, loss=0.0499, lr=0.0001]
Steps:  99%|█████████▉| 595/600 [34:09<00:14,  2.88s/it, loss=0.0499, lr=0.0001]
Steps:  99%|█████████▉| 595/600 [34:09<00:14,  2.88s/it, loss=0.0317, lr=0.0001]
Steps:  99%|█████████▉| 595/600 [34:10<00:14,  2.88s/it, loss=0.0487, lr=0.0001]
Steps:  99%|█████████▉| 596/600 [34:12<00:11,  2.94s/it, loss=0.0487, lr=0.0001]
Steps:  99%|█████████▉| 596/600 [34:12<00:11,  2.94s/it, loss=0.193, lr=0.0001] 
Steps:  99%|█████████▉| 596/600 [34:13<00:11,  2.94s/it, loss=0.211, lr=0.0001]
Steps: 100%|█████████▉| 597/600 [34:15<00:09,  3.09s/it, loss=0.211, lr=0.0001]
Steps: 100%|█████████▉| 597/600 [34:15<00:09,  3.09s/it, loss=0.243, lr=0.0001]
Steps: 100%|█████████▉| 597/600 [34:17<00:09,  3.09s/it, loss=0.0466, lr=0.0001]
Steps: 100%|█████████▉| 598/600 [34:18<00:06,  3.11s/it, loss=0.0466, lr=0.0001]
Steps: 100%|█████████▉| 598/600 [34:18<00:06,  3.11s/it, loss=0.161, lr=0.0001] 
Steps: 100%|█████████▉| 598/600 [34:20<00:06,  3.11s/it, loss=0.0879, lr=0.0001]
Steps: 100%|█████████▉| 599/600 [34:21<00:02,  2.96s/it, loss=0.0879, lr=0.0001]
Steps: 100%|█████████▉| 599/600 [34:21<00:02,  2.96s/it, loss=0.134, lr=0.0001] 
Steps: 100%|██████████| 600/600 [34:22<00:00,  2.30s/it, loss=0.134, lr=0.0001]
Steps: 100%|██████████| 600/600 [34:22<00:00,  2.30s/it, loss=0.0545, lr=0.0001]Model weights saved in logs/sweep_full_1_20231012111005/pytorch_lora_weights.safetensors


Loading pipeline components...:   0%|          | 0/7 [00:00<?, ?it/s]Loaded tokenizer as CLIPTokenizer from `tokenizer` subfolder of stabilityai/stable-diffusion-xl-base-1.0.
Loaded text_encoder_2 as CLIPTextModelWithProjection from `text_encoder_2` subfolder of stabilityai/stable-diffusion-xl-base-1.0.


Loading pipeline components...:  29%|██▊       | 2/7 [00:01<00:02,  1.95it/s]Loaded scheduler as EulerDiscreteScheduler from `scheduler` subfolder of stabilityai/stable-diffusion-xl-base-1.0.
Loaded tokenizer_2 as CLIPTokenizer from `tokenizer_2` subfolder of stabilityai/stable-diffusion-xl-base-1.0.
Loaded text_encoder as CLIPTextModel from `text_encoder` subfolder of stabilityai/stable-diffusion-xl-base-1.0.


Loading pipeline components...:  86%|████████▌ | 6/7 [00:01<00:00,  5.16it/s]{'dropout', 'attention_type'} was not found in config. Values will be initialized to default values.
Loaded unet as UNet2DConditionModel from `unet` subfolder of stabilityai/stable-diffusion-xl-base-1.0.


Loading pipeline components...: 100%|██████████| 7/7 [00:04<00:00,  1.38it/s]
Loading pipeline components...: 100%|██████████| 7/7 [00:04<00:00,  1.72it/s]
{'dynamic_thresholding_ratio', 'solver_order', 'lower_order_final', 'lambda_min_clipped', 'solver_type', 'thresholding', 'algorithm_type', 'variance_type'} was not found in config. Values will be initialized to default values.
Loading unet.


  0%|          | 0/50 [00:00<?, ?it/s]

  2%|▏         | 1/50 [00:00<00:09,  5.41it/s]

  4%|▍         | 2/50 [00:00<00:07,  6.27it/s]

  6%|▌         | 3/50 [00:00<00:08,  5.79it/s]

  8%|▊         | 4/50 [00:00<00:08,  5.62it/s]

 10%|█         | 5/50 [00:00<00:08,  5.51it/s]

 12%|█▏        | 6/50 [00:01<00:08,  5.42it/s]

 14%|█▍        | 7/50 [00:01<00:07,  5.40it/s]

 16%|█▌        | 8/50 [00:01<00:07,  5.37it/s]

 18%|█▊        | 9/50 [00:01<00:07,  5.36it/s]

 20%|██        | 10/50 [00:01<00:07,  5.35it/s]

 22%|██▏       | 11/50 [00:02<00:07,  5.35it/s]

 24%|██▍       | 12/50 [00:02<00:07,  5.33it/s]

 26%|██▌       | 13/50 [00:02<00:06,  5.34it/s]

 28%|██▊       | 14/50 [00:02<00:06,  5.33it/s]

 30%|███       | 15/50 [00:02<00:06,  5.33it/s]

 32%|███▏      | 16/50 [00:02<00:06,  5.32it/s]

 34%|███▍      | 17/50 [00:03<00:06,  5.32it/s]

 36%|███▌      | 18/50 [00:03<00:06,  5.32it/s]

 38%|███▊      | 19/50 [00:03<00:05,  5.32it/s]

 40%|████      | 20/50 [00:03<00:05,  5.32it/s]

 42%|████▏     | 21/50 [00:03<00:05,  5.33it/s]

 44%|████▍     | 22/50 [00:04<00:05,  5.32it/s]

 46%|████▌     | 23/50 [00:04<00:05,  5.32it/s]

 48%|████▊     | 24/50 [00:04<00:04,  5.33it/s]

 50%|█████     | 25/50 [00:04<00:04,  5.33it/s]

 52%|█████▏    | 26/50 [00:04<00:04,  5.33it/s]

 54%|█████▍    | 27/50 [00:05<00:04,  5.32it/s]

 56%|█████▌    | 28/50 [00:05<00:04,  5.33it/s]

 58%|█████▊    | 29/50 [00:05<00:03,  5.33it/s]

 60%|██████    | 30/50 [00:05<00:03,  5.32it/s]

 62%|██████▏   | 31/50 [00:05<00:03,  5.32it/s]

 64%|██████▍   | 32/50 [00:05<00:03,  5.32it/s]

 66%|██████▌   | 33/50 [00:06<00:03,  5.33it/s]

 68%|██████▊   | 34/50 [00:06<00:03,  5.32it/s]

 70%|███████   | 35/50 [00:06<00:02,  5.32it/s]

 72%|███████▏  | 36/50 [00:06<00:02,  5.32it/s]

 74%|███████▍  | 37/50 [00:06<00:02,  5.33it/s]

 76%|███████▌  | 38/50 [00:07<00:02,  5.32it/s]

 78%|███████▊  | 39/50 [00:07<00:02,  5.32it/s]

 80%|████████  | 40/50 [00:07<00:01,  5.32it/s]

 82%|████████▏ | 41/50 [00:07<00:01,  5.32it/s]

 84%|████████▍ | 42/50 [00:07<00:01,  5.32it/s]

 86%|████████▌ | 43/50 [00:08<00:01,  5.32it/s]

 88%|████████▊ | 44/50 [00:08<00:01,  5.31it/s]

 90%|█████████ | 45/50 [00:08<00:00,  5.31it/s]

 92%|█████████▏| 46/50 [00:08<00:00,  5.31it/s]

 94%|█████████▍| 47/50 [00:08<00:00,  5.30it/s]

 96%|█████████▌| 48/50 [00:08<00:00,  5.30it/s]

 98%|█████████▊| 49/50 [00:09<00:00,  5.30it/s]

100%|██████████| 50/50 [00:09<00:00,  5.31it/s]
100%|██████████| 50/50 [00:09<00:00,  5.35it/s]


  0%|          | 0/50 [00:00<?, ?it/s]

  2%|▏         | 1/50 [00:00<00:09,  5.40it/s]

  4%|▍         | 2/50 [00:00<00:07,  6.23it/s]

  6%|▌         | 3/50 [00:00<00:08,  5.79it/s]

  8%|▊         | 4/50 [00:00<00:08,  5.59it/s]

 10%|█         | 5/50 [00:00<00:08,  5.48it/s]

 12%|█▏        | 6/50 [00:01<00:08,  5.40it/s]

 14%|█▍        | 7/50 [00:01<00:08,  5.36it/s]

 16%|█▌        | 8/50 [00:01<00:07,  5.35it/s]

 18%|█▊        | 9/50 [00:01<00:07,  5.34it/s]

 20%|██        | 10/50 [00:01<00:07,  5.33it/s]

 22%|██▏       | 11/50 [00:02<00:07,  5.32it/s]

 24%|██▍       | 12/50 [00:02<00:07,  5.30it/s]

 26%|██▌       | 13/50 [00:02<00:07,  5.28it/s]

 28%|██▊       | 14/50 [00:02<00:06,  5.31it/s]

 30%|███       | 15/50 [00:02<00:06,  5.30it/s]

 32%|███▏      | 16/50 [00:02<00:06,  5.31it/s]

 34%|███▍      | 17/50 [00:03<00:06,  5.30it/s]

 36%|███▌      | 18/50 [00:03<00:06,  5.30it/s]

 38%|███▊      | 19/50 [00:03<00:05,  5.31it/s]

 40%|████      | 20/50 [00:03<00:05,  5.30it/s]

 42%|████▏     | 21/50 [00:03<00:05,  5.31it/s]

 44%|████▍     | 22/50 [00:04<00:05,  5.31it/s]

 46%|████▌     | 23/50 [00:04<00:05,  5.30it/s]

 48%|████▊     | 24/50 [00:04<00:04,  5.31it/s]

 50%|█████     | 25/50 [00:04<00:04,  5.31it/s]

 52%|█████▏    | 26/50 [00:04<00:04,  5.29it/s]

 54%|█████▍    | 27/50 [00:05<00:04,  5.30it/s]

 56%|█████▌    | 28/50 [00:05<00:04,  5.29it/s]

 58%|█████▊    | 29/50 [00:05<00:03,  5.29it/s]

 60%|██████    | 30/50 [00:05<00:03,  5.29it/s]

 62%|██████▏   | 31/50 [00:05<00:03,  5.29it/s]

 64%|██████▍   | 32/50 [00:05<00:03,  5.29it/s]

 66%|██████▌   | 33/50 [00:06<00:03,  5.30it/s]

 68%|██████▊   | 34/50 [00:06<00:03,  5.30it/s]

 70%|███████   | 35/50 [00:06<00:02,  5.30it/s]

 72%|███████▏  | 36/50 [00:06<00:02,  5.30it/s]

 74%|███████▍  | 37/50 [00:06<00:02,  5.29it/s]

 76%|███████▌  | 38/50 [00:07<00:02,  5.29it/s]

 78%|███████▊  | 39/50 [00:07<00:02,  5.29it/s]

 80%|████████  | 40/50 [00:07<00:01,  5.29it/s]

 82%|████████▏ | 41/50 [00:07<00:01,  5.30it/s]

 84%|████████▍ | 42/50 [00:07<00:01,  5.30it/s]

 86%|████████▌ | 43/50 [00:08<00:01,  5.30it/s]

 88%|████████▊ | 44/50 [00:08<00:01,  5.30it/s]

 90%|█████████ | 45/50 [00:08<00:00,  5.30it/s]

 92%|█████████▏| 46/50 [00:08<00:00,  5.28it/s]

 94%|█████████▍| 47/50 [00:08<00:00,  5.29it/s]

 96%|█████████▌| 48/50 [00:09<00:00,  5.29it/s]

 98%|█████████▊| 49/50 [00:09<00:00,  5.29it/s]

100%|██████████| 50/50 [00:09<00:00,  5.29it/s]
100%|██████████| 50/50 [00:09<00:00,  5.32it/s]


  0%|          | 0/50 [00:00<?, ?it/s]

  2%|▏         | 1/50 [00:00<00:09,  5.39it/s]

  4%|▍         | 2/50 [00:00<00:07,  6.21it/s]

  6%|▌         | 3/50 [00:00<00:08,  5.76it/s]

  8%|▊         | 4/50 [00:00<00:08,  5.56it/s]

 10%|█         | 5/50 [00:00<00:08,  5.46it/s]

 12%|█▏        | 6/50 [00:01<00:08,  5.40it/s]

 14%|█▍        | 7/50 [00:01<00:08,  5.37it/s]

 16%|█▌        | 8/50 [00:01<00:07,  5.34it/s]

 18%|█▊        | 9/50 [00:01<00:07,  5.32it/s]

 20%|██        | 10/50 [00:01<00:07,  5.32it/s]

 22%|██▏       | 11/50 [00:02<00:07,  5.31it/s]

 24%|██▍       | 12/50 [00:02<00:07,  5.31it/s]

 26%|██▌       | 13/50 [00:02<00:06,  5.31it/s]

 28%|██▊       | 14/50 [00:02<00:06,  5.30it/s]

 30%|███       | 15/50 [00:02<00:06,  5.29it/s]

 32%|███▏      | 16/50 [00:02<00:06,  5.30it/s]

 34%|███▍      | 17/50 [00:03<00:06,  5.30it/s]

 36%|███▌      | 18/50 [00:03<00:06,  5.29it/s]

 38%|███▊      | 19/50 [00:03<00:05,  5.29it/s]

 40%|████      | 20/50 [00:03<00:05,  5.29it/s]

 42%|████▏     | 21/50 [00:03<00:05,  5.29it/s]

 44%|████▍     | 22/50 [00:04<00:05,  5.29it/s]

 46%|████▌     | 23/50 [00:04<00:05,  5.30it/s]

 48%|████▊     | 24/50 [00:04<00:04,  5.29it/s]

 50%|█████     | 25/50 [00:04<00:04,  5.28it/s]

 52%|█████▏    | 26/50 [00:04<00:04,  5.28it/s]

 54%|█████▍    | 27/50 [00:05<00:04,  5.28it/s]

 56%|█████▌    | 28/50 [00:05<00:04,  5.28it/s]

 58%|█████▊    | 29/50 [00:05<00:03,  5.28it/s]

 60%|██████    | 30/50 [00:05<00:03,  5.28it/s]

 62%|██████▏   | 31/50 [00:05<00:03,  5.29it/s]

 64%|██████▍   | 32/50 [00:06<00:03,  5.29it/s]

 66%|██████▌   | 33/50 [00:06<00:03,  5.29it/s]

 68%|██████▊   | 34/50 [00:06<00:03,  5.29it/s]

 70%|███████   | 35/50 [00:06<00:02,  5.29it/s]

 72%|███████▏  | 36/50 [00:06<00:02,  5.30it/s]

 74%|███████▍  | 37/50 [00:06<00:02,  5.30it/s]

 76%|███████▌  | 38/50 [00:07<00:02,  5.30it/s]

 78%|███████▊  | 39/50 [00:07<00:02,  5.30it/s]

 80%|████████  | 40/50 [00:07<00:01,  5.30it/s]

 82%|████████▏ | 41/50 [00:07<00:01,  5.30it/s]

 84%|████████▍ | 42/50 [00:07<00:01,  5.29it/s]

 86%|████████▌ | 43/50 [00:08<00:01,  5.29it/s]

 88%|████████▊ | 44/50 [00:08<00:01,  5.29it/s]

 90%|█████████ | 45/50 [00:08<00:00,  5.29it/s]

 92%|█████████▏| 46/50 [00:08<00:00,  5.30it/s]

 94%|█████████▍| 47/50 [00:08<00:00,  5.28it/s]

 96%|█████████▌| 48/50 [00:09<00:00,  5.28it/s]

 98%|█████████▊| 49/50 [00:09<00:00,  5.29it/s]

100%|██████████| 50/50 [00:09<00:00,  5.28it/s]
100%|██████████| 50/50 [00:09<00:00,  5.32it/s]


  0%|          | 0/50 [00:00<?, ?it/s]

  2%|▏         | 1/50 [00:00<00:09,  5.39it/s]

  4%|▍         | 2/50 [00:00<00:07,  6.21it/s]

  6%|▌         | 3/50 [00:00<00:08,  5.75it/s]

  8%|▊         | 4/50 [00:00<00:08,  5.56it/s]

 10%|█         | 5/50 [00:00<00:08,  5.47it/s]

 12%|█▏        | 6/50 [00:01<00:08,  5.40it/s]

 14%|█▍        | 7/50 [00:01<00:08,  5.36it/s]

 16%|█▌        | 8/50 [00:01<00:07,  5.34it/s]

 18%|█▊        | 9/50 [00:01<00:07,  5.32it/s]

 20%|██        | 10/50 [00:01<00:07,  5.31it/s]

 22%|██▏       | 11/50 [00:02<00:07,  5.30it/s]

 24%|██▍       | 12/50 [00:02<00:07,  5.30it/s]

 26%|██▌       | 13/50 [00:02<00:06,  5.29it/s]

 28%|██▊       | 14/50 [00:02<00:06,  5.29it/s]

 30%|███       | 15/50 [00:02<00:06,  5.30it/s]

 32%|███▏      | 16/50 [00:02<00:06,  5.29it/s]

 34%|███▍      | 17/50 [00:03<00:06,  5.28it/s]

 36%|███▌      | 18/50 [00:03<00:06,  5.28it/s]

 38%|███▊      | 19/50 [00:03<00:05,  5.28it/s]

 40%|████      | 20/50 [00:03<00:05,  5.28it/s]

 42%|████▏     | 21/50 [00:03<00:05,  5.28it/s]

 44%|████▍     | 22/50 [00:04<00:05,  5.28it/s]

 46%|████▌     | 23/50 [00:04<00:05,  5.28it/s]

 48%|████▊     | 24/50 [00:04<00:04,  5.28it/s]

 50%|█████     | 25/50 [00:04<00:04,  5.28it/s]

 52%|█████▏    | 26/50 [00:04<00:04,  5.28it/s]

 54%|█████▍    | 27/50 [00:05<00:04,  5.29it/s]

 56%|█████▌    | 28/50 [00:05<00:04,  5.29it/s]

 58%|█████▊    | 29/50 [00:05<00:03,  5.28it/s]

 60%|██████    | 30/50 [00:05<00:03,  5.28it/s]

 62%|██████▏   | 31/50 [00:05<00:03,  5.29it/s]

 64%|██████▍   | 32/50 [00:06<00:03,  5.28it/s]

 66%|██████▌   | 33/50 [00:06<00:03,  5.27it/s]

 68%|██████▊   | 34/50 [00:06<00:03,  5.28it/s]

 70%|███████   | 35/50 [00:06<00:02,  5.28it/s]

 72%|███████▏  | 36/50 [00:06<00:02,  5.28it/s]

 74%|███████▍  | 37/50 [00:06<00:02,  5.28it/s]

 76%|███████▌  | 38/50 [00:07<00:02,  5.28it/s]

 78%|███████▊  | 39/50 [00:07<00:02,  3.77it/s]

 80%|████████  | 40/50 [00:07<00:02,  4.13it/s]

 82%|████████▏ | 41/50 [00:07<00:02,  4.42it/s]

 84%|████████▍ | 42/50 [00:08<00:01,  4.65it/s]

 86%|████████▌ | 43/50 [00:08<00:01,  4.82it/s]

 88%|████████▊ | 44/50 [00:08<00:01,  4.94it/s]

 90%|█████████ | 45/50 [00:08<00:00,  5.04it/s]

 92%|█████████▏| 46/50 [00:08<00:00,  5.12it/s]

 94%|█████████▍| 47/50 [00:09<00:00,  5.16it/s]

 96%|█████████▌| 48/50 [00:09<00:00,  5.20it/s]

 98%|█████████▊| 49/50 [00:09<00:00,  5.22it/s]

100%|██████████| 50/50 [00:09<00:00,  5.23it/s]
100%|██████████| 50/50 [00:09<00:00,  5.17it/s]
10/12/2023 11:45:49 - INFO - __main__ - Image features shape: torch.Size([5, 75648])


  0%|          | 0/50 [00:00<?, ?it/s]

  2%|▏         | 1/50 [00:00<00:09,  5.42it/s]

  4%|▍         | 2/50 [00:00<00:07,  6.23it/s]

  6%|▌         | 3/50 [00:00<00:08,  5.77it/s]

  8%|▊         | 4/50 [00:00<00:08,  5.59it/s]

 10%|█         | 5/50 [00:00<00:08,  5.49it/s]

 12%|█▏        | 6/50 [00:01<00:08,  5.43it/s]

 14%|█▍        | 7/50 [00:01<00:07,  5.40it/s]

 16%|█▌        | 8/50 [00:01<00:07,  5.37it/s]

 18%|█▊        | 9/50 [00:01<00:07,  5.35it/s]

 20%|██        | 10/50 [00:01<00:07,  5.34it/s]

 22%|██▏       | 11/50 [00:02<00:07,  5.33it/s]

 24%|██▍       | 12/50 [00:02<00:07,  5.34it/s]

 26%|██▌       | 13/50 [00:02<00:06,  5.33it/s]

 28%|██▊       | 14/50 [00:02<00:06,  5.33it/s]

 30%|███       | 15/50 [00:02<00:06,  5.34it/s]

 32%|███▏      | 16/50 [00:02<00:06,  5.33it/s]

 34%|███▍      | 17/50 [00:03<00:06,  5.31it/s]

 36%|███▌      | 18/50 [00:03<00:06,  5.32it/s]

 38%|███▊      | 19/50 [00:03<00:05,  5.32it/s]

 40%|████      | 20/50 [00:03<00:05,  5.30it/s]

 42%|████▏     | 21/50 [00:03<00:05,  5.30it/s]

 44%|████▍     | 22/50 [00:04<00:05,  5.29it/s]

 46%|████▌     | 23/50 [00:04<00:05,  5.29it/s]

 48%|████▊     | 24/50 [00:04<00:04,  5.29it/s]

 50%|█████     | 25/50 [00:04<00:04,  5.29it/s]

 52%|█████▏    | 26/50 [00:04<00:04,  5.30it/s]

 54%|█████▍    | 27/50 [00:05<00:04,  5.30it/s]

 56%|█████▌    | 28/50 [00:05<00:04,  5.30it/s]

 58%|█████▊    | 29/50 [00:05<00:03,  5.30it/s]

 60%|██████    | 30/50 [00:05<00:03,  5.31it/s]

 62%|██████▏   | 31/50 [00:05<00:03,  5.31it/s]

 64%|██████▍   | 32/50 [00:05<00:03,  5.30it/s]

 66%|██████▌   | 33/50 [00:06<00:03,  5.30it/s]

 68%|██████▊   | 34/50 [00:06<00:03,  5.29it/s]

 70%|███████   | 35/50 [00:06<00:02,  5.29it/s]

 72%|███████▏  | 36/50 [00:06<00:02,  5.29it/s]

 74%|███████▍  | 37/50 [00:06<00:02,  5.29it/s]

 76%|███████▌  | 38/50 [00:07<00:02,  5.29it/s]

 78%|███████▊  | 39/50 [00:07<00:02,  5.29it/s]

 80%|████████  | 40/50 [00:07<00:01,  5.28it/s]

 82%|████████▏ | 41/50 [00:07<00:01,  5.28it/s]

 84%|████████▍ | 42/50 [00:07<00:01,  5.29it/s]

 86%|████████▌ | 43/50 [00:08<00:01,  5.28it/s]

 88%|████████▊ | 44/50 [00:08<00:01,  5.29it/s]

 90%|█████████ | 45/50 [00:08<00:00,  5.28it/s]

 92%|█████████▏| 46/50 [00:08<00:00,  5.28it/s]

 94%|█████████▍| 47/50 [00:08<00:00,  5.28it/s]

 96%|█████████▌| 48/50 [00:09<00:00,  5.29it/s]

 98%|█████████▊| 49/50 [00:09<00:00,  5.29it/s]

100%|██████████| 50/50 [00:09<00:00,  5.29it/s]
100%|██████████| 50/50 [00:09<00:00,  5.33it/s]


  0%|          | 0/50 [00:00<?, ?it/s]

  2%|▏         | 1/50 [00:00<00:09,  5.39it/s]

  4%|▍         | 2/50 [00:00<00:07,  6.20it/s]

  6%|▌         | 3/50 [00:00<00:08,  5.74it/s]

  8%|▊         | 4/50 [00:00<00:08,  5.55it/s]

 10%|█         | 5/50 [00:00<00:08,  5.44it/s]

 12%|█▏        | 6/50 [00:01<00:08,  5.38it/s]

 14%|█▍        | 7/50 [00:01<00:08,  5.35it/s]

 16%|█▌        | 8/50 [00:01<00:07,  5.33it/s]

 18%|█▊        | 9/50 [00:01<00:07,  5.31it/s]

 20%|██        | 10/50 [00:01<00:07,  5.30it/s]

 22%|██▏       | 11/50 [00:02<00:07,  5.30it/s]

 24%|██▍       | 12/50 [00:02<00:07,  5.29it/s]

 26%|██▌       | 13/50 [00:02<00:06,  5.29it/s]

 28%|██▊       | 14/50 [00:02<00:06,  5.28it/s]

 30%|███       | 15/50 [00:02<00:06,  5.29it/s]

 32%|███▏      | 16/50 [00:02<00:06,  5.29it/s]

 34%|███▍      | 17/50 [00:03<00:06,  5.30it/s]

 36%|███▌      | 18/50 [00:03<00:06,  5.29it/s]

 38%|███▊      | 19/50 [00:03<00:05,  5.29it/s]

 40%|████      | 20/50 [00:03<00:05,  5.28it/s]

 42%|████▏     | 21/50 [00:03<00:05,  5.28it/s]

 44%|████▍     | 22/50 [00:04<00:05,  5.28it/s]

 46%|████▌     | 23/50 [00:04<00:05,  5.29it/s]

 48%|████▊     | 24/50 [00:04<00:04,  5.29it/s]

 50%|█████     | 25/50 [00:04<00:04,  5.29it/s]

 52%|█████▏    | 26/50 [00:04<00:04,  5.29it/s]

 54%|█████▍    | 27/50 [00:05<00:04,  5.28it/s]

 56%|█████▌    | 28/50 [00:05<00:04,  5.29it/s]

 58%|█████▊    | 29/50 [00:05<00:03,  5.29it/s]

 60%|██████    | 30/50 [00:05<00:03,  5.29it/s]

 62%|██████▏   | 31/50 [00:05<00:03,  5.28it/s]

 64%|██████▍   | 32/50 [00:06<00:03,  5.28it/s]

 66%|██████▌   | 33/50 [00:06<00:03,  5.28it/s]

 68%|██████▊   | 34/50 [00:06<00:03,  5.28it/s]

 70%|███████   | 35/50 [00:06<00:02,  5.28it/s]

 72%|███████▏  | 36/50 [00:06<00:02,  5.28it/s]

 74%|███████▍  | 37/50 [00:06<00:02,  5.27it/s]

 76%|███████▌  | 38/50 [00:07<00:02,  5.27it/s]

 78%|███████▊  | 39/50 [00:07<00:02,  5.27it/s]

 80%|████████  | 40/50 [00:07<00:01,  5.27it/s]

 82%|████████▏ | 41/50 [00:07<00:01,  5.27it/s]

 84%|████████▍ | 42/50 [00:07<00:01,  5.27it/s]

 86%|████████▌ | 43/50 [00:08<00:01,  5.27it/s]

 88%|████████▊ | 44/50 [00:08<00:01,  5.27it/s]

 90%|█████████ | 45/50 [00:08<00:00,  5.28it/s]

 92%|█████████▏| 46/50 [00:08<00:00,  5.28it/s]

 94%|█████████▍| 47/50 [00:08<00:00,  5.28it/s]

 96%|█████████▌| 48/50 [00:09<00:00,  5.28it/s]

 98%|█████████▊| 49/50 [00:09<00:00,  5.28it/s]

100%|██████████| 50/50 [00:09<00:00,  5.28it/s]
100%|██████████| 50/50 [00:09<00:00,  5.31it/s]


  0%|          | 0/50 [00:00<?, ?it/s]

  2%|▏         | 1/50 [00:00<00:09,  5.38it/s]

  4%|▍         | 2/50 [00:00<00:07,  6.19it/s]

  6%|▌         | 3/50 [00:00<00:08,  5.73it/s]

  8%|▊         | 4/50 [00:00<00:08,  5.54it/s]

 10%|█         | 5/50 [00:00<00:08,  5.45it/s]

 12%|█▏        | 6/50 [00:01<00:08,  5.39it/s]

 14%|█▍        | 7/50 [00:01<00:08,  5.35it/s]

 16%|█▌        | 8/50 [00:01<00:07,  5.33it/s]

 18%|█▊        | 9/50 [00:01<00:07,  5.32it/s]

 20%|██        | 10/50 [00:01<00:07,  5.30it/s]

 22%|██▏       | 11/50 [00:02<00:07,  5.29it/s]

 24%|██▍       | 12/50 [00:02<00:07,  5.30it/s]

 26%|██▌       | 13/50 [00:02<00:06,  5.29it/s]

 28%|██▊       | 14/50 [00:02<00:06,  5.29it/s]

 30%|███       | 15/50 [00:02<00:06,  5.29it/s]

 32%|███▏      | 16/50 [00:02<00:06,  5.29it/s]

 34%|███▍      | 17/50 [00:03<00:06,  5.29it/s]

 36%|███▌      | 18/50 [00:03<00:06,  5.29it/s]

 38%|███▊      | 19/50 [00:03<00:05,  5.28it/s]

 40%|████      | 20/50 [00:03<00:05,  5.29it/s]

 42%|████▏     | 21/50 [00:03<00:05,  5.28it/s]

 44%|████▍     | 22/50 [00:04<00:05,  5.28it/s]

 46%|████▌     | 23/50 [00:04<00:05,  5.28it/s]

 48%|████▊     | 24/50 [00:04<00:04,  5.28it/s]

 50%|█████     | 25/50 [00:04<00:04,  5.28it/s]

 52%|█████▏    | 26/50 [00:04<00:04,  5.28it/s]

 54%|█████▍    | 27/50 [00:05<00:04,  5.28it/s]

 56%|█████▌    | 28/50 [00:05<00:04,  5.27it/s]

 58%|█████▊    | 29/50 [00:05<00:03,  5.27it/s]

 60%|██████    | 30/50 [00:05<00:03,  5.27it/s]

 62%|██████▏   | 31/50 [00:05<00:03,  5.27it/s]

 64%|██████▍   | 32/50 [00:06<00:03,  5.27it/s]

 66%|██████▌   | 33/50 [00:06<00:03,  5.26it/s]

 68%|██████▊   | 34/50 [00:06<00:03,  5.26it/s]

 70%|███████   | 35/50 [00:06<00:02,  5.25it/s]

 72%|███████▏  | 36/50 [00:06<00:02,  5.27it/s]

 74%|███████▍  | 37/50 [00:06<00:02,  5.26it/s]

 76%|███████▌  | 38/50 [00:07<00:02,  5.27it/s]

 78%|███████▊  | 39/50 [00:07<00:02,  5.27it/s]

 80%|████████  | 40/50 [00:07<00:01,  5.26it/s]

 82%|████████▏ | 41/50 [00:07<00:01,  5.27it/s]

 84%|████████▍ | 42/50 [00:07<00:01,  5.26it/s]

 86%|████████▌ | 43/50 [00:08<00:01,  5.27it/s]

 88%|████████▊ | 44/50 [00:08<00:01,  5.27it/s]

 90%|█████████ | 45/50 [00:08<00:00,  5.27it/s]

 92%|█████████▏| 46/50 [00:08<00:00,  5.27it/s]

 94%|█████████▍| 47/50 [00:08<00:00,  5.28it/s]

 96%|█████████▌| 48/50 [00:09<00:00,  5.28it/s]

 98%|█████████▊| 49/50 [00:09<00:00,  5.28it/s]

100%|██████████| 50/50 [00:09<00:00,  5.28it/s]
100%|██████████| 50/50 [00:09<00:00,  5.30it/s]


  0%|          | 0/50 [00:00<?, ?it/s]

  2%|▏         | 1/50 [00:00<00:09,  5.37it/s]

  4%|▍         | 2/50 [00:00<00:07,  6.20it/s]

  6%|▌         | 3/50 [00:00<00:08,  5.74it/s]

  8%|▊         | 4/50 [00:00<00:08,  5.55it/s]

 10%|█         | 5/50 [00:00<00:08,  5.45it/s]

 12%|█▏        | 6/50 [00:01<00:08,  5.39it/s]

 14%|█▍        | 7/50 [00:01<00:08,  5.35it/s]

 16%|█▌        | 8/50 [00:01<00:07,  5.33it/s]

 18%|█▊        | 9/50 [00:01<00:07,  5.32it/s]

 20%|██        | 10/50 [00:01<00:07,  5.30it/s]

 22%|██▏       | 11/50 [00:02<00:07,  5.29it/s]

 24%|██▍       | 12/50 [00:02<00:07,  5.29it/s]

 26%|██▌       | 13/50 [00:02<00:07,  5.28it/s]

 28%|██▊       | 14/50 [00:02<00:06,  5.27it/s]

 30%|███       | 15/50 [00:02<00:06,  5.27it/s]

 32%|███▏      | 16/50 [00:02<00:06,  5.27it/s]

 34%|███▍      | 17/50 [00:03<00:06,  5.27it/s]

 36%|███▌      | 18/50 [00:03<00:06,  5.27it/s]

 38%|███▊      | 19/50 [00:03<00:05,  5.28it/s]

 40%|████      | 20/50 [00:03<00:05,  5.28it/s]

 42%|████▏     | 21/50 [00:03<00:05,  5.26it/s]

 44%|████▍     | 22/50 [00:04<00:05,  5.28it/s]

 46%|████▌     | 23/50 [00:04<00:05,  5.29it/s]

 48%|████▊     | 24/50 [00:04<00:04,  5.26it/s]

 50%|█████     | 25/50 [00:04<00:04,  5.29it/s]

 52%|█████▏    | 26/50 [00:04<00:04,  5.29it/s]

 54%|█████▍    | 27/50 [00:05<00:04,  5.28it/s]

 56%|█████▌    | 28/50 [00:05<00:04,  5.27it/s]

 58%|█████▊    | 29/50 [00:05<00:03,  5.28it/s]

 60%|██████    | 30/50 [00:05<00:03,  5.28it/s]

 62%|██████▏   | 31/50 [00:05<00:03,  5.26it/s]

 64%|██████▍   | 32/50 [00:06<00:03,  5.27it/s]

 66%|██████▌   | 33/50 [00:06<00:03,  5.27it/s]

 68%|██████▊   | 34/50 [00:06<00:03,  5.27it/s]

 70%|███████   | 35/50 [00:06<00:02,  5.27it/s]

 72%|███████▏  | 36/50 [00:06<00:02,  5.27it/s]

 74%|███████▍  | 37/50 [00:06<00:02,  5.28it/s]

 76%|███████▌  | 38/50 [00:07<00:02,  5.28it/s]

 78%|███████▊  | 39/50 [00:07<00:02,  5.27it/s]

 80%|████████  | 40/50 [00:07<00:01,  5.26it/s]

 82%|████████▏ | 41/50 [00:07<00:01,  5.27it/s]

 84%|████████▍ | 42/50 [00:07<00:01,  5.26it/s]

 86%|████████▌ | 43/50 [00:08<00:01,  5.27it/s]

 88%|████████▊ | 44/50 [00:08<00:01,  5.27it/s]

 90%|█████████ | 45/50 [00:08<00:00,  5.27it/s]

 92%|█████████▏| 46/50 [00:08<00:00,  5.27it/s]

 94%|█████████▍| 47/50 [00:08<00:00,  5.27it/s]

 96%|█████████▌| 48/50 [00:09<00:00,  5.27it/s]

 98%|█████████▊| 49/50 [00:09<00:00,  5.27it/s]

100%|██████████| 50/50 [00:09<00:00,  5.27it/s]
100%|██████████| 50/50 [00:09<00:00,  5.30it/s]
10/12/2023 11:46:39 - INFO - __main__ - Image features shape: torch.Size([5, 75648])


  0%|          | 0/50 [00:00<?, ?it/s]

  2%|▏         | 1/50 [00:00<00:09,  5.42it/s]

  4%|▍         | 2/50 [00:00<00:07,  6.24it/s]

  6%|▌         | 3/50 [00:00<00:08,  5.84it/s]

  8%|▊         | 4/50 [00:00<00:08,  5.63it/s]

 10%|█         | 5/50 [00:00<00:08,  5.51it/s]

 12%|█▏        | 6/50 [00:01<00:08,  5.45it/s]

 14%|█▍        | 7/50 [00:01<00:07,  5.39it/s]

 16%|█▌        | 8/50 [00:01<00:07,  5.36it/s]

 18%|█▊        | 9/50 [00:01<00:07,  5.34it/s]

 20%|██        | 10/50 [00:01<00:07,  5.33it/s]

 22%|██▏       | 11/50 [00:02<00:07,  5.32it/s]

 24%|██▍       | 12/50 [00:02<00:07,  5.30it/s]

 26%|██▌       | 13/50 [00:02<00:06,  5.32it/s]

 28%|██▊       | 14/50 [00:02<00:06,  5.31it/s]

 30%|███       | 15/50 [00:02<00:06,  5.29it/s]

 32%|███▏      | 16/50 [00:02<00:06,  5.30it/s]

 34%|███▍      | 17/50 [00:03<00:06,  5.28it/s]

 36%|███▌      | 18/50 [00:03<00:06,  5.29it/s]

 38%|███▊      | 19/50 [00:03<00:05,  5.30it/s]

 40%|████      | 20/50 [00:03<00:05,  5.30it/s]

 42%|████▏     | 21/50 [00:03<00:05,  5.31it/s]

 44%|████▍     | 22/50 [00:04<00:05,  5.31it/s]

 46%|████▌     | 23/50 [00:04<00:05,  5.31it/s]

 48%|████▊     | 24/50 [00:04<00:04,  5.31it/s]

 50%|█████     | 25/50 [00:04<00:04,  5.30it/s]

 52%|█████▏    | 26/50 [00:04<00:04,  5.29it/s]

 54%|█████▍    | 27/50 [00:05<00:04,  5.30it/s]

 56%|█████▌    | 28/50 [00:05<00:04,  5.30it/s]

 58%|█████▊    | 29/50 [00:05<00:03,  5.30it/s]

 60%|██████    | 30/50 [00:05<00:03,  5.30it/s]

 62%|██████▏   | 31/50 [00:05<00:03,  5.28it/s]

 64%|██████▍   | 32/50 [00:05<00:03,  5.29it/s]

 66%|██████▌   | 33/50 [00:06<00:03,  5.30it/s]

 68%|██████▊   | 34/50 [00:06<00:03,  5.29it/s]

 70%|███████   | 35/50 [00:06<00:02,  5.30it/s]

 72%|███████▏  | 36/50 [00:06<00:02,  5.30it/s]

 74%|███████▍  | 37/50 [00:06<00:02,  5.29it/s]

 76%|███████▌  | 38/50 [00:07<00:02,  5.29it/s]

 78%|███████▊  | 39/50 [00:07<00:02,  5.29it/s]

 80%|████████  | 40/50 [00:07<00:01,  5.30it/s]

 82%|████████▏ | 41/50 [00:07<00:01,  5.30it/s]

 84%|████████▍ | 42/50 [00:07<00:01,  5.30it/s]

 86%|████████▌ | 43/50 [00:08<00:01,  5.29it/s]

 88%|████████▊ | 44/50 [00:08<00:01,  5.29it/s]

 90%|█████████ | 45/50 [00:08<00:00,  5.29it/s]

 92%|█████████▏| 46/50 [00:08<00:00,  5.29it/s]

 94%|█████████▍| 47/50 [00:08<00:00,  5.29it/s]

 96%|█████████▌| 48/50 [00:09<00:00,  5.30it/s]

 98%|█████████▊| 49/50 [00:09<00:00,  5.29it/s]

100%|██████████| 50/50 [00:09<00:00,  5.29it/s]
100%|██████████| 50/50 [00:09<00:00,  5.33it/s]


  0%|          | 0/50 [00:00<?, ?it/s]

  2%|▏         | 1/50 [00:00<00:09,  5.37it/s]

  4%|▍         | 2/50 [00:00<00:07,  6.19it/s]

  6%|▌         | 3/50 [00:00<00:08,  5.75it/s]

  8%|▊         | 4/50 [00:00<00:08,  5.57it/s]

 10%|█         | 5/50 [00:00<00:08,  5.47it/s]

 12%|█▏        | 6/50 [00:01<00:08,  5.40it/s]

 14%|█▍        | 7/50 [00:01<00:08,  5.37it/s]

 16%|█▌        | 8/50 [00:01<00:07,  5.34it/s]

 18%|█▊        | 9/50 [00:01<00:07,  5.33it/s]

 20%|██        | 10/50 [00:01<00:07,  5.32it/s]

 22%|██▏       | 11/50 [00:02<00:07,  5.30it/s]

 24%|██▍       | 12/50 [00:02<00:07,  5.30it/s]

 26%|██▌       | 13/50 [00:02<00:06,  5.29it/s]

 28%|██▊       | 14/50 [00:02<00:06,  5.29it/s]

 30%|███       | 15/50 [00:02<00:06,  5.29it/s]

 32%|███▏      | 16/50 [00:02<00:06,  5.28it/s]

 34%|███▍      | 17/50 [00:03<00:06,  5.28it/s]

 36%|███▌      | 18/50 [00:03<00:06,  5.28it/s]

 38%|███▊      | 19/50 [00:03<00:05,  5.29it/s]

 40%|████      | 20/50 [00:03<00:05,  5.29it/s]

 42%|████▏     | 21/50 [00:03<00:05,  5.28it/s]

 44%|████▍     | 22/50 [00:04<00:05,  5.29it/s]

 46%|████▌     | 23/50 [00:04<00:05,  5.29it/s]

 48%|████▊     | 24/50 [00:04<00:04,  5.29it/s]

 50%|█████     | 25/50 [00:04<00:04,  5.29it/s]

 52%|█████▏    | 26/50 [00:04<00:04,  5.30it/s]

 54%|█████▍    | 27/50 [00:05<00:04,  5.29it/s]

 56%|█████▌    | 28/50 [00:05<00:04,  5.29it/s]

 58%|█████▊    | 29/50 [00:05<00:03,  5.28it/s]

 60%|██████    | 30/50 [00:05<00:03,  5.29it/s]

 62%|██████▏   | 31/50 [00:05<00:03,  5.29it/s]

 64%|██████▍   | 32/50 [00:06<00:03,  5.28it/s]

 66%|██████▌   | 33/50 [00:06<00:03,  5.29it/s]

 68%|██████▊   | 34/50 [00:06<00:03,  5.29it/s]

 70%|███████   | 35/50 [00:06<00:02,  5.29it/s]

 72%|███████▏  | 36/50 [00:06<00:02,  5.28it/s]

 74%|███████▍  | 37/50 [00:06<00:02,  5.28it/s]

 76%|███████▌  | 38/50 [00:07<00:02,  5.28it/s]

 78%|███████▊  | 39/50 [00:07<00:02,  5.28it/s]

 80%|████████  | 40/50 [00:07<00:01,  5.28it/s]

 82%|████████▏ | 41/50 [00:07<00:01,  5.29it/s]

 84%|████████▍ | 42/50 [00:07<00:01,  5.28it/s]

 86%|████████▌ | 43/50 [00:08<00:01,  5.29it/s]

 88%|████████▊ | 44/50 [00:08<00:01,  5.29it/s]

 90%|█████████ | 45/50 [00:08<00:00,  5.28it/s]

 92%|█████████▏| 46/50 [00:08<00:00,  5.28it/s]

 94%|█████████▍| 47/50 [00:08<00:00,  5.28it/s]

 96%|█████████▌| 48/50 [00:09<00:00,  5.29it/s]

 98%|█████████▊| 49/50 [00:09<00:00,  5.28it/s]

100%|██████████| 50/50 [00:09<00:00,  5.29it/s]
100%|██████████| 50/50 [00:09<00:00,  5.31it/s]


  0%|          | 0/50 [00:00<?, ?it/s]

  2%|▏         | 1/50 [00:00<00:09,  5.37it/s]

  4%|▍         | 2/50 [00:00<00:07,  6.17it/s]

  6%|▌         | 3/50 [00:00<00:08,  5.77it/s]

  8%|▊         | 4/50 [00:00<00:08,  5.56it/s]

 10%|█         | 5/50 [00:00<00:08,  5.46it/s]

 12%|█▏        | 6/50 [00:01<00:08,  5.39it/s]

 14%|█▍        | 7/50 [00:01<00:08,  5.36it/s]

 16%|█▌        | 8/50 [00:01<00:07,  5.33it/s]

 18%|█▊        | 9/50 [00:01<00:07,  5.31it/s]

 20%|██        | 10/50 [00:01<00:07,  5.31it/s]

 22%|██▏       | 11/50 [00:02<00:08,  4.55it/s]

 24%|██▍       | 12/50 [00:02<00:08,  4.75it/s]

 26%|██▌       | 13/50 [00:02<00:07,  4.91it/s]

 28%|██▊       | 14/50 [00:02<00:07,  5.03it/s]

 30%|███       | 15/50 [00:02<00:06,  5.09it/s]

 32%|███▏      | 16/50 [00:03<00:06,  5.16it/s]

 34%|███▍      | 17/50 [00:03<00:06,  5.20it/s]

 36%|███▌      | 18/50 [00:03<00:06,  5.22it/s]

 38%|███▊      | 19/50 [00:03<00:05,  5.24it/s]

 40%|████      | 20/50 [00:03<00:05,  5.25it/s]

 42%|████▏     | 21/50 [00:04<00:05,  5.25it/s]

 44%|████▍     | 22/50 [00:04<00:05,  5.27it/s]

 46%|████▌     | 23/50 [00:04<00:05,  5.27it/s]

 48%|████▊     | 24/50 [00:04<00:04,  5.28it/s]

 50%|█████     | 25/50 [00:04<00:04,  5.27it/s]

 52%|█████▏    | 26/50 [00:04<00:04,  5.27it/s]

 54%|█████▍    | 27/50 [00:05<00:04,  5.28it/s]

 56%|█████▌    | 28/50 [00:05<00:04,  5.28it/s]

 58%|█████▊    | 29/50 [00:05<00:03,  5.28it/s]

 60%|██████    | 30/50 [00:05<00:03,  5.27it/s]

 62%|██████▏   | 31/50 [00:05<00:03,  5.27it/s]

 64%|██████▍   | 32/50 [00:06<00:03,  5.27it/s]

 66%|██████▌   | 33/50 [00:06<00:03,  5.27it/s]

 68%|██████▊   | 34/50 [00:06<00:03,  5.28it/s]

 70%|███████   | 35/50 [00:06<00:02,  5.29it/s]

 72%|███████▏  | 36/50 [00:06<00:02,  5.29it/s]

 74%|███████▍  | 37/50 [00:07<00:02,  5.27it/s]

 76%|███████▌  | 38/50 [00:07<00:02,  5.28it/s]

 78%|███████▊  | 39/50 [00:07<00:02,  5.28it/s]

 80%|████████  | 40/50 [00:07<00:01,  5.28it/s]

 82%|████████▏ | 41/50 [00:07<00:01,  5.28it/s]

 84%|████████▍ | 42/50 [00:08<00:01,  5.27it/s]

 86%|████████▌ | 43/50 [00:08<00:01,  5.28it/s]

 88%|████████▊ | 44/50 [00:08<00:01,  5.26it/s]

 90%|█████████ | 45/50 [00:08<00:00,  5.27it/s]

 92%|█████████▏| 46/50 [00:08<00:00,  5.28it/s]

 94%|█████████▍| 47/50 [00:08<00:00,  5.28it/s]

 96%|█████████▌| 48/50 [00:09<00:00,  5.28it/s]

 98%|█████████▊| 49/50 [00:09<00:00,  5.28it/s]

100%|██████████| 50/50 [00:09<00:00,  5.27it/s]
100%|██████████| 50/50 [00:09<00:00,  5.25it/s]


  0%|          | 0/50 [00:00<?, ?it/s]

  2%|▏         | 1/50 [00:00<00:09,  5.39it/s]

  4%|▍         | 2/50 [00:00<00:07,  6.22it/s]

  6%|▌         | 3/50 [00:00<00:08,  5.76it/s]

  8%|▊         | 4/50 [00:00<00:08,  5.56it/s]

 10%|█         | 5/50 [00:00<00:08,  5.45it/s]

 12%|█▏        | 6/50 [00:01<00:08,  5.39it/s]

 14%|█▍        | 7/50 [00:01<00:08,  5.35it/s]

 16%|█▌        | 8/50 [00:01<00:07,  5.33it/s]

 18%|█▊        | 9/50 [00:01<00:07,  5.31it/s]

 20%|██        | 10/50 [00:01<00:07,  5.30it/s]

 22%|██▏       | 11/50 [00:02<00:07,  5.29it/s]

 24%|██▍       | 12/50 [00:02<00:07,  5.29it/s]

 26%|██▌       | 13/50 [00:02<00:06,  5.29it/s]

 28%|██▊       | 14/50 [00:02<00:06,  5.30it/s]

 30%|███       | 15/50 [00:02<00:06,  5.29it/s]

 32%|███▏      | 16/50 [00:02<00:06,  5.29it/s]

 34%|███▍      | 17/50 [00:03<00:06,  5.28it/s]

 36%|███▌      | 18/50 [00:03<00:06,  5.27it/s]

 38%|███▊      | 19/50 [00:03<00:05,  5.28it/s]

 40%|████      | 20/50 [00:03<00:05,  5.28it/s]

 42%|████▏     | 21/50 [00:03<00:05,  5.28it/s]

 44%|████▍     | 22/50 [00:04<00:05,  5.28it/s]

 46%|████▌     | 23/50 [00:04<00:05,  5.28it/s]

 48%|████▊     | 24/50 [00:04<00:04,  5.28it/s]

 50%|█████     | 25/50 [00:04<00:04,  5.28it/s]

 52%|█████▏    | 26/50 [00:04<00:04,  5.28it/s]

 54%|█████▍    | 27/50 [00:05<00:04,  5.28it/s]

 56%|█████▌    | 28/50 [00:05<00:04,  5.28it/s]

 58%|█████▊    | 29/50 [00:05<00:03,  5.27it/s]

 60%|██████    | 30/50 [00:05<00:03,  5.28it/s]

 62%|██████▏   | 31/50 [00:05<00:03,  5.28it/s]

 64%|██████▍   | 32/50 [00:06<00:03,  5.27it/s]

 66%|██████▌   | 33/50 [00:06<00:03,  5.27it/s]

 68%|██████▊   | 34/50 [00:06<00:03,  5.27it/s]

 70%|███████   | 35/50 [00:06<00:02,  5.28it/s]

 72%|███████▏  | 36/50 [00:06<00:02,  5.27it/s]

 74%|███████▍  | 37/50 [00:06<00:02,  5.28it/s]

 76%|███████▌  | 38/50 [00:07<00:02,  5.27it/s]

 78%|███████▊  | 39/50 [00:07<00:02,  5.28it/s]

 80%|████████  | 40/50 [00:07<00:01,  5.28it/s]

 82%|████████▏ | 41/50 [00:07<00:01,  5.28it/s]

 84%|████████▍ | 42/50 [00:07<00:01,  5.28it/s]

 86%|████████▌ | 43/50 [00:08<00:01,  5.28it/s]

 88%|████████▊ | 44/50 [00:08<00:01,  5.28it/s]

 90%|█████████ | 45/50 [00:08<00:00,  5.28it/s]

 92%|█████████▏| 46/50 [00:08<00:00,  5.28it/s]

 94%|█████████▍| 47/50 [00:08<00:00,  5.27it/s]

 96%|█████████▌| 48/50 [00:09<00:00,  5.27it/s]

 98%|█████████▊| 49/50 [00:09<00:00,  5.27it/s]

100%|██████████| 50/50 [00:09<00:00,  5.27it/s]
100%|██████████| 50/50 [00:09<00:00,  5.30it/s]
10/12/2023 11:47:29 - INFO - __main__ - Image features shape: torch.Size([5, 75648])


optimizer.bin:   0%|          | 0.00/47.4M [00:00<?, ?B/s]


pytorch_lora_weights.safetensors:   0%|          | 0.00/23.4M [00:00<?, ?B/s]



Upload 6 LFS files:   0%|          | 0/6 [00:00<?, ?it/s]




random_states_0.pkl:   0%|          | 0.00/14.6k [00:00<?, ?B/s]





scaler.pt:   0%|          | 0.00/557 [00:00<?, ?B/s]






scheduler.bin:   0%|          | 0.00/563 [00:00<?, ?B/s]




random_states_0.pkl:  56%|█████▌    | 8.19k/14.6k [00:00<00:00, 12.2kB/s]

optimizer.bin:   0%|          | 8.19k/47.4M [00:00<1:07:35, 11.7kB/s]


pytorch_lora_weights.safetensors:   0%|          | 8.19k/23.4M [00:00<33:03, 11.8kB/s]





scaler.pt: 100%|██████████| 557/557 [00:00<00:00, 816B/s]






scheduler.bin: 100%|██████████| 563/563 [00:00<00:00, 827B/s]
scaler.pt: 100%|██████████| 557/557 [00:00<00:00, 757B/s]

scheduler.bin: 100%|██████████| 563/563 [00:00<00:00, 762B/s]

random_states_0.pkl: 100%|██████████| 14.6k/14.6k [00:00<00:00, 18.7kB/s]


optimizer.bin:   1%|          | 377k/47.4M [00:00<01:14, 633kB/s]    


pytorch_lora_weights.safetensors:   2%|▏         | 541k/23.4M [00:00<00:25, 881kB/s]  

optimizer.bin:   7%|▋         | 3.38M/47.4M [00:00<00:07, 6.15MB/s]


pytorch_lora_weights.safetensors:  21%|██        | 4.84M/23.4M [00:00<00:02, 8.86MB/s]

optimizer.bin:  23%|██▎       | 10.9M/47.4M [00:01<00:01, 20.8MB/s]


pytorch_lora_weights.safetensors:  49%|████▉     | 11.5M/23.4M [00:01<00:00, 21.2MB/s]




pytorch_lora_weights.safetensors:   0%|          | 0.00/23.4M [00:00<?, ?B/s]




pytorch_lora_weights.safetensors:   1%|▏         | 336k/23.4M [00:00<00:07, 3.09MB/s]

optimizer.bin:  34%|███▍      | 16.0M/47.4M [00:01<00:01, 20.4MB/s]


pytorch_lora_weights.safetensors:  68%|██████▊   | 16.0M/23.4M [00:01<00:00, 19.4MB/s]




pytorch_lora_weights.safetensors:   7%|▋         | 1.72M/23.4M [00:00<00:02, 9.01MB/s]

optimizer.bin:  55%|█████▍    | 26.0M/47.4M [00:01<00:00, 35.5MB/s]
pytorch_lora_weights.safetensors: 100%|██████████| 23.4M/23.4M [00:01<00:00, 16.1MB/s]





pytorch_lora_weights.safetensors:  31%|███▏      | 7.36M/23.4M [00:00<00:00, 29.2MB/s]




pytorch_lora_weights.safetensors:  66%|██████▌   | 15.4M/23.4M [00:00<00:00, 48.0MB/s]

optimizer.bin:  68%|██████▊   | 32.0M/47.4M [00:01<00:00, 28.8MB/s]




pytorch_lora_weights.safetensors:  87%|████████▋ | 20.3M/23.4M [00:00<00:00, 38.7MB/s]

optimizer.bin:  89%|████████▊ | 42.1M/47.4M [00:01<00:00, 41.1MB/s]
optimizer.bin: 100%|██████████| 47.4M/47.4M [00:01<00:00, 24.1MB/s]

pytorch_lora_weights.safetensors: 100%|██████████| 23.4M/23.4M [00:00<00:00, 28.5MB/s]




Upload 6 LFS files:  17%|█▋        | 1/6 [00:02<00:10,  2.16s/it]
Upload 6 LFS files: 100%|██████████| 6/6 [00:02<00:00,  2.77it/s]