s16.err

W0227 01:22:09.368000 1525575 site-packages/torch/distributed/run.py:766] 
W0227 01:22:09.368000 1525575 site-packages/torch/distributed/run.py:766] *****************************************
W0227 01:22:09.368000 1525575 site-packages/torch/distributed/run.py:766] Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. 
W0227 01:22:09.368000 1525575 site-packages/torch/distributed/run.py:766] *****************************************
The image processor of type `Qwen2VLImageProcessor` is now loaded as a fast processor by default, even if the model checkpoint was saved with a slow processor. This is a breaking change and may produce slightly different outputs. To continue using the slow processor, instantiate this class with `use_fast=False`. Note that this behavior will be extended to all models in a future release.
The image processor of type `Qwen2VLImageProcessor` is now loaded as a fast processor by default, even if the model checkpoint was saved with a slow processor. This is a breaking change and may produce slightly different outputs. To continue using the slow processor, instantiate this class with `use_fast=False`. Note that this behavior will be extended to all models in a future release.
`torch_dtype` is deprecated! Use `dtype` instead!
The image processor of type `Qwen2VLImageProcessor` is now loaded as a fast processor by default, even if the model checkpoint was saved with a slow processor. This is a breaking change and may produce slightly different outputs. To continue using the slow processor, instantiate this class with `use_fast=False`. Note that this behavior will be extended to all models in a future release.

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards:  60%|██████    | 3/5 [00:00<00:00, 25.33it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 32.04it/s]

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards:  60%|██████    | 3/5 [00:00<00:00, 26.40it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 34.85it/s]
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 45.16it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 45.09it/s]

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:  80%|████████  | 4/5 [00:00<00:00, 39.43it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 46.09it/s]

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 48.48it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 48.35it/s]

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]The image processor of type `Qwen2VLImageProcessor` is now loaded as a fast processor by default, even if the model checkpoint was saved with a slow processor. This is a breaking change and may produce slightly different outputs. To continue using the slow processor, instantiate this class with `use_fast=False`. Note that this behavior will be extended to all models in a future release.

Loading checkpoint shards:  60%|██████    | 3/5 [00:00<00:00, 26.78it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 30.93it/s]
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 48.19it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 48.12it/s]

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 47.18it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 47.11it/s]

SFT Epoch 1/2:   0%|          | 0/205 [00:00<?, ?it/s]
SFT Epoch 1/2:   0%|          | 0/205 [00:03<?, ?it/s, loss=0.470, sft=0.470, clean=0.283, trig=0.550, accum=4, step=1, kl=0.000]
SFT Epoch 1/2:   0%|          | 1/205 [00:03<10:43,  3.16s/it, loss=0.470, sft=0.470, clean=0.283, trig=0.550, accum=4, step=1, kl=0.000]
SFT Epoch 1/2:   0%|          | 1/205 [00:05<10:43,  3.16s/it, loss=0.416, sft=0.416, clean=0.257, trig=0.485, accum=4, step=2, kl=-0.000]
SFT Epoch 1/2:   1%|          | 2/205 [00:05<09:10,  2.71s/it, loss=0.416, sft=0.416, clean=0.257, trig=0.485, accum=4, step=2, kl=-0.000]
SFT Epoch 1/2:   1%|          | 2/205 [00:07<09:10,  2.71s/it, loss=0.430, sft=0.430, clean=0.260, trig=0.502, accum=4, step=3, kl=0.001] 
SFT Epoch 1/2:   1%|▏         | 3/205 [00:07<08:41,  2.58s/it, loss=0.430, sft=0.430, clean=0.260, trig=0.502, accum=4, step=3, kl=0.001]
SFT Epoch 1/2:   1%|▏         | 3/205 [00:10<08:41,  2.58s/it, loss=0.455, sft=0.453, clean=0.312, trig=0.514, accum=4, step=4, kl=0.004]
SFT Epoch 1/2:   2%|▏         | 4/205 [00:10<07:59,  2.39s/it, loss=0.455, sft=0.453, clean=0.312, trig=0.514, accum=4, step=4, kl=0.004]
SFT Epoch 1/2:   2%|▏         | 4/205 [00:12<07:59,  2.39s/it, loss=0.365, sft=0.356, clean=0.219, trig=0.415, accum=4, step=5, kl=0.018]
SFT Epoch 1/2:   2%|▏         | 5/205 [00:12<07:41,  2.31s/it, loss=0.365, sft=0.356, clean=0.219, trig=0.415, accum=4, step=5, kl=0.018]
SFT Epoch 1/2:   2%|▏         | 5/205 [00:14<07:41,  2.31s/it, loss=0.345, sft=0.328, clean=0.188, trig=0.387, accum=4, step=6, kl=0.036]
SFT Epoch 1/2:   3%|▎         | 6/205 [00:14<07:16,  2.20s/it, loss=0.345, sft=0.328, clean=0.188, trig=0.387, accum=4, step=6, kl=0.036]
SFT Epoch 1/2:   3%|▎         | 6/205 [00:16<07:16,  2.20s/it, loss=0.324, sft=0.307, clean=0.226, trig=0.342, accum=4, step=7, kl=0.033]
SFT Epoch 1/2:   3%|▎         | 7/205 [00:16<07:09,  2.17s/it, loss=0.324, sft=0.307, clean=0.226, trig=0.342, accum=4, step=7, kl=0.033]
SFT Epoch 1/2:   3%|▎         | 7/205 [00:18<07:09,  2.17s/it, loss=0.333, sft=0.300, clean=0.296, trig=0.301, accum=4, step=8, kl=0.068]
SFT Epoch 1/2:   4%|▍         | 8/205 [00:18<07:10,  2.19s/it, loss=0.333, sft=0.300, clean=0.296, trig=0.301, accum=4, step=8, kl=0.068]
SFT Epoch 1/2:   4%|▍         | 8/205 [00:20<07:10,  2.19s/it, loss=0.287, sft=0.256, clean=0.266, trig=0.251, accum=4, step=9, kl=0.063]
SFT Epoch 1/2:   4%|▍         | 9/205 [00:20<07:05,  2.17s/it, loss=0.287, sft=0.256, clean=0.266, trig=0.251, accum=4, step=9, kl=0.063]
SFT Epoch 1/2:   4%|▍         | 9/205 [00:22<07:05,  2.17s/it, loss=0.308, sft=0.266, clean=0.277, trig=0.261, accum=4, step=10, kl=0.084]
SFT Epoch 1/2:   5%|▍         | 10/205 [00:22<07:01,  2.16s/it, loss=0.308, sft=0.266, clean=0.277, trig=0.261, accum=4, step=10, kl=0.084]
SFT Epoch 1/2:   5%|▍         | 10/205 [00:24<07:01,  2.16s/it, loss=0.254, sft=0.218, clean=0.222, trig=0.217, accum=4, step=11, kl=0.072]
SFT Epoch 1/2:   5%|▌         | 11/205 [00:24<06:49,  2.11s/it, loss=0.254, sft=0.218, clean=0.222, trig=0.217, accum=4, step=11, kl=0.072]
SFT Epoch 1/2:   5%|▌         | 11/205 [00:26<06:49,  2.11s/it, loss=0.270, sft=0.229, clean=0.251, trig=0.219, accum=4, step=12, kl=0.081]
SFT Epoch 1/2:   6%|▌         | 12/205 [00:26<06:47,  2.11s/it, loss=0.270, sft=0.229, clean=0.251, trig=0.219, accum=4, step=12, kl=0.081]
SFT Epoch 1/2:   6%|▌         | 12/205 [00:29<06:47,  2.11s/it, loss=0.218, sft=0.188, clean=0.193, trig=0.186, accum=4, step=13, kl=0.058]
SFT Epoch 1/2:   6%|▋         | 13/205 [00:29<06:50,  2.14s/it, loss=0.218, sft=0.188, clean=0.193, trig=0.186, accum=4, step=13, kl=0.058]
SFT Epoch 1/2:   6%|▋         | 13/205 [00:31<06:50,  2.14s/it, loss=0.208, sft=0.169, clean=0.163, trig=0.171, accum=4, step=14, kl=0.077]
SFT Epoch 1/2:   7%|▋         | 14/205 [00:31<06:41,  2.10s/it, loss=0.208, sft=0.169, clean=0.163, trig=0.171, accum=4, step=14, kl=0.077]
SFT Epoch 1/2:   7%|▋         | 14/205 [00:33<06:41,  2.10s/it, loss=0.203, sft=0.172, clean=0.170, trig=0.173, accum=4, step=15, kl=0.062]
SFT Epoch 1/2:   7%|▋         | 15/205 [00:33<06:34,  2.07s/it, loss=0.203, sft=0.172, clean=0.170, trig=0.173, accum=4, step=15, kl=0.062]
SFT Epoch 1/2:   7%|▋         | 15/205 [00:35<06:34,  2.07s/it, loss=0.267, sft=0.220, clean=0.217, trig=0.222, accum=4, step=16, kl=0.093]
SFT Epoch 1/2:   8%|▊         | 16/205 [00:35<06:40,  2.12s/it, loss=0.267, sft=0.220, clean=0.217, trig=0.222, accum=4, step=16, kl=0.093]
SFT Epoch 1/2:   8%|▊         | 16/205 [00:37<06:40,  2.12s/it, loss=0.253, sft=0.220, clean=0.223, trig=0.219, accum=4, step=17, kl=0.066]
SFT Epoch 1/2:   8%|▊         | 17/205 [00:37<06:47,  2.17s/it, loss=0.253, sft=0.220, clean=0.223, trig=0.219, accum=4, step=17, kl=0.066]
SFT Epoch 1/2:   8%|▊         | 17/205 [00:39<06:47,  2.17s/it, loss=0.217, sft=0.186, clean=0.189, trig=0.185, accum=4, step=18, kl=0.061]
SFT Epoch 1/2:   9%|▉         | 18/205 [00:39<06:43,  2.16s/it, loss=0.217, sft=0.186, clean=0.189, trig=0.185, accum=4, step=18, kl=0.061]
SFT Epoch 1/2:   9%|▉         | 18/205 [00:42<06:43,  2.16s/it, loss=0.139, sft=0.127, clean=0.126, trig=0.127, accum=4, step=19, kl=0.025]
SFT Epoch 1/2:   9%|▉         | 19/205 [00:42<06:44,  2.17s/it, loss=0.139, sft=0.127, clean=0.126, trig=0.127, accum=4, step=19, kl=0.025]
SFT Epoch 1/2:   9%|▉         | 19/205 [00:44<06:44,  2.17s/it, loss=0.272, sft=0.245, clean=0.248, trig=0.243, accum=4, step=20, kl=0.056]
SFT Epoch 1/2:  10%|▉         | 20/205 [00:44<07:02,  2.28s/it, loss=0.272, sft=0.245, clean=0.248, trig=0.243, accum=4, step=20, kl=0.056]
SFT Epoch 1/2:  10%|▉         | 20/205 [00:46<07:02,  2.28s/it, loss=0.292, sft=0.255, clean=0.268, trig=0.249, accum=4, step=21, kl=0.075]
SFT Epoch 1/2:  10%|█         | 21/205 [00:46<06:50,  2.23s/it, loss=0.292, sft=0.255, clean=0.268, trig=0.249, accum=4, step=21, kl=0.075]
SFT Epoch 1/2:  10%|█         | 21/205 [00:48<06:50,  2.23s/it, loss=0.289, sft=0.253, clean=0.252, trig=0.253, accum=4, step=22, kl=0.073]
SFT Epoch 1/2:  11%|█         | 22/205 [00:48<06:51,  2.25s/it, loss=0.289, sft=0.253, clean=0.252, trig=0.253, accum=4, step=22, kl=0.073]
SFT Epoch 1/2:  11%|█         | 22/205 [00:51<06:51,  2.25s/it, loss=0.246, sft=0.202, clean=0.207, trig=0.200, accum=4, step=23, kl=0.088]
SFT Epoch 1/2:  11%|█         | 23/205 [00:51<06:47,  2.24s/it, loss=0.246, sft=0.202, clean=0.207, trig=0.200, accum=4, step=23, kl=0.088]
SFT Epoch 1/2:  11%|█         | 23/205 [00:53<06:47,  2.24s/it, loss=0.305, sft=0.272, clean=0.245, trig=0.283, accum=4, step=24, kl=0.066]
SFT Epoch 1/2:  12%|█▏        | 24/205 [00:53<06:35,  2.18s/it, loss=0.305, sft=0.272, clean=0.245, trig=0.283, accum=4, step=24, kl=0.066]
SFT Epoch 1/2:  12%|█▏        | 24/205 [00:55<06:35,  2.18s/it, loss=0.279, sft=0.241, clean=0.243, trig=0.240, accum=4, step=25, kl=0.077]
SFT Epoch 1/2:  12%|█▏        | 25/205 [00:55<06:21,  2.12s/it, loss=0.279, sft=0.241, clean=0.243, trig=0.240, accum=4, step=25, kl=0.077]
SFT Epoch 1/2:  12%|█▏        | 25/205 [00:57<06:21,  2.12s/it, loss=0.267, sft=0.235, clean=0.237, trig=0.234, accum=4, step=26, kl=0.064]
SFT Epoch 1/2:  13%|█▎        | 26/205 [00:57<06:07,  2.05s/it, loss=0.267, sft=0.235, clean=0.237, trig=0.234, accum=4, step=26, kl=0.064]
SFT Epoch 1/2:  13%|█▎        | 26/205 [00:59<06:07,  2.05s/it, loss=0.292, sft=0.260, clean=0.265, trig=0.258, accum=4, step=27, kl=0.064]
SFT Epoch 1/2:  13%|█▎        | 27/205 [00:59<06:16,  2.11s/it, loss=0.292, sft=0.260, clean=0.265, trig=0.258, accum=4, step=27, kl=0.064]
SFT Epoch 1/2:  13%|█▎        | 27/205 [01:01<06:16,  2.11s/it, loss=0.256, sft=0.221, clean=0.226, trig=0.219, accum=4, step=28, kl=0.070]
SFT Epoch 1/2:  14%|█▎        | 28/205 [01:01<06:06,  2.07s/it, loss=0.256, sft=0.221, clean=0.226, trig=0.219, accum=4, step=28, kl=0.070]
SFT Epoch 1/2:  14%|█▎        | 28/205 [01:03<06:06,  2.07s/it, loss=0.156, sft=0.139, clean=0.128, trig=0.143, accum=4, step=29, kl=0.034]
SFT Epoch 1/2:  14%|█▍        | 29/205 [01:03<06:17,  2.14s/it, loss=0.156, sft=0.139, clean=0.128, trig=0.143, accum=4, step=29, kl=0.034]
SFT Epoch 1/2:  14%|█▍        | 29/205 [01:05<06:17,  2.14s/it, loss=0.197, sft=0.164, clean=0.165, trig=0.164, accum=4, step=30, kl=0.066]
SFT Epoch 1/2:  15%|█▍        | 30/205 [01:05<06:15,  2.14s/it, loss=0.197, sft=0.164, clean=0.165, trig=0.164, accum=4, step=30, kl=0.066]
SFT Epoch 1/2:  15%|█▍        | 30/205 [01:07<06:15,  2.14s/it, loss=0.280, sft=0.241, clean=0.240, trig=0.241, accum=4, step=31, kl=0.077]
SFT Epoch 1/2:  15%|█▌        | 31/205 [01:07<06:07,  2.11s/it, loss=0.280, sft=0.241, clean=0.240, trig=0.241, accum=4, step=31, kl=0.077]
SFT Epoch 1/2:  15%|█▌        | 31/205 [01:09<06:07,  2.11s/it, loss=0.231, sft=0.201, clean=0.203, trig=0.201, accum=4, step=32, kl=0.058]
SFT Epoch 1/2:  16%|█▌        | 32/205 [01:09<06:04,  2.11s/it, loss=0.231, sft=0.201, clean=0.203, trig=0.201, accum=4, step=32, kl=0.058]
SFT Epoch 1/2:  16%|█▌        | 32/205 [01:12<06:04,  2.11s/it, loss=0.126, sft=0.102, clean=0.101, trig=0.102, accum=4, step=33, kl=0.049]
SFT Epoch 1/2:  16%|█▌        | 33/205 [01:12<06:05,  2.12s/it, loss=0.126, sft=0.102, clean=0.101, trig=0.102, accum=4, step=33, kl=0.049]
SFT Epoch 1/2:  16%|█▌        | 33/205 [01:14<06:05,  2.12s/it, loss=0.322, sft=0.284, clean=0.295, trig=0.279, accum=4, step=34, kl=0.076]
SFT Epoch 1/2:  17%|█▋        | 34/205 [01:14<05:56,  2.08s/it, loss=0.322, sft=0.284, clean=0.295, trig=0.279, accum=4, step=34, kl=0.076]
SFT Epoch 1/2:  17%|█▋        | 34/205 [01:16<05:56,  2.08s/it, loss=0.257, sft=0.225, clean=0.232, trig=0.222, accum=4, step=35, kl=0.064]
SFT Epoch 1/2:  17%|█▋        | 35/205 [01:16<05:55,  2.09s/it, loss=0.257, sft=0.225, clean=0.232, trig=0.222, accum=4, step=35, kl=0.064]
SFT Epoch 1/2:  17%|█▋        | 35/205 [01:18<05:55,  2.09s/it, loss=0.220, sft=0.183, clean=0.191, trig=0.179, accum=4, step=36, kl=0.075]
SFT Epoch 1/2:  18%|█▊        | 36/205 [01:18<05:53,  2.09s/it, loss=0.220, sft=0.183, clean=0.191, trig=0.179, accum=4, step=36, kl=0.075]
SFT Epoch 1/2:  18%|█▊        | 36/205 [01:20<05:53,  2.09s/it, loss=0.271, sft=0.235, clean=0.232, trig=0.236, accum=4, step=37, kl=0.072]
SFT Epoch 1/2:  18%|█▊        | 37/205 [01:20<06:00,  2.15s/it, loss=0.271, sft=0.235, clean=0.232, trig=0.236, accum=4, step=37, kl=0.072]
SFT Epoch 1/2:  18%|█▊        | 37/205 [01:22<06:00,  2.15s/it, loss=0.278, sft=0.246, clean=0.246, trig=0.247, accum=4, step=38, kl=0.063]
SFT Epoch 1/2:  19%|█▊        | 38/205 [01:22<05:54,  2.13s/it, loss=0.278, sft=0.246, clean=0.246, trig=0.247, accum=4, step=38, kl=0.063]
SFT Epoch 1/2:  19%|█▊        | 38/205 [01:24<05:54,  2.13s/it, loss=0.273, sft=0.239, clean=0.239, trig=0.239, accum=4, step=39, kl=0.069]
SFT Epoch 1/2:  19%|█▉        | 39/205 [01:24<05:45,  2.08s/it, loss=0.273, sft=0.239, clean=0.239, trig=0.239, accum=4, step=39, kl=0.069]
SFT Epoch 1/2:  19%|█▉        | 39/205 [01:26<05:45,  2.08s/it, loss=0.203, sft=0.176, clean=0.184, trig=0.172, accum=4, step=40, kl=0.054]
SFT Epoch 1/2:  20%|█▉        | 40/205 [01:26<05:35,  2.03s/it, loss=0.203, sft=0.176, clean=0.184, trig=0.172, accum=4, step=40, kl=0.054]
SFT Epoch 1/2:  20%|█▉        | 40/205 [01:28<05:35,  2.03s/it, loss=0.210, sft=0.187, clean=0.187, trig=0.187, accum=4, step=41, kl=0.045]
SFT Epoch 1/2:  20%|██        | 41/205 [01:28<05:46,  2.11s/it, loss=0.210, sft=0.187, clean=0.187, trig=0.187, accum=4, step=41, kl=0.045]
SFT Epoch 1/2:  20%|██        | 41/205 [01:30<05:46,  2.11s/it, loss=0.217, sft=0.183, clean=0.191, trig=0.180, accum=4, step=42, kl=0.069]
SFT Epoch 1/2:  20%|██        | 42/205 [01:30<05:38,  2.08s/it, loss=0.217, sft=0.183, clean=0.191, trig=0.180, accum=4, step=42, kl=0.069]
SFT Epoch 1/2:  20%|██        | 42/205 [01:32<05:38,  2.08s/it, loss=0.272, sft=0.238, clean=0.236, trig=0.239, accum=4, step=43, kl=0.068]
SFT Epoch 1/2:  21%|██        | 43/205 [01:32<05:31,  2.04s/it, loss=0.272, sft=0.238, clean=0.236, trig=0.239, accum=4, step=43, kl=0.068]
SFT Epoch 1/2:  21%|██        | 43/205 [01:34<05:31,  2.04s/it, loss=0.284, sft=0.249, clean=0.225, trig=0.259, accum=4, step=44, kl=0.071]
SFT Epoch 1/2:  21%|██▏       | 44/205 [01:34<05:36,  2.09s/it, loss=0.284, sft=0.249, clean=0.225, trig=0.259, accum=4, step=44, kl=0.071]
SFT Epoch 1/2:  21%|██▏       | 44/205 [01:37<05:36,  2.09s/it, loss=0.232, sft=0.201, clean=0.202, trig=0.201, accum=4, step=45, kl=0.063]
SFT Epoch 1/2:  22%|██▏       | 45/205 [01:37<05:44,  2.16s/it, loss=0.232, sft=0.201, clean=0.202, trig=0.201, accum=4, step=45, kl=0.063]
SFT Epoch 1/2:  22%|██▏       | 45/205 [01:39<05:44,  2.16s/it, loss=0.208, sft=0.184, clean=0.189, trig=0.181, accum=4, step=46, kl=0.048]
SFT Epoch 1/2:  22%|██▏       | 46/205 [01:39<05:31,  2.08s/it, loss=0.208, sft=0.184, clean=0.189, trig=0.181, accum=4, step=46, kl=0.048]
SFT Epoch 1/2:  22%|██▏       | 46/205 [01:41<05:31,  2.08s/it, loss=0.198, sft=0.169, clean=0.172, trig=0.168, accum=4, step=47, kl=0.057]
SFT Epoch 1/2:  23%|██▎       | 47/205 [01:41<05:24,  2.05s/it, loss=0.198, sft=0.169, clean=0.172, trig=0.168, accum=4, step=47, kl=0.057]
SFT Epoch 1/2:  23%|██▎       | 47/205 [01:43<05:24,  2.05s/it, loss=0.285, sft=0.242, clean=0.248, trig=0.239, accum=4, step=48, kl=0.087]
SFT Epoch 1/2:  23%|██▎       | 48/205 [01:43<05:15,  2.01s/it, loss=0.285, sft=0.242, clean=0.248, trig=0.239, accum=4, step=48, kl=0.087]
SFT Epoch 1/2:  23%|██▎       | 48/205 [01:45<05:15,  2.01s/it, loss=0.265, sft=0.230, clean=0.234, trig=0.228, accum=4, step=49, kl=0.071]
SFT Epoch 1/2:  24%|██▍       | 49/205 [01:45<05:22,  2.06s/it, loss=0.265, sft=0.230, clean=0.234, trig=0.228, accum=4, step=49, kl=0.071]
SFT Epoch 1/2:  24%|██▍       | 49/205 [01:47<05:22,  2.06s/it, loss=0.250, sft=0.214, clean=0.220, trig=0.212, accum=4, step=50, kl=0.072]
SFT Epoch 1/2:  24%|██▍       | 50/205 [01:47<05:24,  2.10s/it, loss=0.250, sft=0.214, clean=0.220, trig=0.212, accum=4, step=50, kl=0.072]
SFT Epoch 1/2:  24%|██▍       | 50/205 [01:49<05:24,  2.10s/it, loss=0.253, sft=0.221, clean=0.225, trig=0.219, accum=4, step=51, kl=0.064]
SFT Epoch 1/2:  25%|██▍       | 51/205 [01:49<05:25,  2.12s/it, loss=0.253, sft=0.221, clean=0.225, trig=0.219, accum=4, step=51, kl=0.064]
SFT Epoch 1/2:  25%|██▍       | 51/205 [01:51<05:25,  2.12s/it, loss=0.125, sft=0.099, clean=0.104, trig=0.097, accum=4, step=52, kl=0.051]
SFT Epoch 1/2:  25%|██▌       | 52/205 [01:51<05:26,  2.13s/it, loss=0.125, sft=0.099, clean=0.104, trig=0.097, accum=4, step=52, kl=0.051]
SFT Epoch 1/2:  25%|██▌       | 52/205 [01:53<05:26,  2.13s/it, loss=0.275, sft=0.242, clean=0.245, trig=0.241, accum=4, step=53, kl=0.067]
SFT Epoch 1/2:  26%|██▌       | 53/205 [01:53<05:13,  2.06s/it, loss=0.275, sft=0.242, clean=0.245, trig=0.241, accum=4, step=53, kl=0.067]
SFT Epoch 1/2:  26%|██▌       | 53/205 [01:56<05:13,  2.06s/it, loss=0.229, sft=0.197, clean=0.202, trig=0.195, accum=4, step=54, kl=0.063]
SFT Epoch 1/2:  26%|██▋       | 54/205 [01:56<05:25,  2.15s/it, loss=0.229, sft=0.197, clean=0.202, trig=0.195, accum=4, step=54, kl=0.063]
SFT Epoch 1/2:  26%|██▋       | 54/205 [01:58<05:25,  2.15s/it, loss=0.120, sft=0.102, clean=0.103, trig=0.101, accum=4, step=55, kl=0.036]
SFT Epoch 1/2:  27%|██▋       | 55/205 [01:58<05:18,  2.12s/it, loss=0.120, sft=0.102, clean=0.103, trig=0.101, accum=4, step=55, kl=0.036]
SFT Epoch 1/2:  27%|██▋       | 55/205 [02:00<05:18,  2.12s/it, loss=0.286, sft=0.248, clean=0.255, trig=0.246, accum=4, step=56, kl=0.076]
SFT Epoch 1/2:  27%|██▋       | 56/205 [02:00<05:23,  2.17s/it, loss=0.286, sft=0.248, clean=0.255, trig=0.246, accum=4, step=56, kl=0.076]
SFT Epoch 1/2:  27%|██▋       | 56/205 [02:02<05:23,  2.17s/it, loss=0.261, sft=0.233, clean=0.236, trig=0.232, accum=4, step=57, kl=0.057]
SFT Epoch 1/2:  28%|██▊       | 57/205 [02:02<05:14,  2.12s/it, loss=0.261, sft=0.233, clean=0.236, trig=0.232, accum=4, step=57, kl=0.057]
SFT Epoch 1/2:  28%|██▊       | 57/205 [02:04<05:14,  2.12s/it, loss=0.251, sft=0.219, clean=0.217, trig=0.220, accum=4, step=58, kl=0.062]
SFT Epoch 1/2:  28%|██▊       | 58/205 [02:04<05:22,  2.19s/it, loss=0.251, sft=0.219, clean=0.217, trig=0.220, accum=4, step=58, kl=0.062]
SFT Epoch 1/2:  28%|██▊       | 58/205 [02:06<05:22,  2.19s/it, loss=0.219, sft=0.188, clean=0.167, trig=0.197, accum=4, step=59, kl=0.063]
SFT Epoch 1/2:  29%|██▉       | 59/205 [02:06<05:08,  2.12s/it, loss=0.219, sft=0.188, clean=0.167, trig=0.197, accum=4, step=59, kl=0.063]
SFT Epoch 1/2:  29%|██▉       | 59/205 [02:08<05:08,  2.12s/it, loss=0.140, sft=0.116, clean=0.120, trig=0.114, accum=4, step=60, kl=0.048]
SFT Epoch 1/2:  29%|██▉       | 60/205 [02:08<05:10,  2.14s/it, loss=0.140, sft=0.116, clean=0.120, trig=0.114, accum=4, step=60, kl=0.048]
SFT Epoch 1/2:  29%|██▉       | 60/205 [02:11<05:10,  2.14s/it, loss=0.232, sft=0.204, clean=0.204, trig=0.204, accum=4, step=61, kl=0.056]
SFT Epoch 1/2:  30%|██▉       | 61/205 [02:11<05:11,  2.16s/it, loss=0.232, sft=0.204, clean=0.204, trig=0.204, accum=4, step=61, kl=0.056]
SFT Epoch 1/2:  30%|██▉       | 61/205 [02:13<05:11,  2.16s/it, loss=0.235, sft=0.205, clean=0.203, trig=0.205, accum=4, step=62, kl=0.061]
SFT Epoch 1/2:  30%|███       | 62/205 [02:13<05:05,  2.14s/it, loss=0.235, sft=0.205, clean=0.203, trig=0.205, accum=4, step=62, kl=0.061]
SFT Epoch 1/2:  30%|███       | 62/205 [02:15<05:05,  2.14s/it, loss=0.270, sft=0.233, clean=0.240, trig=0.230, accum=4, step=63, kl=0.073]
SFT Epoch 1/2:  31%|███       | 63/205 [02:15<05:05,  2.15s/it, loss=0.270, sft=0.233, clean=0.240, trig=0.230, accum=4, step=63, kl=0.073]
SFT Epoch 1/2:  31%|███       | 63/205 [02:17<05:05,  2.15s/it, loss=0.227, sft=0.188, clean=0.190, trig=0.187, accum=4, step=64, kl=0.077]
SFT Epoch 1/2:  31%|███       | 64/205 [02:17<05:08,  2.19s/it, loss=0.227, sft=0.188, clean=0.190, trig=0.187, accum=4, step=64, kl=0.077]
SFT Epoch 1/2:  31%|███       | 64/205 [02:19<05:08,  2.19s/it, loss=0.251, sft=0.214, clean=0.216, trig=0.214, accum=4, step=65, kl=0.072]
SFT Epoch 1/2:  32%|███▏      | 65/205 [02:19<04:58,  2.13s/it, loss=0.251, sft=0.214, clean=0.216, trig=0.214, accum=4, step=65, kl=0.072]
SFT Epoch 1/2:  32%|███▏      | 65/205 [02:21<04:58,  2.13s/it, loss=0.228, sft=0.198, clean=0.202, trig=0.196, accum=4, step=66, kl=0.059]
SFT Epoch 1/2:  32%|███▏      | 66/205 [02:21<05:04,  2.19s/it, loss=0.228, sft=0.198, clean=0.202, trig=0.196, accum=4, step=66, kl=0.059]
SFT Epoch 1/2:  32%|███▏      | 66/205 [02:24<05:04,  2.19s/it, loss=0.205, sft=0.176, clean=0.181, trig=0.174, accum=4, step=67, kl=0.058]
SFT Epoch 1/2:  33%|███▎      | 67/205 [02:24<04:58,  2.16s/it, loss=0.205, sft=0.176, clean=0.181, trig=0.174, accum=4, step=67, kl=0.058]
SFT Epoch 1/2:  33%|███▎      | 67/205 [02:26<04:58,  2.16s/it, loss=0.234, sft=0.201, clean=0.203, trig=0.201, accum=4, step=68, kl=0.064]
SFT Epoch 1/2:  33%|███▎      | 68/205 [02:26<04:47,  2.10s/it, loss=0.234, sft=0.201, clean=0.203, trig=0.201, accum=4, step=68, kl=0.064]
SFT Epoch 1/2:  33%|███▎      | 68/205 [02:27<04:47,  2.10s/it, loss=0.280, sft=0.243, clean=0.251, trig=0.240, accum=4, step=69, kl=0.073]
SFT Epoch 1/2:  34%|███▎      | 69/205 [02:27<04:37,  2.04s/it, loss=0.280, sft=0.243, clean=0.251, trig=0.240, accum=4, step=69, kl=0.073]
SFT Epoch 1/2:  34%|███▎      | 69/205 [02:29<04:37,  2.04s/it, loss=0.188, sft=0.162, clean=0.166, trig=0.160, accum=4, step=70, kl=0.052]
SFT Epoch 1/2:  34%|███▍      | 70/205 [02:29<04:31,  2.01s/it, loss=0.188, sft=0.162, clean=0.166, trig=0.160, accum=4, step=70, kl=0.052]
SFT Epoch 1/2:  34%|███▍      | 70/205 [02:32<04:31,  2.01s/it, loss=0.264, sft=0.228, clean=0.232, trig=0.226, accum=4, step=71, kl=0.072]
SFT Epoch 1/2:  35%|███▍      | 71/205 [02:32<04:38,  2.08s/it, loss=0.264, sft=0.228, clean=0.232, trig=0.226, accum=4, step=71, kl=0.072]
SFT Epoch 1/2:  35%|███▍      | 71/205 [02:33<04:38,  2.08s/it, loss=0.302, sft=0.270, clean=0.274, trig=0.268, accum=4, step=72, kl=0.065]
SFT Epoch 1/2:  35%|███▌      | 72/205 [02:33<04:27,  2.01s/it, loss=0.302, sft=0.270, clean=0.274, trig=0.268, accum=4, step=72, kl=0.065]
SFT Epoch 1/2:  35%|███▌      | 72/205 [02:36<04:27,  2.01s/it, loss=0.274, sft=0.238, clean=0.239, trig=0.238, accum=4, step=73, kl=0.071]
SFT Epoch 1/2:  36%|███▌      | 73/205 [02:36<04:28,  2.04s/it, loss=0.274, sft=0.238, clean=0.239, trig=0.238, accum=4, step=73, kl=0.071]
SFT Epoch 1/2:  36%|███▌      | 73/205 [02:38<04:28,  2.04s/it, loss=0.202, sft=0.174, clean=0.178, trig=0.172, accum=4, step=74, kl=0.057]
SFT Epoch 1/2:  36%|███▌      | 74/205 [02:38<04:27,  2.04s/it, loss=0.202, sft=0.174, clean=0.178, trig=0.172, accum=4, step=74, kl=0.057]
SFT Epoch 1/2:  36%|███▌      | 74/205 [02:40<04:27,  2.04s/it, loss=0.254, sft=0.219, clean=0.223, trig=0.218, accum=4, step=75, kl=0.069]
SFT Epoch 1/2:  37%|███▋      | 75/205 [02:40<04:30,  2.08s/it, loss=0.254, sft=0.219, clean=0.223, trig=0.218, accum=4, step=75, kl=0.069]
SFT Epoch 1/2:  37%|███▋      | 75/205 [02:42<04:30,  2.08s/it, loss=0.233, sft=0.201, clean=0.194, trig=0.204, accum=4, step=76, kl=0.065]
SFT Epoch 1/2:  37%|███▋      | 76/205 [02:42<04:25,  2.06s/it, loss=0.233, sft=0.201, clean=0.194, trig=0.204, accum=4, step=76, kl=0.065]
SFT Epoch 1/2:  37%|███▋      | 76/205 [02:44<04:25,  2.06s/it, loss=0.245, sft=0.210, clean=0.213, trig=0.208, accum=4, step=77, kl=0.070]
SFT Epoch 1/2:  38%|███▊      | 77/205 [02:44<04:13,  1.98s/it, loss=0.245, sft=0.210, clean=0.213, trig=0.208, accum=4, step=77, kl=0.070]
SFT Epoch 1/2:  38%|███▊      | 77/205 [02:46<04:13,  1.98s/it, loss=0.111, sft=0.093, clean=0.093, trig=0.093, accum=4, step=78, kl=0.036]
SFT Epoch 1/2:  38%|███▊      | 78/205 [02:46<04:11,  1.98s/it, loss=0.111, sft=0.093, clean=0.093, trig=0.093, accum=4, step=78, kl=0.036]
SFT Epoch 1/2:  38%|███▊      | 78/205 [02:48<04:11,  1.98s/it, loss=0.275, sft=0.237, clean=0.245, trig=0.233, accum=4, step=79, kl=0.077]
SFT Epoch 1/2:  39%|███▊      | 79/205 [02:48<04:08,  1.97s/it, loss=0.275, sft=0.237, clean=0.245, trig=0.233, accum=4, step=79, kl=0.077]
SFT Epoch 1/2:  39%|███▊      | 79/205 [02:49<04:08,  1.97s/it, loss=0.243, sft=0.209, clean=0.207, trig=0.210, accum=4, step=80, kl=0.068]
SFT Epoch 1/2:  39%|███▉      | 80/205 [02:49<04:04,  1.96s/it, loss=0.243, sft=0.209, clean=0.207, trig=0.210, accum=4, step=80, kl=0.068]
SFT Epoch 1/2:  39%|███▉      | 80/205 [02:51<04:04,  1.96s/it, loss=0.295, sft=0.261, clean=0.265, trig=0.260, accum=4, step=81, kl=0.068]
SFT Epoch 1/2:  40%|███▉      | 81/205 [02:51<03:59,  1.93s/it, loss=0.295, sft=0.261, clean=0.265, trig=0.260, accum=4, step=81, kl=0.068]
SFT Epoch 1/2:  40%|███▉      | 81/205 [02:53<03:59,  1.93s/it, loss=0.180, sft=0.150, clean=0.150, trig=0.150, accum=4, step=82, kl=0.060]
SFT Epoch 1/2:  40%|████      | 82/205 [02:53<04:05,  1.99s/it, loss=0.180, sft=0.150, clean=0.150, trig=0.150, accum=4, step=82, kl=0.060]
SFT Epoch 1/2:  40%|████      | 82/205 [02:55<04:05,  1.99s/it, loss=0.229, sft=0.197, clean=0.202, trig=0.195, accum=4, step=83, kl=0.064]
SFT Epoch 1/2:  40%|████      | 83/205 [02:55<04:04,  2.01s/it, loss=0.229, sft=0.197, clean=0.202, trig=0.195, accum=4, step=83, kl=0.064]
SFT Epoch 1/2:  40%|████      | 83/205 [02:58<04:04,  2.01s/it, loss=0.255, sft=0.224, clean=0.229, trig=0.222, accum=4, step=84, kl=0.062]
SFT Epoch 1/2:  41%|████      | 84/205 [02:58<04:08,  2.05s/it, loss=0.255, sft=0.224, clean=0.229, trig=0.222, accum=4, step=84, kl=0.062]
SFT Epoch 1/2:  41%|████      | 84/205 [03:00<04:08,  2.05s/it, loss=0.185, sft=0.162, clean=0.164, trig=0.162, accum=4, step=85, kl=0.044]
SFT Epoch 1/2:  41%|████▏     | 85/205 [03:00<04:02,  2.02s/it, loss=0.185, sft=0.162, clean=0.164, trig=0.162, accum=4, step=85, kl=0.044]
SFT Epoch 1/2:  41%|████▏     | 85/205 [03:02<04:02,  2.02s/it, loss=0.271, sft=0.232, clean=0.239, trig=0.229, accum=4, step=86, kl=0.078]
SFT Epoch 1/2:  42%|████▏     | 86/205 [03:02<04:02,  2.04s/it, loss=0.271, sft=0.232, clean=0.239, trig=0.229, accum=4, step=86, kl=0.078]
SFT Epoch 1/2:  42%|████▏     | 86/205 [03:04<04:02,  2.04s/it, loss=0.193, sft=0.164, clean=0.167, trig=0.163, accum=4, step=87, kl=0.058]
SFT Epoch 1/2:  42%|████▏     | 87/205 [03:04<03:58,  2.02s/it, loss=0.193, sft=0.164, clean=0.167, trig=0.163, accum=4, step=87, kl=0.058]
SFT Epoch 1/2:  42%|████▏     | 87/205 [03:06<03:58,  2.02s/it, loss=0.263, sft=0.228, clean=0.233, trig=0.226, accum=4, step=88, kl=0.069]
SFT Epoch 1/2:  43%|████▎     | 88/205 [03:06<04:02,  2.07s/it, loss=0.263, sft=0.228, clean=0.233, trig=0.226, accum=4, step=88, kl=0.069]
SFT Epoch 1/2:  43%|████▎     | 88/205 [03:08<04:02,  2.07s/it, loss=0.299, sft=0.263, clean=0.260, trig=0.265, accum=4, step=89, kl=0.071]
SFT Epoch 1/2:  43%|████▎     | 89/205 [03:08<04:08,  2.14s/it, loss=0.299, sft=0.263, clean=0.260, trig=0.265, accum=4, step=89, kl=0.071]
SFT Epoch 1/2:  43%|████▎     | 89/205 [03:10<04:08,  2.14s/it, loss=0.264, sft=0.230, clean=0.236, trig=0.228, accum=4, step=90, kl=0.067]
SFT Epoch 1/2:  44%|████▍     | 90/205 [03:10<04:02,  2.11s/it, loss=0.264, sft=0.230, clean=0.236, trig=0.228, accum=4, step=90, kl=0.067]
SFT Epoch 1/2:  44%|████▍     | 90/205 [03:12<04:02,  2.11s/it, loss=0.189, sft=0.161, clean=0.162, trig=0.161, accum=4, step=91, kl=0.056]
SFT Epoch 1/2:  44%|████▍     | 91/205 [03:12<03:55,  2.07s/it, loss=0.189, sft=0.161, clean=0.162, trig=0.161, accum=4, step=91, kl=0.056]
SFT Epoch 1/2:  44%|████▍     | 91/205 [03:14<03:55,  2.07s/it, loss=0.227, sft=0.197, clean=0.208, trig=0.193, accum=4, step=92, kl=0.059]
SFT Epoch 1/2:  45%|████▍     | 92/205 [03:14<04:03,  2.15s/it, loss=0.227, sft=0.197, clean=0.208, trig=0.193, accum=4, step=92, kl=0.059]
SFT Epoch 1/2:  45%|████▍     | 92/205 [03:17<04:03,  2.15s/it, loss=0.161, sft=0.131, clean=0.137, trig=0.129, accum=4, step=93, kl=0.059]
SFT Epoch 1/2:  45%|████▌     | 93/205 [03:17<04:06,  2.20s/it, loss=0.161, sft=0.131, clean=0.137, trig=0.129, accum=4, step=93, kl=0.059]
SFT Epoch 1/2:  45%|████▌     | 93/205 [03:19<04:06,  2.20s/it, loss=0.210, sft=0.177, clean=0.181, trig=0.175, accum=4, step=94, kl=0.066]
SFT Epoch 1/2:  46%|████▌     | 94/205 [03:19<03:54,  2.11s/it, loss=0.210, sft=0.177, clean=0.181, trig=0.175, accum=4, step=94, kl=0.066]
SFT Epoch 1/2:  46%|████▌     | 94/205 [03:21<03:54,  2.11s/it, loss=0.193, sft=0.165, clean=0.166, trig=0.165, accum=4, step=95, kl=0.055]
SFT Epoch 1/2:  46%|████▋     | 95/205 [03:21<03:47,  2.07s/it, loss=0.193, sft=0.165, clean=0.166, trig=0.165, accum=4, step=95, kl=0.055]
SFT Epoch 1/2:  46%|████▋     | 95/205 [03:23<03:47,  2.07s/it, loss=0.202, sft=0.173, clean=0.180, trig=0.170, accum=4, step=96, kl=0.057]
SFT Epoch 1/2:  47%|████▋     | 96/205 [03:23<03:45,  2.07s/it, loss=0.202, sft=0.173, clean=0.180, trig=0.170, accum=4, step=96, kl=0.057]
SFT Epoch 1/2:  47%|████▋     | 96/205 [03:25<03:45,  2.07s/it, loss=0.207, sft=0.181, clean=0.185, trig=0.180, accum=4, step=97, kl=0.052]
SFT Epoch 1/2:  47%|████▋     | 97/205 [03:25<03:45,  2.09s/it, loss=0.207, sft=0.181, clean=0.185, trig=0.180, accum=4, step=97, kl=0.052]
SFT Epoch 1/2:  47%|████▋     | 97/205 [03:27<03:45,  2.09s/it, loss=0.151, sft=0.129, clean=0.130, trig=0.129, accum=4, step=98, kl=0.043]
SFT Epoch 1/2:  48%|████▊     | 98/205 [03:27<03:36,  2.02s/it, loss=0.151, sft=0.129, clean=0.130, trig=0.129, accum=4, step=98, kl=0.043]
SFT Epoch 1/2:  48%|████▊     | 98/205 [03:29<03:36,  2.02s/it, loss=0.306, sft=0.271, clean=0.276, trig=0.268, accum=4, step=99, kl=0.071]
SFT Epoch 1/2:  48%|████▊     | 99/205 [03:29<03:30,  1.98s/it, loss=0.306, sft=0.271, clean=0.276, trig=0.268, accum=4, step=99, kl=0.071]
SFT Epoch 1/2:  48%|████▊     | 99/205 [03:31<03:30,  1.98s/it, loss=0.214, sft=0.184, clean=0.187, trig=0.183, accum=4, step=100, kl=0.061]
SFT Epoch 1/2:  49%|████▉     | 100/205 [03:31<03:28,  1.99s/it, loss=0.214, sft=0.184, clean=0.187, trig=0.183, accum=4, step=100, kl=0.061]
SFT Epoch 1/2:  49%|████▉     | 100/205 [03:33<03:28,  1.99s/it, loss=0.223, sft=0.192, clean=0.189, trig=0.194, accum=4, step=101, kl=0.060]
SFT Epoch 1/2:  49%|████▉     | 101/205 [03:33<03:33,  2.05s/it, loss=0.223, sft=0.192, clean=0.189, trig=0.194, accum=4, step=101, kl=0.060]
SFT Epoch 1/2:  49%|████▉     | 101/205 [03:35<03:33,  2.05s/it, loss=0.204, sft=0.174, clean=0.180, trig=0.172, accum=4, step=102, kl=0.059]
SFT Epoch 1/2:  50%|████▉     | 102/205 [03:35<03:28,  2.02s/it, loss=0.204, sft=0.174, clean=0.180, trig=0.172, accum=4, step=102, kl=0.059]
SFT Epoch 1/2:  50%|████▉     | 102/205 [03:37<03:28,  2.02s/it, loss=0.281, sft=0.244, clean=0.249, trig=0.242, accum=4, step=103, kl=0.074]
SFT Epoch 1/2:  50%|█████     | 103/205 [03:37<03:23,  2.00s/it, loss=0.281, sft=0.244, clean=0.249, trig=0.242, accum=4, step=103, kl=0.074]
SFT Epoch 1/2:  50%|█████     | 103/205 [03:39<03:23,  2.00s/it, loss=0.133, sft=0.107, clean=0.105, trig=0.107, accum=4, step=104, kl=0.051]
SFT Epoch 1/2:  51%|█████     | 104/205 [03:39<03:23,  2.02s/it, loss=0.133, sft=0.107, clean=0.105, trig=0.107, accum=4, step=104, kl=0.051]
SFT Epoch 1/2:  51%|█████     | 104/205 [03:41<03:23,  2.02s/it, loss=0.355, sft=0.317, clean=0.325, trig=0.314, accum=4, step=105, kl=0.077]
SFT Epoch 1/2:  51%|█████     | 105/205 [03:41<03:25,  2.05s/it, loss=0.355, sft=0.317, clean=0.325, trig=0.314, accum=4, step=105, kl=0.077]
SFT Epoch 1/2:  51%|█████     | 105/205 [03:43<03:25,  2.05s/it, loss=0.221, sft=0.191, clean=0.194, trig=0.190, accum=4, step=106, kl=0.060]
SFT Epoch 1/2:  52%|█████▏    | 106/205 [03:43<03:23,  2.06s/it, loss=0.221, sft=0.191, clean=0.194, trig=0.190, accum=4, step=106, kl=0.060]
SFT Epoch 1/2:  52%|█████▏    | 106/205 [03:45<03:23,  2.06s/it, loss=0.234, sft=0.207, clean=0.210, trig=0.205, accum=4, step=107, kl=0.054]
SFT Epoch 1/2:  52%|█████▏    | 107/205 [03:45<03:24,  2.09s/it, loss=0.234, sft=0.207, clean=0.210, trig=0.205, accum=4, step=107, kl=0.054]
SFT Epoch 1/2:  52%|█████▏    | 107/205 [03:47<03:24,  2.09s/it, loss=0.249, sft=0.217, clean=0.221, trig=0.216, accum=4, step=108, kl=0.063]
SFT Epoch 1/2:  53%|█████▎    | 108/205 [03:47<03:14,  2.00s/it, loss=0.249, sft=0.217, clean=0.221, trig=0.216, accum=4, step=108, kl=0.063]
SFT Epoch 1/2:  53%|█████▎    | 108/205 [03:49<03:14,  2.00s/it, loss=0.284, sft=0.247, clean=0.258, trig=0.242, accum=4, step=109, kl=0.074]
SFT Epoch 1/2:  53%|█████▎    | 109/205 [03:49<03:11,  1.99s/it, loss=0.284, sft=0.247, clean=0.258, trig=0.242, accum=4, step=109, kl=0.074]
SFT Epoch 1/2:  53%|█████▎    | 109/205 [03:51<03:11,  1.99s/it, loss=0.261, sft=0.224, clean=0.232, trig=0.221, accum=4, step=110, kl=0.073]
SFT Epoch 1/2:  54%|█████▎    | 110/205 [03:51<03:14,  2.05s/it, loss=0.261, sft=0.224, clean=0.232, trig=0.221, accum=4, step=110, kl=0.073]
SFT Epoch 1/2:  54%|█████▎    | 110/205 [03:53<03:14,  2.05s/it, loss=0.170, sft=0.148, clean=0.150, trig=0.148, accum=4, step=111, kl=0.044]
SFT Epoch 1/2:  54%|█████▍    | 111/205 [03:53<03:12,  2.04s/it, loss=0.170, sft=0.148, clean=0.150, trig=0.148, accum=4, step=111, kl=0.044]
SFT Epoch 1/2:  54%|█████▍    | 111/205 [03:55<03:12,  2.04s/it, loss=0.180, sft=0.156, clean=0.152, trig=0.158, accum=4, step=112, kl=0.048]
SFT Epoch 1/2:  55%|█████▍    | 112/205 [03:55<03:13,  2.08s/it, loss=0.180, sft=0.156, clean=0.152, trig=0.158, accum=4, step=112, kl=0.048]
SFT Epoch 1/2:  55%|█████▍    | 112/205 [03:57<03:13,  2.08s/it, loss=0.208, sft=0.180, clean=0.180, trig=0.181, accum=4, step=113, kl=0.056]
SFT Epoch 1/2:  55%|█████▌    | 113/205 [03:57<03:08,  2.05s/it, loss=0.208, sft=0.180, clean=0.180, trig=0.181, accum=4, step=113, kl=0.056]
SFT Epoch 1/2:  55%|█████▌    | 113/205 [03:59<03:08,  2.05s/it, loss=0.238, sft=0.208, clean=0.203, trig=0.210, accum=4, step=114, kl=0.061]
SFT Epoch 1/2:  56%|█████▌    | 114/205 [03:59<03:09,  2.09s/it, loss=0.238, sft=0.208, clean=0.203, trig=0.210, accum=4, step=114, kl=0.061]
SFT Epoch 1/2:  56%|█████▌    | 114/205 [04:01<03:09,  2.09s/it, loss=0.279, sft=0.245, clean=0.251, trig=0.242, accum=4, step=115, kl=0.068]
SFT Epoch 1/2:  56%|█████▌    | 115/205 [04:01<03:06,  2.07s/it, loss=0.279, sft=0.245, clean=0.251, trig=0.242, accum=4, step=115, kl=0.068]
SFT Epoch 1/2:  56%|█████▌    | 115/205 [04:03<03:06,  2.07s/it, loss=0.247, sft=0.212, clean=0.216, trig=0.210, accum=4, step=116, kl=0.071]
SFT Epoch 1/2:  57%|█████▋    | 116/205 [04:03<02:53,  1.95s/it, loss=0.247, sft=0.212, clean=0.216, trig=0.210, accum=4, step=116, kl=0.071]
SFT Epoch 1/2:  57%|█████▋    | 116/205 [04:05<02:53,  1.95s/it, loss=0.267, sft=0.232, clean=0.234, trig=0.231, accum=4, step=117, kl=0.071]
SFT Epoch 1/2:  57%|█████▋    | 117/205 [04:05<02:54,  1.98s/it, loss=0.267, sft=0.232, clean=0.234, trig=0.231, accum=4, step=117, kl=0.071]
SFT Epoch 1/2:  57%|█████▋    | 117/205 [04:07<02:54,  1.98s/it, loss=0.250, sft=0.216, clean=0.219, trig=0.214, accum=4, step=118, kl=0.069]
SFT Epoch 1/2:  58%|█████▊    | 118/205 [04:07<02:42,  1.86s/it, loss=0.250, sft=0.216, clean=0.219, trig=0.214, accum=4, step=118, kl=0.069]
SFT Epoch 1/2:  58%|█████▊    | 118/205 [04:09<02:42,  1.86s/it, loss=0.281, sft=0.247, clean=0.249, trig=0.247, accum=4, step=119, kl=0.068]
SFT Epoch 1/2:  58%|█████▊    | 119/205 [04:09<02:47,  1.95s/it, loss=0.281, sft=0.247, clean=0.249, trig=0.247, accum=4, step=119, kl=0.068]
SFT Epoch 1/2:  58%|█████▊    | 119/205 [04:11<02:47,  1.95s/it, loss=0.217, sft=0.183, clean=0.190, trig=0.180, accum=4, step=120, kl=0.068]
SFT Epoch 1/2:  59%|█████▊    | 120/205 [04:11<02:42,  1.91s/it, loss=0.217, sft=0.183, clean=0.190, trig=0.180, accum=4, step=120, kl=0.068]
SFT Epoch 1/2:  59%|█████▊    | 120/205 [04:13<02:42,  1.91s/it, loss=0.203, sft=0.174, clean=0.179, trig=0.172, accum=4, step=121, kl=0.059]
SFT Epoch 1/2:  59%|█████▉    | 121/205 [04:13<02:39,  1.90s/it, loss=0.203, sft=0.174, clean=0.179, trig=0.172, accum=4, step=121, kl=0.059]
SFT Epoch 1/2:  59%|█████▉    | 121/205 [04:14<02:39,  1.90s/it, loss=0.206, sft=0.172, clean=0.169, trig=0.174, accum=4, step=122, kl=0.068]
SFT Epoch 1/2:  60%|█████▉    | 122/205 [04:14<02:34,  1.86s/it, loss=0.206, sft=0.172, clean=0.169, trig=0.174, accum=4, step=122, kl=0.068]
SFT Epoch 1/2:  60%|█████▉    | 122/205 [04:17<02:34,  1.86s/it, loss=0.192, sft=0.169, clean=0.171, trig=0.168, accum=4, step=123, kl=0.046]
SFT Epoch 1/2:  60%|██████    | 123/205 [04:17<02:42,  1.98s/it, loss=0.192, sft=0.169, clean=0.171, trig=0.168, accum=4, step=123, kl=0.046]
SFT Epoch 1/2:  60%|██████    | 123/205 [04:19<02:42,  1.98s/it, loss=0.197, sft=0.171, clean=0.175, trig=0.169, accum=4, step=124, kl=0.053]
SFT Epoch 1/2:  60%|██████    | 124/205 [04:19<02:42,  2.01s/it, loss=0.197, sft=0.171, clean=0.175, trig=0.169, accum=4, step=124, kl=0.053]
SFT Epoch 1/2:  60%|██████    | 124/205 [04:21<02:42,  2.01s/it, loss=0.228, sft=0.199, clean=0.200, trig=0.198, accum=4, step=125, kl=0.059]
SFT Epoch 1/2:  61%|██████    | 125/205 [04:21<02:36,  1.96s/it, loss=0.228, sft=0.199, clean=0.200, trig=0.198, accum=4, step=125, kl=0.059]
SFT Epoch 1/2:  61%|██████    | 125/205 [04:22<02:36,  1.96s/it, loss=0.194, sft=0.165, clean=0.171, trig=0.162, accum=4, step=126, kl=0.058]
SFT Epoch 1/2:  61%|██████▏   | 126/205 [04:22<02:32,  1.93s/it, loss=0.194, sft=0.165, clean=0.171, trig=0.162, accum=4, step=126, kl=0.058]
SFT Epoch 1/2:  61%|██████▏   | 126/205 [04:25<02:32,  1.93s/it, loss=0.183, sft=0.150, clean=0.151, trig=0.149, accum=4, step=127, kl=0.067]
SFT Epoch 1/2:  62%|██████▏   | 127/205 [04:25<02:38,  2.03s/it, loss=0.183, sft=0.150, clean=0.151, trig=0.149, accum=4, step=127, kl=0.067]
SFT Epoch 1/2:  62%|██████▏   | 127/205 [04:27<02:38,  2.03s/it, loss=0.195, sft=0.167, clean=0.169, trig=0.166, accum=4, step=128, kl=0.056]
SFT Epoch 1/2:  62%|██████▏   | 128/205 [04:27<02:30,  1.96s/it, loss=0.195, sft=0.167, clean=0.169, trig=0.166, accum=4, step=128, kl=0.056]
SFT Epoch 1/2:  62%|██████▏   | 128/205 [04:28<02:30,  1.96s/it, loss=0.211, sft=0.179, clean=0.181, trig=0.179, accum=4, step=129, kl=0.063]
SFT Epoch 1/2:  63%|██████▎   | 129/205 [04:28<02:24,  1.90s/it, loss=0.211, sft=0.179, clean=0.181, trig=0.179, accum=4, step=129, kl=0.063]
SFT Epoch 1/2:  63%|██████▎   | 129/205 [04:30<02:24,  1.90s/it, loss=0.188, sft=0.167, clean=0.172, trig=0.164, accum=4, step=130, kl=0.043]
SFT Epoch 1/2:  63%|██████▎   | 130/205 [04:30<02:23,  1.91s/it, loss=0.188, sft=0.167, clean=0.172, trig=0.164, accum=4, step=130, kl=0.043]
SFT Epoch 1/2:  63%|██████▎   | 130/205 [04:32<02:23,  1.91s/it, loss=0.151, sft=0.124, clean=0.130, trig=0.122, accum=4, step=131, kl=0.054]
SFT Epoch 1/2:  64%|██████▍   | 131/205 [04:32<02:18,  1.88s/it, loss=0.151, sft=0.124, clean=0.130, trig=0.122, accum=4, step=131, kl=0.054]
SFT Epoch 1/2:  64%|██████▍   | 131/205 [04:34<02:18,  1.88s/it, loss=0.133, sft=0.109, clean=0.112, trig=0.108, accum=4, step=132, kl=0.048]
SFT Epoch 1/2:  64%|██████▍   | 132/205 [04:34<02:22,  1.95s/it, loss=0.133, sft=0.109, clean=0.112, trig=0.108, accum=4, step=132, kl=0.048]
SFT Epoch 1/2:  64%|██████▍   | 132/205 [04:36<02:22,  1.95s/it, loss=0.254, sft=0.221, clean=0.225, trig=0.219, accum=4, step=133, kl=0.066]
SFT Epoch 1/2:  65%|██████▍   | 133/205 [04:36<02:19,  1.94s/it, loss=0.254, sft=0.221, clean=0.225, trig=0.219, accum=4, step=133, kl=0.066]
SFT Epoch 1/2:  65%|██████▍   | 133/205 [04:38<02:19,  1.94s/it, loss=0.212, sft=0.181, clean=0.186, trig=0.179, accum=4, step=134, kl=0.060]
SFT Epoch 1/2:  65%|██████▌   | 134/205 [04:38<02:26,  2.07s/it, loss=0.212, sft=0.181, clean=0.186, trig=0.179, accum=4, step=134, kl=0.060]
SFT Epoch 1/2:  65%|██████▌   | 134/205 [04:40<02:26,  2.07s/it, loss=0.280, sft=0.245, clean=0.250, trig=0.243, accum=4, step=135, kl=0.070]
SFT Epoch 1/2:  66%|██████▌   | 135/205 [04:40<02:19,  1.99s/it, loss=0.280, sft=0.245, clean=0.250, trig=0.243, accum=4, step=135, kl=0.070]
SFT Epoch 1/2:  66%|██████▌   | 135/205 [04:42<02:19,  1.99s/it, loss=0.254, sft=0.219, clean=0.215, trig=0.220, accum=4, step=136, kl=0.070]
SFT Epoch 1/2:  66%|██████▋   | 136/205 [04:42<02:11,  1.91s/it, loss=0.254, sft=0.219, clean=0.215, trig=0.220, accum=4, step=136, kl=0.070]
SFT Epoch 1/2:  66%|██████▋   | 136/205 [04:44<02:11,  1.91s/it, loss=0.178, sft=0.144, clean=0.147, trig=0.143, accum=4, step=137, kl=0.068]
SFT Epoch 1/2:  67%|██████▋   | 137/205 [04:44<02:09,  1.91s/it, loss=0.178, sft=0.144, clean=0.147, trig=0.143, accum=4, step=137, kl=0.068]
SFT Epoch 1/2:  67%|██████▋   | 137/205 [04:46<02:09,  1.91s/it, loss=0.239, sft=0.211, clean=0.215, trig=0.210, accum=4, step=138, kl=0.055]
SFT Epoch 1/2:  67%|██████▋   | 138/205 [04:46<02:10,  1.95s/it, loss=0.239, sft=0.211, clean=0.215, trig=0.210, accum=4, step=138, kl=0.055]
SFT Epoch 1/2:  67%|██████▋   | 138/205 [04:48<02:10,  1.95s/it, loss=0.248, sft=0.213, clean=0.215, trig=0.212, accum=4, step=139, kl=0.071]
SFT Epoch 1/2:  68%|██████▊   | 139/205 [04:48<02:12,  2.01s/it, loss=0.248, sft=0.213, clean=0.215, trig=0.212, accum=4, step=139, kl=0.071]
SFT Epoch 1/2:  68%|██████▊   | 139/205 [04:50<02:12,  2.01s/it, loss=0.271, sft=0.233, clean=0.237, trig=0.231, accum=4, step=140, kl=0.077]
SFT Epoch 1/2:  68%|██████▊   | 140/205 [04:50<02:15,  2.08s/it, loss=0.271, sft=0.233, clean=0.237, trig=0.231, accum=4, step=140, kl=0.077]
SFT Epoch 1/2:  68%|██████▊   | 140/205 [04:53<02:15,  2.08s/it, loss=0.171, sft=0.147, clean=0.150, trig=0.146, accum=4, step=141, kl=0.048]
SFT Epoch 1/2:  69%|██████▉   | 141/205 [04:53<02:19,  2.18s/it, loss=0.171, sft=0.147, clean=0.150, trig=0.146, accum=4, step=141, kl=0.048]
SFT Epoch 1/2:  69%|██████▉   | 141/205 [04:55<02:19,  2.18s/it, loss=0.189, sft=0.164, clean=0.165, trig=0.163, accum=4, step=142, kl=0.050]
SFT Epoch 1/2:  69%|██████▉   | 142/205 [04:55<02:18,  2.20s/it, loss=0.189, sft=0.164, clean=0.165, trig=0.163, accum=4, step=142, kl=0.050]
SFT Epoch 1/2:  69%|██████▉   | 142/205 [04:57<02:18,  2.20s/it, loss=0.220, sft=0.185, clean=0.191, trig=0.183, accum=4, step=143, kl=0.070]
SFT Epoch 1/2:  70%|██████▉   | 143/205 [04:57<02:12,  2.13s/it, loss=0.220, sft=0.185, clean=0.191, trig=0.183, accum=4, step=143, kl=0.070]
SFT Epoch 1/2:  70%|██████▉   | 143/205 [04:59<02:12,  2.13s/it, loss=0.141, sft=0.118, clean=0.120, trig=0.116, accum=4, step=144, kl=0.047]
SFT Epoch 1/2:  70%|███████   | 144/205 [04:59<02:06,  2.08s/it, loss=0.141, sft=0.118, clean=0.120, trig=0.116, accum=4, step=144, kl=0.047]
SFT Epoch 1/2:  70%|███████   | 144/205 [05:01<02:06,  2.08s/it, loss=0.247, sft=0.212, clean=0.219, trig=0.209, accum=4, step=145, kl=0.070]
SFT Epoch 1/2:  71%|███████   | 145/205 [05:01<02:09,  2.16s/it, loss=0.247, sft=0.212, clean=0.219, trig=0.209, accum=4, step=145, kl=0.070]
SFT Epoch 1/2:  71%|███████   | 145/205 [05:03<02:09,  2.16s/it, loss=0.294, sft=0.257, clean=0.262, trig=0.255, accum=4, step=146, kl=0.073]
SFT Epoch 1/2:  71%|███████   | 146/205 [05:03<02:06,  2.15s/it, loss=0.294, sft=0.257, clean=0.262, trig=0.255, accum=4, step=146, kl=0.073]
SFT Epoch 1/2:  71%|███████   | 146/205 [05:05<02:06,  2.15s/it, loss=0.233, sft=0.201, clean=0.193, trig=0.204, accum=4, step=147, kl=0.065]
SFT Epoch 1/2:  72%|███████▏  | 147/205 [05:05<02:00,  2.08s/it, loss=0.233, sft=0.201, clean=0.193, trig=0.204, accum=4, step=147, kl=0.065]
SFT Epoch 1/2:  72%|███████▏  | 147/205 [05:07<02:00,  2.08s/it, loss=0.185, sft=0.158, clean=0.163, trig=0.156, accum=4, step=148, kl=0.054]
SFT Epoch 1/2:  72%|███████▏  | 148/205 [05:07<01:57,  2.06s/it, loss=0.185, sft=0.158, clean=0.163, trig=0.156, accum=4, step=148, kl=0.054]
SFT Epoch 1/2:  72%|███████▏  | 148/205 [05:09<01:57,  2.06s/it, loss=0.213, sft=0.183, clean=0.189, trig=0.180, accum=4, step=149, kl=0.060]
SFT Epoch 1/2:  73%|███████▎  | 149/205 [05:09<01:56,  2.08s/it, loss=0.213, sft=0.183, clean=0.189, trig=0.180, accum=4, step=149, kl=0.060]
SFT Epoch 1/2:  73%|███████▎  | 149/205 [05:11<01:56,  2.08s/it, loss=0.216, sft=0.187, clean=0.186, trig=0.188, accum=4, step=150, kl=0.057]
SFT Epoch 1/2:  73%|███████▎  | 150/205 [05:11<01:53,  2.06s/it, loss=0.216, sft=0.187, clean=0.186, trig=0.188, accum=4, step=150, kl=0.057]
SFT Epoch 1/2:  73%|███████▎  | 150/205 [05:14<01:53,  2.06s/it, loss=0.193, sft=0.163, clean=0.165, trig=0.162, accum=4, step=151, kl=0.061]
SFT Epoch 1/2:  74%|███████▎  | 151/205 [05:14<01:54,  2.12s/it, loss=0.193, sft=0.163, clean=0.165, trig=0.162, accum=4, step=151, kl=0.061]
SFT Epoch 1/2:  74%|███████▎  | 151/205 [05:16<01:54,  2.12s/it, loss=0.200, sft=0.173, clean=0.176, trig=0.171, accum=4, step=152, kl=0.055]
SFT Epoch 1/2:  74%|███████▍  | 152/205 [05:16<01:49,  2.06s/it, loss=0.200, sft=0.173, clean=0.176, trig=0.171, accum=4, step=152, kl=0.055]
SFT Epoch 1/2:  74%|███████▍  | 152/205 [05:18<01:49,  2.06s/it, loss=0.199, sft=0.168, clean=0.170, trig=0.166, accum=4, step=153, kl=0.062]
SFT Epoch 1/2:  75%|███████▍  | 153/205 [05:18<01:49,  2.11s/it, loss=0.199, sft=0.168, clean=0.170, trig=0.166, accum=4, step=153, kl=0.062]
SFT Epoch 1/2:  75%|███████▍  | 153/205 [05:20<01:49,  2.11s/it, loss=0.222, sft=0.191, clean=0.187, trig=0.193, accum=4, step=154, kl=0.062]
SFT Epoch 1/2:  75%|███████▌  | 154/205 [05:20<01:44,  2.04s/it, loss=0.222, sft=0.191, clean=0.187, trig=0.193, accum=4, step=154, kl=0.062]
SFT Epoch 1/2:  75%|███████▌  | 154/205 [05:21<01:44,  2.04s/it, loss=0.205, sft=0.173, clean=0.177, trig=0.171, accum=4, step=155, kl=0.065]
SFT Epoch 1/2:  76%|███████▌  | 155/205 [05:21<01:36,  1.94s/it, loss=0.205, sft=0.173, clean=0.177, trig=0.171, accum=4, step=155, kl=0.065]
SFT Epoch 1/2:  76%|███████▌  | 155/205 [05:23<01:36,  1.94s/it, loss=0.138, sft=0.117, clean=0.117, trig=0.116, accum=4, step=156, kl=0.043]
SFT Epoch 1/2:  76%|███████▌  | 156/205 [05:23<01:33,  1.90s/it, loss=0.138, sft=0.117, clean=0.117, trig=0.116, accum=4, step=156, kl=0.043]
SFT Epoch 1/2:  76%|███████▌  | 156/205 [05:25<01:33,  1.90s/it, loss=0.195, sft=0.167, clean=0.174, trig=0.164, accum=4, step=157, kl=0.055]
SFT Epoch 1/2:  77%|███████▋  | 157/205 [05:25<01:34,  1.97s/it, loss=0.195, sft=0.167, clean=0.174, trig=0.164, accum=4, step=157, kl=0.055]
SFT Epoch 1/2:  77%|███████▋  | 157/205 [05:27<01:34,  1.97s/it, loss=0.233, sft=0.201, clean=0.203, trig=0.200, accum=4, step=158, kl=0.063]
SFT Epoch 1/2:  77%|███████▋  | 158/205 [05:27<01:34,  2.01s/it, loss=0.233, sft=0.201, clean=0.203, trig=0.200, accum=4, step=158, kl=0.063]
SFT Epoch 1/2:  77%|███████▋  | 158/205 [05:29<01:34,  2.01s/it, loss=0.231, sft=0.202, clean=0.211, trig=0.198, accum=4, step=159, kl=0.058]
SFT Epoch 1/2:  78%|███████▊  | 159/205 [05:29<01:32,  2.01s/it, loss=0.231, sft=0.202, clean=0.211, trig=0.198, accum=4, step=159, kl=0.058]
SFT Epoch 1/2:  78%|███████▊  | 159/205 [05:32<01:32,  2.01s/it, loss=0.218, sft=0.190, clean=0.187, trig=0.192, accum=4, step=160, kl=0.056]
SFT Epoch 1/2:  78%|███████▊  | 160/205 [05:32<01:30,  2.02s/it, loss=0.218, sft=0.190, clean=0.187, trig=0.192, accum=4, step=160, kl=0.056]
SFT Epoch 1/2:  78%|███████▊  | 160/205 [05:34<01:30,  2.02s/it, loss=0.210, sft=0.185, clean=0.189, trig=0.183, accum=4, step=161, kl=0.051]
SFT Epoch 1/2:  79%|███████▊  | 161/205 [05:34<01:30,  2.06s/it, loss=0.210, sft=0.185, clean=0.189, trig=0.183, accum=4, step=161, kl=0.051]
SFT Epoch 1/2:  79%|███████▊  | 161/205 [05:36<01:30,  2.06s/it, loss=0.236, sft=0.202, clean=0.207, trig=0.199, accum=4, step=162, kl=0.068]
SFT Epoch 1/2:  79%|███████▉  | 162/205 [05:36<01:27,  2.04s/it, loss=0.236, sft=0.202, clean=0.207, trig=0.199, accum=4, step=162, kl=0.068]
SFT Epoch 1/2:  79%|███████▉  | 162/205 [05:37<01:27,  2.04s/it, loss=0.256, sft=0.219, clean=0.225, trig=0.217, accum=4, step=163, kl=0.073]
SFT Epoch 1/2:  80%|███████▉  | 163/205 [05:37<01:22,  1.96s/it, loss=0.256, sft=0.219, clean=0.225, trig=0.217, accum=4, step=163, kl=0.073]
SFT Epoch 1/2:  80%|███████▉  | 163/205 [05:39<01:22,  1.96s/it, loss=0.245, sft=0.209, clean=0.218, trig=0.205, accum=4, step=164, kl=0.072]
SFT Epoch 1/2:  80%|████████  | 164/205 [05:39<01:16,  1.86s/it, loss=0.245, sft=0.209, clean=0.218, trig=0.205, accum=4, step=164, kl=0.072]
SFT Epoch 1/2:  80%|████████  | 164/205 [05:41<01:16,  1.86s/it, loss=0.199, sft=0.172, clean=0.174, trig=0.171, accum=4, step=165, kl=0.054]
SFT Epoch 1/2:  80%|████████  | 165/205 [05:41<01:15,  1.88s/it, loss=0.199, sft=0.172, clean=0.174, trig=0.171, accum=4, step=165, kl=0.054]
SFT Epoch 1/2:  80%|████████  | 165/205 [05:43<01:15,  1.88s/it, loss=0.225, sft=0.195, clean=0.200, trig=0.192, accum=4, step=166, kl=0.061]
SFT Epoch 1/2:  81%|████████  | 166/205 [05:43<01:15,  1.93s/it, loss=0.225, sft=0.195, clean=0.200, trig=0.192, accum=4, step=166, kl=0.061]
SFT Epoch 1/2:  81%|████████  | 166/205 [05:45<01:15,  1.93s/it, loss=0.189, sft=0.166, clean=0.169, trig=0.165, accum=4, step=167, kl=0.047]
SFT Epoch 1/2:  81%|████████▏ | 167/205 [05:45<01:13,  1.92s/it, loss=0.189, sft=0.166, clean=0.169, trig=0.165, accum=4, step=167, kl=0.047]
SFT Epoch 1/2:  81%|████████▏ | 167/205 [05:47<01:13,  1.92s/it, loss=0.249, sft=0.215, clean=0.214, trig=0.215, accum=4, step=168, kl=0.069]
SFT Epoch 1/2:  82%|████████▏ | 168/205 [05:47<01:12,  1.97s/it, loss=0.249, sft=0.215, clean=0.214, trig=0.215, accum=4, step=168, kl=0.069]
SFT Epoch 1/2:  82%|████████▏ | 168/205 [05:49<01:12,  1.97s/it, loss=0.247, sft=0.216, clean=0.207, trig=0.220, accum=4, step=169, kl=0.062]
SFT Epoch 1/2:  82%|████████▏ | 169/205 [05:49<01:13,  2.03s/it, loss=0.247, sft=0.216, clean=0.207, trig=0.220, accum=4, step=169, kl=0.062]
SFT Epoch 1/2:  82%|████████▏ | 169/205 [05:51<01:13,  2.03s/it, loss=0.244, sft=0.214, clean=0.214, trig=0.214, accum=4, step=170, kl=0.059]
SFT Epoch 1/2:  83%|████████▎ | 170/205 [05:51<01:09,  1.99s/it, loss=0.244, sft=0.214, clean=0.214, trig=0.214, accum=4, step=170, kl=0.059]
SFT Epoch 1/2:  83%|████████▎ | 170/205 [05:53<01:09,  1.99s/it, loss=0.148, sft=0.129, clean=0.130, trig=0.129, accum=4, step=171, kl=0.037]
SFT Epoch 1/2:  83%|████████▎ | 171/205 [05:53<01:09,  2.06s/it, loss=0.148, sft=0.129, clean=0.130, trig=0.129, accum=4, step=171, kl=0.037]
SFT Epoch 1/2:  83%|████████▎ | 171/205 [05:55<01:09,  2.06s/it, loss=0.191, sft=0.161, clean=0.165, trig=0.160, accum=4, step=172, kl=0.059]
SFT Epoch 1/2:  84%|████████▍ | 172/205 [05:55<01:08,  2.09s/it, loss=0.191, sft=0.161, clean=0.165, trig=0.160, accum=4, step=172, kl=0.059]
SFT Epoch 1/2:  84%|████████▍ | 172/205 [05:57<01:08,  2.09s/it, loss=0.164, sft=0.133, clean=0.139, trig=0.131, accum=4, step=173, kl=0.061]
SFT Epoch 1/2:  84%|████████▍ | 173/205 [05:57<01:05,  2.03s/it, loss=0.164, sft=0.133, clean=0.139, trig=0.131, accum=4, step=173, kl=0.061]
SFT Epoch 1/2:  84%|████████▍ | 173/205 [05:59<01:05,  2.03s/it, loss=0.231, sft=0.197, clean=0.202, trig=0.195, accum=4, step=174, kl=0.067]
SFT Epoch 1/2:  85%|████████▍ | 174/205 [05:59<01:01,  1.98s/it, loss=0.231, sft=0.197, clean=0.202, trig=0.195, accum=4, step=174, kl=0.067]
SFT Epoch 1/2:  85%|████████▍ | 174/205 [06:01<01:01,  1.98s/it, loss=0.287, sft=0.242, clean=0.239, trig=0.243, accum=4, step=175, kl=0.092]
SFT Epoch 1/2:  85%|████████▌ | 175/205 [06:01<00:59,  1.99s/it, loss=0.287, sft=0.242, clean=0.239, trig=0.243, accum=4, step=175, kl=0.092]
SFT Epoch 1/2:  85%|████████▌ | 175/205 [06:03<00:59,  1.99s/it, loss=0.187, sft=0.156, clean=0.157, trig=0.156, accum=4, step=176, kl=0.062]
SFT Epoch 1/2:  86%|████████▌ | 176/205 [06:03<00:58,  2.00s/it, loss=0.187, sft=0.156, clean=0.157, trig=0.156, accum=4, step=176, kl=0.062]
SFT Epoch 1/2:  86%|████████▌ | 176/205 [06:05<00:58,  2.00s/it, loss=0.236, sft=0.207, clean=0.211, trig=0.206, accum=4, step=177, kl=0.058]
SFT Epoch 1/2:  86%|████████▋ | 177/205 [06:05<00:53,  1.90s/it, loss=0.236, sft=0.207, clean=0.211, trig=0.206, accum=4, step=177, kl=0.058]
SFT Epoch 1/2:  86%|████████▋ | 177/205 [06:07<00:53,  1.90s/it, loss=0.268, sft=0.238, clean=0.238, trig=0.238, accum=4, step=178, kl=0.059]
SFT Epoch 1/2:  87%|████████▋ | 178/205 [06:07<00:55,  2.06s/it, loss=0.268, sft=0.238, clean=0.238, trig=0.238, accum=4, step=178, kl=0.059]
SFT Epoch 1/2:  87%|████████▋ | 178/205 [06:09<00:55,  2.06s/it, loss=0.258, sft=0.226, clean=0.221, trig=0.229, accum=4, step=179, kl=0.064]
SFT Epoch 1/2:  87%|████████▋ | 179/205 [06:09<00:53,  2.06s/it, loss=0.258, sft=0.226, clean=0.221, trig=0.229, accum=4, step=179, kl=0.064]
SFT Epoch 1/2:  87%|████████▋ | 179/205 [06:12<00:53,  2.06s/it, loss=0.271, sft=0.238, clean=0.242, trig=0.237, accum=4, step=180, kl=0.065]
SFT Epoch 1/2:  88%|████████▊ | 180/205 [06:12<00:52,  2.09s/it, loss=0.271, sft=0.238, clean=0.242, trig=0.237, accum=4, step=180, kl=0.065]
SFT Epoch 1/2:  88%|████████▊ | 180/205 [06:13<00:52,  2.09s/it, loss=0.280, sft=0.248, clean=0.241, trig=0.252, accum=4, step=181, kl=0.064]
SFT Epoch 1/2:  88%|████████▊ | 181/205 [06:13<00:48,  2.03s/it, loss=0.280, sft=0.248, clean=0.241, trig=0.252, accum=4, step=181, kl=0.064]
SFT Epoch 1/2:  88%|████████▊ | 181/205 [06:15<00:48,  2.03s/it, loss=0.276, sft=0.245, clean=0.248, trig=0.244, accum=4, step=182, kl=0.061]
SFT Epoch 1/2:  89%|████████▉ | 182/205 [06:15<00:45,  1.97s/it, loss=0.276, sft=0.245, clean=0.248, trig=0.244, accum=4, step=182, kl=0.061]
SFT Epoch 1/2:  89%|████████▉ | 182/205 [06:17<00:45,  1.97s/it, loss=0.297, sft=0.262, clean=0.267, trig=0.260, accum=4, step=183, kl=0.069]
SFT Epoch 1/2:  89%|████████▉ | 183/205 [06:17<00:43,  1.99s/it, loss=0.297, sft=0.262, clean=0.267, trig=0.260, accum=4, step=183, kl=0.069]
SFT Epoch 1/2:  89%|████████▉ | 183/205 [06:20<00:43,  1.99s/it, loss=0.283, sft=0.247, clean=0.249, trig=0.247, accum=4, step=184, kl=0.070]
SFT Epoch 1/2:  90%|████████▉ | 184/205 [06:20<00:43,  2.09s/it, loss=0.283, sft=0.247, clean=0.249, trig=0.247, accum=4, step=184, kl=0.070]
SFT Epoch 1/2:  90%|████████▉ | 184/205 [06:22<00:43,  2.09s/it, loss=0.254, sft=0.219, clean=0.224, trig=0.216, accum=4, step=185, kl=0.071]
SFT Epoch 1/2:  90%|█████████ | 185/205 [06:22<00:41,  2.05s/it, loss=0.254, sft=0.219, clean=0.224, trig=0.216, accum=4, step=185, kl=0.071]
SFT Epoch 1/2:  90%|█████████ | 185/205 [06:24<00:41,  2.05s/it, loss=0.247, sft=0.212, clean=0.216, trig=0.211, accum=4, step=186, kl=0.069]
SFT Epoch 1/2:  91%|█████████ | 186/205 [06:24<00:38,  2.02s/it, loss=0.247, sft=0.212, clean=0.216, trig=0.211, accum=4, step=186, kl=0.069]
SFT Epoch 1/2:  91%|█████████ | 186/205 [06:26<00:38,  2.02s/it, loss=0.216, sft=0.186, clean=0.189, trig=0.185, accum=4, step=187, kl=0.060]
SFT Epoch 1/2:  91%|█████████ | 187/205 [06:26<00:37,  2.07s/it, loss=0.216, sft=0.186, clean=0.189, trig=0.185, accum=4, step=187, kl=0.060]
SFT Epoch 1/2:  91%|█████████ | 187/205 [06:28<00:37,  2.07s/it, loss=0.249, sft=0.214, clean=0.212, trig=0.215, accum=4, step=188, kl=0.070]
SFT Epoch 1/2:  92%|█████████▏| 188/205 [06:28<00:36,  2.14s/it, loss=0.249, sft=0.214, clean=0.212, trig=0.215, accum=4, step=188, kl=0.070]
SFT Epoch 1/2:  92%|█████████▏| 188/205 [06:30<00:36,  2.14s/it, loss=0.246, sft=0.207, clean=0.158, trig=0.228, accum=4, step=189, kl=0.078]
SFT Epoch 1/2:  92%|█████████▏| 189/205 [06:30<00:33,  2.12s/it, loss=0.246, sft=0.207, clean=0.158, trig=0.228, accum=4, step=189, kl=0.078]
SFT Epoch 1/2:  92%|█████████▏| 189/205 [06:32<00:33,  2.12s/it, loss=0.288, sft=0.250, clean=0.256, trig=0.247, accum=4, step=190, kl=0.075]
SFT Epoch 1/2:  93%|█████████▎| 190/205 [06:32<00:31,  2.11s/it, loss=0.288, sft=0.250, clean=0.256, trig=0.247, accum=4, step=190, kl=0.075]
SFT Epoch 1/2:  93%|█████████▎| 190/205 [06:34<00:31,  2.11s/it, loss=0.302, sft=0.264, clean=0.260, trig=0.266, accum=4, step=191, kl=0.077]
SFT Epoch 1/2:  93%|█████████▎| 191/205 [06:34<00:28,  2.01s/it, loss=0.302, sft=0.264, clean=0.260, trig=0.266, accum=4, step=191, kl=0.077]
SFT Epoch 1/2:  93%|█████████▎| 191/205 [06:36<00:28,  2.01s/it, loss=0.302, sft=0.265, clean=0.273, trig=0.261, accum=4, step=192, kl=0.075]
SFT Epoch 1/2:  94%|█████████▎| 192/205 [06:36<00:27,  2.12s/it, loss=0.302, sft=0.265, clean=0.273, trig=0.261, accum=4, step=192, kl=0.075]
SFT Epoch 1/2:  94%|█████████▎| 192/205 [06:38<00:27,  2.12s/it, loss=0.251, sft=0.213, clean=0.223, trig=0.209, accum=4, step=193, kl=0.076]
SFT Epoch 1/2:  94%|█████████▍| 193/205 [06:38<00:24,  2.06s/it, loss=0.251, sft=0.213, clean=0.223, trig=0.209, accum=4, step=193, kl=0.076]
SFT Epoch 1/2:  94%|█████████▍| 193/205 [06:40<00:24,  2.06s/it, loss=0.132, sft=0.109, clean=0.114, trig=0.107, accum=4, step=194, kl=0.046]
SFT Epoch 1/2:  95%|█████████▍| 194/205 [06:40<00:22,  2.00s/it, loss=0.132, sft=0.109, clean=0.114, trig=0.107, accum=4, step=194, kl=0.046]
SFT Epoch 1/2:  95%|█████████▍| 194/205 [06:42<00:22,  2.00s/it, loss=0.221, sft=0.195, clean=0.150, trig=0.214, accum=4, step=195, kl=0.052]
SFT Epoch 1/2:  95%|█████████▌| 195/205 [06:42<00:19,  1.94s/it, loss=0.221, sft=0.195, clean=0.150, trig=0.214, accum=4, step=195, kl=0.052]
SFT Epoch 1/2:  95%|█████████▌| 195/205 [06:44<00:19,  1.94s/it, loss=0.227, sft=0.189, clean=0.193, trig=0.188, accum=4, step=196, kl=0.075]
SFT Epoch 1/2:  96%|█████████▌| 196/205 [06:44<00:17,  1.90s/it, loss=0.227, sft=0.189, clean=0.193, trig=0.188, accum=4, step=196, kl=0.075]
SFT Epoch 1/2:  96%|█████████▌| 196/205 [06:46<00:17,  1.90s/it, loss=0.257, sft=0.229, clean=0.215, trig=0.234, accum=4, step=197, kl=0.057]
SFT Epoch 1/2:  96%|█████████▌| 197/205 [06:46<00:15,  1.92s/it, loss=0.257, sft=0.229, clean=0.215, trig=0.234, accum=4, step=197, kl=0.057]
SFT Epoch 1/2:  96%|█████████▌| 197/205 [06:48<00:15,  1.92s/it, loss=0.257, sft=0.221, clean=0.223, trig=0.221, accum=4, step=198, kl=0.071]
SFT Epoch 1/2:  97%|█████████▋| 198/205 [06:48<00:13,  1.98s/it, loss=0.257, sft=0.221, clean=0.223, trig=0.221, accum=4, step=198, kl=0.071]
SFT Epoch 1/2:  97%|█████████▋| 198/205 [06:50<00:13,  1.98s/it, loss=0.201, sft=0.174, clean=0.179, trig=0.171, accum=4, step=199, kl=0.054]
SFT Epoch 1/2:  97%|█████████▋| 199/205 [06:50<00:11,  1.99s/it, loss=0.201, sft=0.174, clean=0.179, trig=0.171, accum=4, step=199, kl=0.054]
SFT Epoch 1/2:  97%|█████████▋| 199/205 [06:52<00:11,  1.99s/it, loss=0.176, sft=0.152, clean=0.154, trig=0.152, accum=4, step=200, kl=0.047]
SFT Epoch 1/2:  98%|█████████▊| 200/205 [06:52<00:09,  1.96s/it, loss=0.176, sft=0.152, clean=0.154, trig=0.152, accum=4, step=200, kl=0.047]
SFT Epoch 1/2:  98%|█████████▊| 200/205 [06:54<00:09,  1.96s/it, loss=0.187, sft=0.161, clean=0.159, trig=0.161, accum=4, step=201, kl=0.053]
SFT Epoch 1/2:  98%|█████████▊| 201/205 [06:54<00:08,  2.05s/it, loss=0.187, sft=0.161, clean=0.159, trig=0.161, accum=4, step=201, kl=0.053]
SFT Epoch 1/2:  98%|█████████▊| 201/205 [06:56<00:08,  2.05s/it, loss=0.254, sft=0.219, clean=0.229, trig=0.214, accum=4, step=202, kl=0.070]
SFT Epoch 1/2:  99%|█████████▊| 202/205 [06:56<00:06,  2.01s/it, loss=0.254, sft=0.219, clean=0.229, trig=0.214, accum=4, step=202, kl=0.070]
SFT Epoch 1/2:  99%|█████████▊| 202/205 [06:58<00:06,  2.01s/it, loss=0.229, sft=0.186, clean=0.194, trig=0.183, accum=4, step=203, kl=0.084]
SFT Epoch 1/2:  99%|█████████▉| 203/205 [06:58<00:04,  2.09s/it, loss=0.229, sft=0.186, clean=0.194, trig=0.183, accum=4, step=203, kl=0.084]
SFT Epoch 1/2:  99%|█████████▉| 203/205 [07:01<00:04,  2.09s/it, loss=0.222, sft=0.187, clean=0.188, trig=0.187, accum=4, step=204, kl=0.069]
SFT Epoch 1/2: 100%|█████████▉| 204/205 [07:01<00:02,  2.19s/it, loss=0.222, sft=0.187, clean=0.188, trig=0.187, accum=4, step=204, kl=0.069]
SFT Epoch 1/2: 100%|█████████▉| 204/205 [07:02<00:02,  2.19s/it, loss=0.233, sft=0.198, clean=0.203, trig=0.197, accum=4, step=205, kl=0.070]
SFT Epoch 1/2: 100%|██████████| 205/205 [07:02<00:00,  2.06s/it, loss=0.233, sft=0.198, clean=0.203, trig=0.197, accum=4, step=205, kl=0.070]
SFT Epoch 1/2: 100%|██████████| 205/205 [07:02<00:00,  2.06s/it, loss=0.233, sft=0.198, clean=0.203, trig=0.197, accum=4, step=205, kl=0.070]

SFT Epoch 2/2:   0%|          | 0/205 [00:00<?, ?it/s]
SFT Epoch 2/2:   0%|          | 0/205 [00:02<?, ?it/s, loss=0.217, sft=0.174, clean=0.180, trig=0.171, accum=4, step=206, kl=0.087]
SFT Epoch 2/2:   0%|          | 1/205 [00:02<07:49,  2.30s/it, loss=0.217, sft=0.174, clean=0.180, trig=0.171, accum=4, step=206, kl=0.087]
SFT Epoch 2/2:   0%|          | 1/205 [00:04<07:49,  2.30s/it, loss=0.162, sft=0.135, clean=0.141, trig=0.133, accum=4, step=207, kl=0.054]
SFT Epoch 2/2:   1%|          | 2/205 [00:04<07:31,  2.22s/it, loss=0.162, sft=0.135, clean=0.141, trig=0.133, accum=4, step=207, kl=0.054]
SFT Epoch 2/2:   1%|          | 2/205 [00:06<07:31,  2.22s/it, loss=0.147, sft=0.111, clean=0.114, trig=0.110, accum=4, step=208, kl=0.071]
SFT Epoch 2/2:   1%|▏         | 3/205 [00:06<06:40,  1.98s/it, loss=0.147, sft=0.111, clean=0.114, trig=0.110, accum=4, step=208, kl=0.071]
SFT Epoch 2/2:   1%|▏         | 3/205 [00:08<06:40,  1.98s/it, loss=0.175, sft=0.140, clean=0.140, trig=0.139, accum=4, step=209, kl=0.072]
SFT Epoch 2/2:   2%|▏         | 4/205 [00:08<06:57,  2.08s/it, loss=0.175, sft=0.140, clean=0.140, trig=0.139, accum=4, step=209, kl=0.072]
SFT Epoch 2/2:   2%|▏         | 4/205 [00:10<06:57,  2.08s/it, loss=0.223, sft=0.171, clean=0.167, trig=0.172, accum=4, step=210, kl=0.105]
SFT Epoch 2/2:   2%|▏         | 5/205 [00:10<06:45,  2.03s/it, loss=0.223, sft=0.171, clean=0.167, trig=0.172, accum=4, step=210, kl=0.105]
SFT Epoch 2/2:   2%|▏         | 5/205 [00:12<06:45,  2.03s/it, loss=0.217, sft=0.186, clean=0.195, trig=0.182, accum=4, step=211, kl=0.062]
SFT Epoch 2/2:   3%|▎         | 6/205 [00:12<06:49,  2.06s/it, loss=0.217, sft=0.186, clean=0.195, trig=0.182, accum=4, step=211, kl=0.062]
SFT Epoch 2/2:   3%|▎         | 6/205 [00:14<06:49,  2.06s/it, loss=0.245, sft=0.212, clean=0.214, trig=0.212, accum=4, step=212, kl=0.065]
SFT Epoch 2/2:   3%|▎         | 7/205 [00:14<06:36,  2.00s/it, loss=0.245, sft=0.212, clean=0.214, trig=0.212, accum=4, step=212, kl=0.065]
SFT Epoch 2/2:   3%|▎         | 7/205 [00:16<06:36,  2.00s/it, loss=0.191, sft=0.158, clean=0.167, trig=0.154, accum=4, step=213, kl=0.067]
SFT Epoch 2/2:   4%|▍         | 8/205 [00:16<06:55,  2.11s/it, loss=0.191, sft=0.158, clean=0.167, trig=0.154, accum=4, step=213, kl=0.067]
SFT Epoch 2/2:   4%|▍         | 8/205 [00:18<06:55,  2.11s/it, loss=0.135, sft=0.108, clean=0.108, trig=0.107, accum=4, step=214, kl=0.055]
SFT Epoch 2/2:   4%|▍         | 9/205 [00:18<06:46,  2.07s/it, loss=0.135, sft=0.108, clean=0.108, trig=0.107, accum=4, step=214, kl=0.055]
SFT Epoch 2/2:   4%|▍         | 9/205 [00:20<06:46,  2.07s/it, loss=0.176, sft=0.132, clean=0.140, trig=0.129, accum=4, step=215, kl=0.087]
SFT Epoch 2/2:   5%|▍         | 10/205 [00:20<06:41,  2.06s/it, loss=0.176, sft=0.132, clean=0.140, trig=0.129, accum=4, step=215, kl=0.087]
SFT Epoch 2/2:   5%|▍         | 10/205 [00:22<06:41,  2.06s/it, loss=0.130, sft=0.096, clean=0.099, trig=0.094, accum=4, step=216, kl=0.069]
SFT Epoch 2/2:   5%|▌         | 11/205 [00:22<06:36,  2.05s/it, loss=0.130, sft=0.096, clean=0.099, trig=0.094, accum=4, step=216, kl=0.069]
SFT Epoch 2/2:   5%|▌         | 11/205 [00:24<06:36,  2.05s/it, loss=0.123, sft=0.091, clean=0.095, trig=0.089, accum=4, step=217, kl=0.064]
SFT Epoch 2/2:   6%|▌         | 12/205 [00:24<06:40,  2.07s/it, loss=0.123, sft=0.091, clean=0.095, trig=0.089, accum=4, step=217, kl=0.064]
SFT Epoch 2/2:   6%|▌         | 12/205 [00:27<06:40,  2.07s/it, loss=0.164, sft=0.121, clean=0.124, trig=0.120, accum=4, step=218, kl=0.086]
SFT Epoch 2/2:   6%|▋         | 13/205 [00:27<06:44,  2.11s/it, loss=0.164, sft=0.121, clean=0.124, trig=0.120, accum=4, step=218, kl=0.086]
SFT Epoch 2/2:   6%|▋         | 13/205 [00:28<06:44,  2.11s/it, loss=0.135, sft=0.097, clean=0.101, trig=0.095, accum=4, step=219, kl=0.077]
SFT Epoch 2/2:   7%|▋         | 14/205 [00:28<06:10,  1.94s/it, loss=0.135, sft=0.097, clean=0.101, trig=0.095, accum=4, step=219, kl=0.077]
SFT Epoch 2/2:   7%|▋         | 14/205 [00:30<06:10,  1.94s/it, loss=0.254, sft=0.205, clean=0.172, trig=0.219, accum=4, step=220, kl=0.099]
SFT Epoch 2/2:   7%|▋         | 15/205 [00:30<06:03,  1.91s/it, loss=0.254, sft=0.205, clean=0.172, trig=0.219, accum=4, step=220, kl=0.099]
SFT Epoch 2/2:   7%|▋         | 15/205 [00:32<06:03,  1.91s/it, loss=0.194, sft=0.140, clean=0.147, trig=0.136, accum=4, step=221, kl=0.108]
SFT Epoch 2/2:   8%|▊         | 16/205 [00:32<06:03,  1.93s/it, loss=0.194, sft=0.140, clean=0.147, trig=0.136, accum=4, step=221, kl=0.108]
SFT Epoch 2/2:   8%|▊         | 16/205 [00:34<06:03,  1.93s/it, loss=0.181, sft=0.144, clean=0.150, trig=0.141, accum=4, step=222, kl=0.075]
SFT Epoch 2/2:   8%|▊         | 17/205 [00:34<06:16,  2.00s/it, loss=0.181, sft=0.144, clean=0.150, trig=0.141, accum=4, step=222, kl=0.075]
SFT Epoch 2/2:   8%|▊         | 17/205 [00:36<06:16,  2.00s/it, loss=0.171, sft=0.128, clean=0.138, trig=0.124, accum=4, step=223, kl=0.086]
SFT Epoch 2/2:   9%|▉         | 18/205 [00:36<06:30,  2.09s/it, loss=0.171, sft=0.128, clean=0.138, trig=0.124, accum=4, step=223, kl=0.086]
SFT Epoch 2/2:   9%|▉         | 18/205 [00:38<06:30,  2.09s/it, loss=0.130, sft=0.091, clean=0.098, trig=0.089, accum=4, step=224, kl=0.076]
SFT Epoch 2/2:   9%|▉         | 19/205 [00:38<06:29,  2.09s/it, loss=0.130, sft=0.091, clean=0.098, trig=0.089, accum=4, step=224, kl=0.076]
SFT Epoch 2/2:   9%|▉         | 19/205 [00:40<06:29,  2.09s/it, loss=0.190, sft=0.163, clean=0.173, trig=0.158, accum=4, step=225, kl=0.055]
SFT Epoch 2/2:  10%|▉         | 20/205 [00:40<06:13,  2.02s/it, loss=0.190, sft=0.163, clean=0.173, trig=0.158, accum=4, step=225, kl=0.055]
SFT Epoch 2/2:  10%|▉         | 20/205 [00:42<06:13,  2.02s/it, loss=0.214, sft=0.179, clean=0.194, trig=0.172, accum=4, step=226, kl=0.071]
SFT Epoch 2/2:  10%|█         | 21/205 [00:42<06:13,  2.03s/it, loss=0.214, sft=0.179, clean=0.194, trig=0.172, accum=4, step=226, kl=0.071]
SFT Epoch 2/2:  10%|█         | 21/205 [00:44<06:13,  2.03s/it, loss=0.098, sft=0.077, clean=0.080, trig=0.076, accum=4, step=227, kl=0.042]
SFT Epoch 2/2:  11%|█         | 22/205 [00:44<06:15,  2.05s/it, loss=0.098, sft=0.077, clean=0.080, trig=0.076, accum=4, step=227, kl=0.042]
SFT Epoch 2/2:  11%|█         | 22/205 [00:47<06:15,  2.05s/it, loss=0.176, sft=0.127, clean=0.151, trig=0.117, accum=4, step=228, kl=0.098]
SFT Epoch 2/2:  11%|█         | 23/205 [00:47<06:14,  2.06s/it, loss=0.176, sft=0.127, clean=0.151, trig=0.117, accum=4, step=228, kl=0.098]
SFT Epoch 2/2:  11%|█         | 23/205 [00:48<06:14,  2.06s/it, loss=0.166, sft=0.124, clean=0.160, trig=0.109, accum=4, step=229, kl=0.083]
SFT Epoch 2/2:  12%|█▏        | 24/205 [00:48<05:59,  1.99s/it, loss=0.166, sft=0.124, clean=0.160, trig=0.109, accum=4, step=229, kl=0.083]
SFT Epoch 2/2:  12%|█▏        | 24/205 [00:51<05:59,  1.99s/it, loss=0.201, sft=0.160, clean=0.184, trig=0.150, accum=4, step=230, kl=0.081]
SFT Epoch 2/2:  12%|█▏        | 25/205 [00:51<06:07,  2.04s/it, loss=0.201, sft=0.160, clean=0.184, trig=0.150, accum=4, step=230, kl=0.081]
SFT Epoch 2/2:  12%|█▏        | 25/205 [00:53<06:07,  2.04s/it, loss=0.154, sft=0.131, clean=0.141, trig=0.127, accum=4, step=231, kl=0.046]
SFT Epoch 2/2:  13%|█▎        | 26/205 [00:53<06:06,  2.05s/it, loss=0.154, sft=0.131, clean=0.141, trig=0.127, accum=4, step=231, kl=0.046]
SFT Epoch 2/2:  13%|█▎        | 26/205 [00:55<06:06,  2.05s/it, loss=0.168, sft=0.141, clean=0.163, trig=0.131, accum=4, step=232, kl=0.054]
SFT Epoch 2/2:  13%|█▎        | 27/205 [00:55<05:57,  2.01s/it, loss=0.168, sft=0.141, clean=0.163, trig=0.131, accum=4, step=232, kl=0.054]
SFT Epoch 2/2:  13%|█▎        | 27/205 [00:57<05:57,  2.01s/it, loss=0.182, sft=0.140, clean=0.190, trig=0.119, accum=4, step=233, kl=0.085]
SFT Epoch 2/2:  14%|█▎        | 28/205 [00:57<06:09,  2.09s/it, loss=0.182, sft=0.140, clean=0.190, trig=0.119, accum=4, step=233, kl=0.085]
SFT Epoch 2/2:  14%|█▎        | 28/205 [00:59<06:09,  2.09s/it, loss=0.227, sft=0.207, clean=0.229, trig=0.198, accum=4, step=234, kl=0.039]
SFT Epoch 2/2:  14%|█▍        | 29/205 [00:59<06:09,  2.10s/it, loss=0.227, sft=0.207, clean=0.229, trig=0.198, accum=4, step=234, kl=0.039]
SFT Epoch 2/2:  14%|█▍        | 29/205 [01:01<06:09,  2.10s/it, loss=0.134, sft=0.087, clean=0.115, trig=0.075, accum=4, step=235, kl=0.093]
SFT Epoch 2/2:  15%|█▍        | 30/205 [01:01<05:54,  2.03s/it, loss=0.134, sft=0.087, clean=0.115, trig=0.075, accum=4, step=235, kl=0.093]
SFT Epoch 2/2:  15%|█▍        | 30/205 [01:03<05:54,  2.03s/it, loss=0.253, sft=0.222, clean=0.254, trig=0.209, accum=4, step=236, kl=0.061]
SFT Epoch 2/2:  15%|█▌        | 31/205 [01:03<05:53,  2.03s/it, loss=0.253, sft=0.222, clean=0.254, trig=0.209, accum=4, step=236, kl=0.061]
SFT Epoch 2/2:  15%|█▌        | 31/205 [01:05<05:53,  2.03s/it, loss=0.175, sft=0.137, clean=0.177, trig=0.120, accum=4, step=237, kl=0.074]
SFT Epoch 2/2:  16%|█▌        | 32/205 [01:05<05:58,  2.07s/it, loss=0.175, sft=0.137, clean=0.177, trig=0.120, accum=4, step=237, kl=0.074]
SFT Epoch 2/2:  16%|█▌        | 32/205 [01:07<05:58,  2.07s/it, loss=0.214, sft=0.170, clean=0.230, trig=0.145, accum=4, step=238, kl=0.088]
SFT Epoch 2/2:  16%|█▌        | 33/205 [01:07<05:52,  2.05s/it, loss=0.214, sft=0.170, clean=0.230, trig=0.145, accum=4, step=238, kl=0.088]
SFT Epoch 2/2:  16%|█▌        | 33/205 [01:09<05:52,  2.05s/it, loss=0.136, sft=0.114, clean=0.146, trig=0.101, accum=4, step=239, kl=0.044]
SFT Epoch 2/2:  17%|█▋        | 34/205 [01:09<05:47,  2.03s/it, loss=0.136, sft=0.114, clean=0.146, trig=0.101, accum=4, step=239, kl=0.044]
SFT Epoch 2/2:  17%|█▋        | 34/205 [01:11<05:47,  2.03s/it, loss=0.165, sft=0.142, clean=0.181, trig=0.125, accum=4, step=240, kl=0.046]
SFT Epoch 2/2:  17%|█▋        | 35/205 [01:11<05:48,  2.05s/it, loss=0.165, sft=0.142, clean=0.181, trig=0.125, accum=4, step=240, kl=0.046]
SFT Epoch 2/2:  17%|█▋        | 35/205 [01:13<05:48,  2.05s/it, loss=0.196, sft=0.167, clean=0.216, trig=0.146, accum=4, step=241, kl=0.057]
SFT Epoch 2/2:  18%|█▊        | 36/205 [01:13<05:47,  2.06s/it, loss=0.196, sft=0.167, clean=0.216, trig=0.146, accum=4, step=241, kl=0.057]
SFT Epoch 2/2:  18%|█▊        | 36/205 [01:15<05:47,  2.06s/it, loss=0.257, sft=0.227, clean=0.245, trig=0.220, accum=4, step=242, kl=0.059]
SFT Epoch 2/2:  18%|█▊        | 37/205 [01:15<05:32,  1.98s/it, loss=0.257, sft=0.227, clean=0.245, trig=0.220, accum=4, step=242, kl=0.059]
SFT Epoch 2/2:  18%|█▊        | 37/205 [01:17<05:32,  1.98s/it, loss=0.152, sft=0.132, clean=0.163, trig=0.118, accum=4, step=243, kl=0.039]
SFT Epoch 2/2:  19%|█▊        | 38/205 [01:17<05:38,  2.02s/it, loss=0.152, sft=0.132, clean=0.163, trig=0.118, accum=4, step=243, kl=0.039]
SFT Epoch 2/2:  19%|█▊        | 38/205 [01:20<05:38,  2.02s/it, loss=0.155, sft=0.108, clean=0.141, trig=0.095, accum=4, step=244, kl=0.093]
SFT Epoch 2/2:  19%|█▉        | 39/205 [01:20<05:59,  2.16s/it, loss=0.155, sft=0.108, clean=0.141, trig=0.095, accum=4, step=244, kl=0.093]
SFT Epoch 2/2:  19%|█▉        | 39/205 [01:21<05:59,  2.16s/it, loss=0.187, sft=0.149, clean=0.180, trig=0.136, accum=4, step=245, kl=0.076]
SFT Epoch 2/2:  20%|█▉        | 40/205 [01:21<05:41,  2.07s/it, loss=0.187, sft=0.149, clean=0.180, trig=0.136, accum=4, step=245, kl=0.076]
SFT Epoch 2/2:  20%|█▉        | 40/205 [01:23<05:41,  2.07s/it, loss=0.128, sft=0.108, clean=0.125, trig=0.101, accum=4, step=246, kl=0.039]
SFT Epoch 2/2:  20%|██        | 41/205 [01:23<05:27,  1.99s/it, loss=0.128, sft=0.108, clean=0.125, trig=0.101, accum=4, step=246, kl=0.039]
SFT Epoch 2/2:  20%|██        | 41/205 [01:25<05:27,  1.99s/it, loss=0.169, sft=0.135, clean=0.168, trig=0.120, accum=4, step=247, kl=0.069]
SFT Epoch 2/2:  20%|██        | 42/205 [01:25<05:29,  2.02s/it, loss=0.169, sft=0.135, clean=0.168, trig=0.120, accum=4, step=247, kl=0.069]
SFT Epoch 2/2:  20%|██        | 42/205 [01:27<05:29,  2.02s/it, loss=0.214, sft=0.175, clean=0.217, trig=0.156, accum=4, step=248, kl=0.079]
SFT Epoch 2/2:  21%|██        | 43/205 [01:27<05:21,  1.98s/it, loss=0.214, sft=0.175, clean=0.217, trig=0.156, accum=4, step=248, kl=0.079]
SFT Epoch 2/2:  21%|██        | 43/205 [01:29<05:21,  1.98s/it, loss=0.163, sft=0.121, clean=0.166, trig=0.101, accum=4, step=249, kl=0.084]
SFT Epoch 2/2:  21%|██▏       | 44/205 [01:29<05:07,  1.91s/it, loss=0.163, sft=0.121, clean=0.166, trig=0.101, accum=4, step=249, kl=0.084]
SFT Epoch 2/2:  21%|██▏       | 44/205 [01:31<05:07,  1.91s/it, loss=0.236, sft=0.210, clean=0.250, trig=0.192, accum=4, step=250, kl=0.052]
SFT Epoch 2/2:  22%|██▏       | 45/205 [01:31<05:16,  1.98s/it, loss=0.236, sft=0.210, clean=0.250, trig=0.192, accum=4, step=250, kl=0.052]
SFT Epoch 2/2:  22%|██▏       | 45/205 [01:33<05:16,  1.98s/it, loss=0.172, sft=0.145, clean=0.200, trig=0.121, accum=4, step=251, kl=0.055]
SFT Epoch 2/2:  22%|██▏       | 46/205 [01:33<05:17,  2.00s/it, loss=0.172, sft=0.145, clean=0.200, trig=0.121, accum=4, step=251, kl=0.055]
SFT Epoch 2/2:  22%|██▏       | 46/205 [01:35<05:17,  2.00s/it, loss=0.211, sft=0.172, clean=0.226, trig=0.149, accum=4, step=252, kl=0.078]
SFT Epoch 2/2:  23%|██▎       | 47/205 [01:35<05:05,  1.93s/it, loss=0.211, sft=0.172, clean=0.226, trig=0.149, accum=4, step=252, kl=0.078]
SFT Epoch 2/2:  23%|██▎       | 47/205 [01:37<05:05,  1.93s/it, loss=0.145, sft=0.125, clean=0.170, trig=0.106, accum=4, step=253, kl=0.040]
SFT Epoch 2/2:  23%|██▎       | 48/205 [01:37<05:09,  1.97s/it, loss=0.145, sft=0.125, clean=0.170, trig=0.106, accum=4, step=253, kl=0.040]
SFT Epoch 2/2:  23%|██▎       | 48/205 [01:39<05:09,  1.97s/it, loss=0.154, sft=0.132, clean=0.175, trig=0.113, accum=4, step=254, kl=0.046]
SFT Epoch 2/2:  24%|██▍       | 49/205 [01:39<05:22,  2.07s/it, loss=0.154, sft=0.132, clean=0.175, trig=0.113, accum=4, step=254, kl=0.046]
SFT Epoch 2/2:  24%|██▍       | 49/205 [01:42<05:22,  2.07s/it, loss=0.172, sft=0.122, clean=0.148, trig=0.110, accum=4, step=255, kl=0.100]
SFT Epoch 2/2:  24%|██▍       | 50/205 [01:42<05:31,  2.14s/it, loss=0.172, sft=0.122, clean=0.148, trig=0.110, accum=4, step=255, kl=0.100]
SFT Epoch 2/2:  24%|██▍       | 50/205 [01:44<05:31,  2.14s/it, loss=0.188, sft=0.172, clean=0.209, trig=0.156, accum=4, step=256, kl=0.032]
SFT Epoch 2/2:  25%|██▍       | 51/205 [01:44<05:38,  2.20s/it, loss=0.188, sft=0.172, clean=0.209, trig=0.156, accum=4, step=256, kl=0.032]
SFT Epoch 2/2:  25%|██▍       | 51/205 [01:46<05:38,  2.20s/it, loss=0.214, sft=0.190, clean=0.223, trig=0.176, accum=4, step=257, kl=0.048]
SFT Epoch 2/2:  25%|██▌       | 52/205 [01:46<05:41,  2.23s/it, loss=0.214, sft=0.190, clean=0.223, trig=0.176, accum=4, step=257, kl=0.048]
SFT Epoch 2/2:  25%|██▌       | 52/205 [01:48<05:41,  2.23s/it, loss=0.174, sft=0.151, clean=0.196, trig=0.132, accum=4, step=258, kl=0.045]
SFT Epoch 2/2:  26%|██▌       | 53/205 [01:48<05:29,  2.17s/it, loss=0.174, sft=0.151, clean=0.196, trig=0.132, accum=4, step=258, kl=0.045]
SFT Epoch 2/2:  26%|██▌       | 53/205 [01:50<05:29,  2.17s/it, loss=0.186, sft=0.159, clean=0.177, trig=0.151, accum=4, step=259, kl=0.055]
SFT Epoch 2/2:  26%|██▋       | 54/205 [01:50<05:19,  2.12s/it, loss=0.186, sft=0.159, clean=0.177, trig=0.151, accum=4, step=259, kl=0.055]
SFT Epoch 2/2:  26%|██▋       | 54/205 [01:52<05:19,  2.12s/it, loss=0.100, sft=0.072, clean=0.104, trig=0.058, accum=4, step=260, kl=0.056]
SFT Epoch 2/2:  27%|██▋       | 55/205 [01:52<05:12,  2.08s/it, loss=0.100, sft=0.072, clean=0.104, trig=0.058, accum=4, step=260, kl=0.056]
SFT Epoch 2/2:  27%|██▋       | 55/205 [01:54<05:12,  2.08s/it, loss=0.177, sft=0.146, clean=0.202, trig=0.122, accum=4, step=261, kl=0.063]
SFT Epoch 2/2:  27%|██▋       | 56/205 [01:54<04:50,  1.95s/it, loss=0.177, sft=0.146, clean=0.202, trig=0.122, accum=4, step=261, kl=0.063]
SFT Epoch 2/2:  27%|██▋       | 56/205 [01:56<04:50,  1.95s/it, loss=0.227, sft=0.203, clean=0.242, trig=0.186, accum=4, step=262, kl=0.048]
SFT Epoch 2/2:  28%|██▊       | 57/205 [01:56<04:52,  1.98s/it, loss=0.227, sft=0.203, clean=0.242, trig=0.186, accum=4, step=262, kl=0.048]
SFT Epoch 2/2:  28%|██▊       | 57/205 [01:58<04:52,  1.98s/it, loss=0.187, sft=0.169, clean=0.188, trig=0.160, accum=4, step=263, kl=0.037]
SFT Epoch 2/2:  28%|██▊       | 58/205 [01:58<04:43,  1.93s/it, loss=0.187, sft=0.169, clean=0.188, trig=0.160, accum=4, step=263, kl=0.037]
SFT Epoch 2/2:  28%|██▊       | 58/205 [02:00<04:43,  1.93s/it, loss=0.181, sft=0.148, clean=0.187, trig=0.132, accum=4, step=264, kl=0.064]
SFT Epoch 2/2:  29%|██▉       | 59/205 [02:00<04:41,  1.93s/it, loss=0.181, sft=0.148, clean=0.187, trig=0.132, accum=4, step=264, kl=0.064]
SFT Epoch 2/2:  29%|██▉       | 59/205 [02:02<04:41,  1.93s/it, loss=0.148, sft=0.129, clean=0.154, trig=0.118, accum=4, step=265, kl=0.037]
SFT Epoch 2/2:  29%|██▉       | 60/205 [02:02<04:57,  2.05s/it, loss=0.148, sft=0.129, clean=0.154, trig=0.118, accum=4, step=265, kl=0.037]
SFT Epoch 2/2:  29%|██▉       | 60/205 [02:04<04:57,  2.05s/it, loss=0.209, sft=0.188, clean=0.199, trig=0.184, accum=4, step=266, kl=0.042]
SFT Epoch 2/2:  30%|██▉       | 61/205 [02:04<04:55,  2.05s/it, loss=0.209, sft=0.188, clean=0.199, trig=0.184, accum=4, step=266, kl=0.042]
SFT Epoch 2/2:  30%|██▉       | 61/205 [02:06<04:55,  2.05s/it, loss=0.117, sft=0.086, clean=0.108, trig=0.077, accum=4, step=267, kl=0.063]
SFT Epoch 2/2:  30%|███       | 62/205 [02:06<04:39,  1.96s/it, loss=0.117, sft=0.086, clean=0.108, trig=0.077, accum=4, step=267, kl=0.063]
SFT Epoch 2/2:  30%|███       | 62/205 [02:08<04:39,  1.96s/it, loss=0.230, sft=0.199, clean=0.250, trig=0.177, accum=4, step=268, kl=0.062]
SFT Epoch 2/2:  31%|███       | 63/205 [02:08<04:41,  1.98s/it, loss=0.230, sft=0.199, clean=0.250, trig=0.177, accum=4, step=268, kl=0.062]
SFT Epoch 2/2:  31%|███       | 63/205 [02:10<04:41,  1.98s/it, loss=0.169, sft=0.138, clean=0.174, trig=0.123, accum=4, step=269, kl=0.061]
SFT Epoch 2/2:  31%|███       | 64/205 [02:10<04:43,  2.01s/it, loss=0.169, sft=0.138, clean=0.174, trig=0.123, accum=4, step=269, kl=0.061]
SFT Epoch 2/2:  31%|███       | 64/205 [02:12<04:43,  2.01s/it, loss=0.167, sft=0.149, clean=0.203, trig=0.126, accum=4, step=270, kl=0.035]
SFT Epoch 2/2:  32%|███▏      | 65/205 [02:12<04:57,  2.13s/it, loss=0.167, sft=0.149, clean=0.203, trig=0.126, accum=4, step=270, kl=0.035]
SFT Epoch 2/2:  32%|███▏      | 65/205 [02:14<04:57,  2.13s/it, loss=0.184, sft=0.153, clean=0.192, trig=0.137, accum=4, step=271, kl=0.062]
SFT Epoch 2/2:  32%|███▏      | 66/205 [02:14<04:44,  2.05s/it, loss=0.184, sft=0.153, clean=0.192, trig=0.137, accum=4, step=271, kl=0.062]
SFT Epoch 2/2:  32%|███▏      | 66/205 [02:16<04:44,  2.05s/it, loss=0.161, sft=0.143, clean=0.191, trig=0.123, accum=4, step=272, kl=0.035]
SFT Epoch 2/2:  33%|███▎      | 67/205 [02:16<04:44,  2.06s/it, loss=0.161, sft=0.143, clean=0.191, trig=0.123, accum=4, step=272, kl=0.035]
SFT Epoch 2/2:  33%|███▎      | 67/205 [02:18<04:44,  2.06s/it, loss=0.203, sft=0.180, clean=0.230, trig=0.159, accum=4, step=273, kl=0.045]
SFT Epoch 2/2:  33%|███▎      | 68/205 [02:18<04:33,  1.99s/it, loss=0.203, sft=0.180, clean=0.230, trig=0.159, accum=4, step=273, kl=0.045]
SFT Epoch 2/2:  33%|███▎      | 68/205 [02:20<04:33,  1.99s/it, loss=0.249, sft=0.226, clean=0.262, trig=0.210, accum=4, step=274, kl=0.048]
SFT Epoch 2/2:  34%|███▎      | 69/205 [02:20<04:27,  1.97s/it, loss=0.249, sft=0.226, clean=0.262, trig=0.210, accum=4, step=274, kl=0.048]
SFT Epoch 2/2:  34%|███▎      | 69/205 [02:22<04:27,  1.97s/it, loss=0.178, sft=0.153, clean=0.210, trig=0.129, accum=4, step=275, kl=0.050]
SFT Epoch 2/2:  34%|███▍      | 70/205 [02:22<04:38,  2.06s/it, loss=0.178, sft=0.153, clean=0.210, trig=0.129, accum=4, step=275, kl=0.050]
SFT Epoch 2/2:  34%|███▍      | 70/205 [02:24<04:38,  2.06s/it, loss=0.168, sft=0.151, clean=0.182, trig=0.138, accum=4, step=276, kl=0.034]
SFT Epoch 2/2:  35%|███▍      | 71/205 [02:24<04:27,  2.00s/it, loss=0.168, sft=0.151, clean=0.182, trig=0.138, accum=4, step=276, kl=0.034]
SFT Epoch 2/2:  35%|███▍      | 71/205 [02:26<04:27,  2.00s/it, loss=0.169, sft=0.142, clean=0.201, trig=0.117, accum=4, step=277, kl=0.054]
SFT Epoch 2/2:  35%|███▌      | 72/205 [02:26<04:18,  1.94s/it, loss=0.169, sft=0.142, clean=0.201, trig=0.117, accum=4, step=277, kl=0.054]
SFT Epoch 2/2:  35%|███▌      | 72/205 [02:28<04:18,  1.94s/it, loss=0.181, sft=0.153, clean=0.191, trig=0.137, accum=4, step=278, kl=0.055]
SFT Epoch 2/2:  36%|███▌      | 73/205 [02:28<04:09,  1.89s/it, loss=0.181, sft=0.153, clean=0.191, trig=0.137, accum=4, step=278, kl=0.055]
SFT Epoch 2/2:  36%|███▌      | 73/205 [02:30<04:09,  1.89s/it, loss=0.184, sft=0.165, clean=0.173, trig=0.162, accum=4, step=279, kl=0.038]
SFT Epoch 2/2:  36%|███▌      | 74/205 [02:30<04:10,  1.91s/it, loss=0.184, sft=0.165, clean=0.173, trig=0.162, accum=4, step=279, kl=0.038]
SFT Epoch 2/2:  36%|███▌      | 74/205 [02:32<04:10,  1.91s/it, loss=0.164, sft=0.125, clean=0.193, trig=0.096, accum=4, step=280, kl=0.078]
SFT Epoch 2/2:  37%|███▋      | 75/205 [02:32<04:18,  1.99s/it, loss=0.164, sft=0.125, clean=0.193, trig=0.096, accum=4, step=280, kl=0.078]
SFT Epoch 2/2:  37%|███▋      | 75/205 [02:34<04:18,  1.99s/it, loss=0.131, sft=0.112, clean=0.148, trig=0.097, accum=4, step=281, kl=0.038]
SFT Epoch 2/2:  37%|███▋      | 76/205 [02:34<04:06,  1.91s/it, loss=0.131, sft=0.112, clean=0.148, trig=0.097, accum=4, step=281, kl=0.038]
SFT Epoch 2/2:  37%|███▋      | 76/205 [02:35<04:06,  1.91s/it, loss=0.146, sft=0.107, clean=0.154, trig=0.087, accum=4, step=282, kl=0.078]
SFT Epoch 2/2:  38%|███▊      | 77/205 [02:35<04:04,  1.91s/it, loss=0.146, sft=0.107, clean=0.154, trig=0.087, accum=4, step=282, kl=0.078]
SFT Epoch 2/2:  38%|███▊      | 77/205 [02:38<04:04,  1.91s/it, loss=0.125, sft=0.102, clean=0.135, trig=0.088, accum=4, step=283, kl=0.047]
SFT Epoch 2/2:  38%|███▊      | 78/205 [02:38<04:07,  1.95s/it, loss=0.125, sft=0.102, clean=0.135, trig=0.088, accum=4, step=283, kl=0.047]
SFT Epoch 2/2:  38%|███▊      | 78/205 [02:39<04:07,  1.95s/it, loss=0.112, sft=0.089, clean=0.120, trig=0.076, accum=4, step=284, kl=0.045]
SFT Epoch 2/2:  39%|███▊      | 79/205 [02:39<03:58,  1.89s/it, loss=0.112, sft=0.089, clean=0.120, trig=0.076, accum=4, step=284, kl=0.045]
SFT Epoch 2/2:  39%|███▊      | 79/205 [02:41<03:58,  1.89s/it, loss=0.133, sft=0.114, clean=0.152, trig=0.098, accum=4, step=285, kl=0.037]
SFT Epoch 2/2:  39%|███▉      | 80/205 [02:41<03:56,  1.89s/it, loss=0.133, sft=0.114, clean=0.152, trig=0.098, accum=4, step=285, kl=0.037]
SFT Epoch 2/2:  39%|███▉      | 80/205 [02:43<03:56,  1.89s/it, loss=0.143, sft=0.115, clean=0.159, trig=0.096, accum=4, step=286, kl=0.055]
SFT Epoch 2/2:  40%|███▉      | 81/205 [02:43<03:59,  1.93s/it, loss=0.143, sft=0.115, clean=0.159, trig=0.096, accum=4, step=286, kl=0.055]
SFT Epoch 2/2:  40%|███▉      | 81/205 [02:45<03:59,  1.93s/it, loss=0.183, sft=0.164, clean=0.207, trig=0.146, accum=4, step=287, kl=0.037]
SFT Epoch 2/2:  40%|████      | 82/205 [02:45<04:09,  2.03s/it, loss=0.183, sft=0.164, clean=0.207, trig=0.146, accum=4, step=287, kl=0.037]
SFT Epoch 2/2:  40%|████      | 82/205 [02:47<04:09,  2.03s/it, loss=0.136, sft=0.103, clean=0.145, trig=0.085, accum=4, step=288, kl=0.065]
SFT Epoch 2/2:  40%|████      | 83/205 [02:47<04:02,  1.99s/it, loss=0.136, sft=0.103, clean=0.145, trig=0.085, accum=4, step=288, kl=0.065]
SFT Epoch 2/2:  40%|████      | 83/205 [02:49<04:02,  1.99s/it, loss=0.132, sft=0.115, clean=0.133, trig=0.108, accum=4, step=289, kl=0.032]
SFT Epoch 2/2:  41%|████      | 84/205 [02:49<03:54,  1.94s/it, loss=0.132, sft=0.115, clean=0.133, trig=0.108, accum=4, step=289, kl=0.032]
SFT Epoch 2/2:  41%|████      | 84/205 [02:51<03:54,  1.94s/it, loss=0.121, sft=0.100, clean=0.148, trig=0.079, accum=4, step=290, kl=0.043]
SFT Epoch 2/2:  41%|████▏     | 85/205 [02:51<03:56,  1.97s/it, loss=0.121, sft=0.100, clean=0.148, trig=0.079, accum=4, step=290, kl=0.043]
SFT Epoch 2/2:  41%|████▏     | 85/205 [02:53<03:56,  1.97s/it, loss=0.105, sft=0.083, clean=0.115, trig=0.069, accum=4, step=291, kl=0.044]
SFT Epoch 2/2:  42%|████▏     | 86/205 [02:53<03:47,  1.92s/it, loss=0.105, sft=0.083, clean=0.115, trig=0.069, accum=4, step=291, kl=0.044]
SFT Epoch 2/2:  42%|████▏     | 86/205 [02:55<03:47,  1.92s/it, loss=0.094, sft=0.084, clean=0.110, trig=0.073, accum=4, step=292, kl=0.019]
SFT Epoch 2/2:  42%|████▏     | 87/205 [02:55<03:46,  1.92s/it, loss=0.094, sft=0.084, clean=0.110, trig=0.073, accum=4, step=292, kl=0.019]
SFT Epoch 2/2:  42%|████▏     | 87/205 [02:57<03:46,  1.92s/it, loss=0.233, sft=0.207, clean=0.261, trig=0.185, accum=4, step=293, kl=0.050]
SFT Epoch 2/2:  43%|████▎     | 88/205 [02:57<03:49,  1.96s/it, loss=0.233, sft=0.207, clean=0.261, trig=0.185, accum=4, step=293, kl=0.050]
SFT Epoch 2/2:  43%|████▎     | 88/205 [02:59<03:49,  1.96s/it, loss=0.163, sft=0.129, clean=0.151, trig=0.120, accum=4, step=294, kl=0.067]
SFT Epoch 2/2:  43%|████▎     | 89/205 [02:59<03:50,  1.98s/it, loss=0.163, sft=0.129, clean=0.151, trig=0.120, accum=4, step=294, kl=0.067]
SFT Epoch 2/2:  43%|████▎     | 89/205 [03:01<03:50,  1.98s/it, loss=0.153, sft=0.133, clean=0.169, trig=0.118, accum=4, step=295, kl=0.040]
SFT Epoch 2/2:  44%|████▍     | 90/205 [03:01<03:35,  1.88s/it, loss=0.153, sft=0.133, clean=0.169, trig=0.118, accum=4, step=295, kl=0.040]
SFT Epoch 2/2:  44%|████▍     | 90/205 [03:03<03:35,  1.88s/it, loss=0.138, sft=0.116, clean=0.137, trig=0.107, accum=4, step=296, kl=0.045]
SFT Epoch 2/2:  44%|████▍     | 91/205 [03:03<03:40,  1.93s/it, loss=0.138, sft=0.116, clean=0.137, trig=0.107, accum=4, step=296, kl=0.045]
SFT Epoch 2/2:  44%|████▍     | 91/205 [03:05<03:40,  1.93s/it, loss=0.210, sft=0.168, clean=0.191, trig=0.158, accum=4, step=297, kl=0.083]
SFT Epoch 2/2:  45%|████▍     | 92/205 [03:05<03:35,  1.91s/it, loss=0.210, sft=0.168, clean=0.191, trig=0.158, accum=4, step=297, kl=0.083]
SFT Epoch 2/2:  45%|████▍     | 92/205 [03:06<03:35,  1.91s/it, loss=0.149, sft=0.134, clean=0.148, trig=0.128, accum=4, step=298, kl=0.031]
SFT Epoch 2/2:  45%|████▌     | 93/205 [03:06<03:32,  1.89s/it, loss=0.149, sft=0.134, clean=0.148, trig=0.128, accum=4, step=298, kl=0.031]
SFT Epoch 2/2:  45%|████▌     | 93/205 [03:08<03:32,  1.89s/it, loss=0.153, sft=0.126, clean=0.171, trig=0.107, accum=4, step=299, kl=0.053]
SFT Epoch 2/2:  46%|████▌     | 94/205 [03:08<03:25,  1.85s/it, loss=0.153, sft=0.126, clean=0.171, trig=0.107, accum=4, step=299, kl=0.053]
SFT Epoch 2/2:  46%|████▌     | 94/205 [03:10<03:25,  1.85s/it, loss=0.245, sft=0.225, clean=0.279, trig=0.202, accum=4, step=300, kl=0.041]
SFT Epoch 2/2:  46%|████▋     | 95/205 [03:10<03:19,  1.82s/it, loss=0.245, sft=0.225, clean=0.279, trig=0.202, accum=4, step=300, kl=0.041]
SFT Epoch 2/2:  46%|████▋     | 95/205 [03:12<03:19,  1.82s/it, loss=0.152, sft=0.106, clean=0.135, trig=0.093, accum=4, step=301, kl=0.093]
SFT Epoch 2/2:  47%|████▋     | 96/205 [03:12<03:27,  1.91s/it, loss=0.152, sft=0.106, clean=0.135, trig=0.093, accum=4, step=301, kl=0.093]
SFT Epoch 2/2:  47%|████▋     | 96/205 [03:14<03:27,  1.91s/it, loss=0.260, sft=0.237, clean=0.285, trig=0.216, accum=4, step=302, kl=0.047]
SFT Epoch 2/2:  47%|████▋     | 97/205 [03:14<03:26,  1.91s/it, loss=0.260, sft=0.237, clean=0.285, trig=0.216, accum=4, step=302, kl=0.047]
SFT Epoch 2/2:  47%|████▋     | 97/205 [03:16<03:26,  1.91s/it, loss=0.161, sft=0.132, clean=0.177, trig=0.112, accum=4, step=303, kl=0.059]
SFT Epoch 2/2:  48%|████▊     | 98/205 [03:16<03:28,  1.95s/it, loss=0.161, sft=0.132, clean=0.177, trig=0.112, accum=4, step=303, kl=0.059]
SFT Epoch 2/2:  48%|████▊     | 98/205 [03:18<03:28,  1.95s/it, loss=0.192, sft=0.160, clean=0.181, trig=0.151, accum=4, step=304, kl=0.064]
SFT Epoch 2/2:  48%|████▊     | 99/205 [03:18<03:26,  1.95s/it, loss=0.192, sft=0.160, clean=0.181, trig=0.151, accum=4, step=304, kl=0.064]
SFT Epoch 2/2:  48%|████▊     | 99/205 [03:20<03:26,  1.95s/it, loss=0.165, sft=0.130, clean=0.183, trig=0.107, accum=4, step=305, kl=0.070]
SFT Epoch 2/2:  49%|████▉     | 100/205 [03:20<03:25,  1.96s/it, loss=0.165, sft=0.130, clean=0.183, trig=0.107, accum=4, step=305, kl=0.070]
SFT Epoch 2/2:  49%|████▉     | 100/205 [03:22<03:25,  1.96s/it, loss=0.083, sft=0.068, clean=0.106, trig=0.051, accum=4, step=306, kl=0.031]
SFT Epoch 2/2:  49%|████▉     | 101/205 [03:22<03:18,  1.91s/it, loss=0.083, sft=0.068, clean=0.106, trig=0.051, accum=4, step=306, kl=0.031]
SFT Epoch 2/2:  49%|████▉     | 101/205 [03:23<03:18,  1.91s/it, loss=0.171, sft=0.135, clean=0.182, trig=0.115, accum=4, step=307, kl=0.071]
SFT Epoch 2/2:  50%|████▉     | 102/205 [03:23<03:12,  1.87s/it, loss=0.171, sft=0.135, clean=0.182, trig=0.115, accum=4, step=307, kl=0.071]
SFT Epoch 2/2:  50%|████▉     | 102/205 [03:26<03:12,  1.87s/it, loss=0.197, sft=0.162, clean=0.215, trig=0.139, accum=4, step=308, kl=0.070]
SFT Epoch 2/2:  50%|█████     | 103/205 [03:26<03:18,  1.95s/it, loss=0.197, sft=0.162, clean=0.215, trig=0.139, accum=4, step=308, kl=0.070]
SFT Epoch 2/2:  50%|█████     | 103/205 [03:27<03:18,  1.95s/it, loss=0.164, sft=0.131, clean=0.179, trig=0.110, accum=4, step=309, kl=0.067]
SFT Epoch 2/2:  51%|█████     | 104/205 [03:27<03:13,  1.92s/it, loss=0.164, sft=0.131, clean=0.179, trig=0.110, accum=4, step=309, kl=0.067]
SFT Epoch 2/2:  51%|█████     | 104/205 [03:29<03:13,  1.92s/it, loss=0.147, sft=0.128, clean=0.155, trig=0.116, accum=4, step=310, kl=0.038]
SFT Epoch 2/2:  51%|█████     | 105/205 [03:29<03:11,  1.92s/it, loss=0.147, sft=0.128, clean=0.155, trig=0.116, accum=4, step=310, kl=0.038]
SFT Epoch 2/2:  51%|█████     | 105/205 [03:31<03:11,  1.92s/it, loss=0.172, sft=0.155, clean=0.183, trig=0.142, accum=4, step=311, kl=0.035]
SFT Epoch 2/2:  52%|█████▏    | 106/205 [03:31<03:09,  1.91s/it, loss=0.172, sft=0.155, clean=0.183, trig=0.142, accum=4, step=311, kl=0.035]
SFT Epoch 2/2:  52%|█████▏    | 106/205 [03:33<03:09,  1.91s/it, loss=0.176, sft=0.149, clean=0.200, trig=0.127, accum=4, step=312, kl=0.054]
SFT Epoch 2/2:  52%|█████▏    | 107/205 [03:33<03:05,  1.90s/it, loss=0.176, sft=0.149, clean=0.200, trig=0.127, accum=4, step=312, kl=0.054]
SFT Epoch 2/2:  52%|█████▏    | 107/205 [03:35<03:05,  1.90s/it, loss=0.161, sft=0.129, clean=0.167, trig=0.112, accum=4, step=313, kl=0.065]
SFT Epoch 2/2:  53%|█████▎    | 108/205 [03:35<02:59,  1.85s/it, loss=0.161, sft=0.129, clean=0.167, trig=0.112, accum=4, step=313, kl=0.065]
SFT Epoch 2/2:  53%|█████▎    | 108/205 [03:37<02:59,  1.85s/it, loss=0.129, sft=0.079, clean=0.120, trig=0.061, accum=4, step=314, kl=0.101]
SFT Epoch 2/2:  53%|█████▎    | 109/205 [03:37<03:10,  1.99s/it, loss=0.129, sft=0.079, clean=0.120, trig=0.061, accum=4, step=314, kl=0.101]
SFT Epoch 2/2:  53%|█████▎    | 109/205 [03:39<03:10,  1.99s/it, loss=0.200, sft=0.176, clean=0.234, trig=0.151, accum=4, step=315, kl=0.049]
SFT Epoch 2/2:  54%|█████▎    | 110/205 [03:39<03:04,  1.94s/it, loss=0.200, sft=0.176, clean=0.234, trig=0.151, accum=4, step=315, kl=0.049]
SFT Epoch 2/2:  54%|█████▎    | 110/205 [03:41<03:04,  1.94s/it, loss=0.143, sft=0.121, clean=0.171, trig=0.099, accum=4, step=316, kl=0.045]
SFT Epoch 2/2:  54%|█████▍    | 111/205 [03:41<03:03,  1.95s/it, loss=0.143, sft=0.121, clean=0.171, trig=0.099, accum=4, step=316, kl=0.045]
SFT Epoch 2/2:  54%|█████▍    | 111/205 [03:43<03:03,  1.95s/it, loss=0.223, sft=0.199, clean=0.240, trig=0.181, accum=4, step=317, kl=0.048]
SFT Epoch 2/2:  55%|█████▍    | 112/205 [03:43<02:53,  1.87s/it, loss=0.223, sft=0.199, clean=0.240, trig=0.181, accum=4, step=317, kl=0.048]
SFT Epoch 2/2:  55%|█████▍    | 112/205 [03:45<02:53,  1.87s/it, loss=0.165, sft=0.144, clean=0.174, trig=0.131, accum=4, step=318, kl=0.042]
SFT Epoch 2/2:  55%|█████▌    | 113/205 [03:45<03:00,  1.97s/it, loss=0.165, sft=0.144, clean=0.174, trig=0.131, accum=4, step=318, kl=0.042]
SFT Epoch 2/2:  55%|█████▌    | 113/205 [03:47<03:00,  1.97s/it, loss=0.141, sft=0.106, clean=0.135, trig=0.093, accum=4, step=319, kl=0.070]
SFT Epoch 2/2:  56%|█████▌    | 114/205 [03:47<02:51,  1.88s/it, loss=0.141, sft=0.106, clean=0.135, trig=0.093, accum=4, step=319, kl=0.070]
SFT Epoch 2/2:  56%|█████▌    | 114/205 [03:48<02:51,  1.88s/it, loss=0.196, sft=0.167, clean=0.209, trig=0.149, accum=4, step=320, kl=0.058]
SFT Epoch 2/2:  56%|█████▌    | 115/205 [03:48<02:41,  1.80s/it, loss=0.196, sft=0.167, clean=0.209, trig=0.149, accum=4, step=320, kl=0.058]
SFT Epoch 2/2:  56%|█████▌    | 115/205 [03:50<02:41,  1.80s/it, loss=0.167, sft=0.135, clean=0.176, trig=0.117, accum=4, step=321, kl=0.063]
SFT Epoch 2/2:  57%|█████▋    | 116/205 [03:50<02:32,  1.71s/it, loss=0.167, sft=0.135, clean=0.176, trig=0.117, accum=4, step=321, kl=0.063]
SFT Epoch 2/2:  57%|█████▋    | 116/205 [03:52<02:32,  1.71s/it, loss=0.126, sft=0.116, clean=0.146, trig=0.103, accum=4, step=322, kl=0.019]
SFT Epoch 2/2:  57%|█████▋    | 117/205 [03:52<02:35,  1.77s/it, loss=0.126, sft=0.116, clean=0.146, trig=0.103, accum=4, step=322, kl=0.019]
SFT Epoch 2/2:  57%|█████▋    | 117/205 [03:54<02:35,  1.77s/it, loss=0.121, sft=0.104, clean=0.142, trig=0.088, accum=4, step=323, kl=0.033]
SFT Epoch 2/2:  58%|█████▊    | 118/205 [03:54<02:43,  1.88s/it, loss=0.121, sft=0.104, clean=0.142, trig=0.088, accum=4, step=323, kl=0.033]
SFT Epoch 2/2:  58%|█████▊    | 118/205 [03:55<02:43,  1.88s/it, loss=0.153, sft=0.089, clean=0.155, trig=0.060, accum=4, step=324, kl=0.130]
SFT Epoch 2/2:  58%|█████▊    | 119/205 [03:55<02:34,  1.80s/it, loss=0.153, sft=0.089, clean=0.155, trig=0.060, accum=4, step=324, kl=0.130]
SFT Epoch 2/2:  58%|█████▊    | 119/205 [03:57<02:34,  1.80s/it, loss=0.094, sft=0.078, clean=0.109, trig=0.064, accum=4, step=325, kl=0.033]
SFT Epoch 2/2:  59%|█████▊    | 120/205 [03:57<02:41,  1.90s/it, loss=0.094, sft=0.078, clean=0.109, trig=0.064, accum=4, step=325, kl=0.033]
SFT Epoch 2/2:  59%|█████▊    | 120/205 [04:00<02:41,  1.90s/it, loss=0.187, sft=0.169, clean=0.218, trig=0.148, accum=4, step=326, kl=0.036]
SFT Epoch 2/2:  59%|█████▉    | 121/205 [04:00<02:48,  2.01s/it, loss=0.187, sft=0.169, clean=0.218, trig=0.148, accum=4, step=326, kl=0.036]
SFT Epoch 2/2:  59%|█████▉    | 121/205 [04:02<02:48,  2.01s/it, loss=0.166, sft=0.129, clean=0.184, trig=0.106, accum=4, step=327, kl=0.074]
SFT Epoch 2/2:  60%|█████▉    | 122/205 [04:02<02:51,  2.07s/it, loss=0.166, sft=0.129, clean=0.184, trig=0.106, accum=4, step=327, kl=0.074]
SFT Epoch 2/2:  60%|█████▉    | 122/205 [04:04<02:51,  2.07s/it, loss=0.081, sft=0.059, clean=0.091, trig=0.045, accum=4, step=328, kl=0.044]
SFT Epoch 2/2:  60%|██████    | 123/205 [04:04<02:44,  2.00s/it, loss=0.081, sft=0.059, clean=0.091, trig=0.045, accum=4, step=328, kl=0.044]
SFT Epoch 2/2:  60%|██████    | 123/205 [04:05<02:44,  2.00s/it, loss=0.137, sft=0.112, clean=0.165, trig=0.090, accum=4, step=329, kl=0.049]
SFT Epoch 2/2:  60%|██████    | 124/205 [04:05<02:35,  1.92s/it, loss=0.137, sft=0.112, clean=0.165, trig=0.090, accum=4, step=329, kl=0.049]
SFT Epoch 2/2:  60%|██████    | 124/205 [04:07<02:35,  1.92s/it, loss=0.101, sft=0.084, clean=0.126, trig=0.066, accum=4, step=330, kl=0.033]
SFT Epoch 2/2:  61%|██████    | 125/205 [04:07<02:27,  1.84s/it, loss=0.101, sft=0.084, clean=0.126, trig=0.066, accum=4, step=330, kl=0.033]
SFT Epoch 2/2:  61%|██████    | 125/205 [04:09<02:27,  1.84s/it, loss=0.150, sft=0.110, clean=0.159, trig=0.089, accum=4, step=331, kl=0.080]
SFT Epoch 2/2:  61%|██████▏   | 126/205 [04:09<02:34,  1.95s/it, loss=0.150, sft=0.110, clean=0.159, trig=0.089, accum=4, step=331, kl=0.080]
SFT Epoch 2/2:  61%|██████▏   | 126/205 [04:11<02:34,  1.95s/it, loss=0.138, sft=0.114, clean=0.148, trig=0.099, accum=4, step=332, kl=0.048]
SFT Epoch 2/2:  62%|██████▏   | 127/205 [04:11<02:30,  1.93s/it, loss=0.138, sft=0.114, clean=0.148, trig=0.099, accum=4, step=332, kl=0.048]
SFT Epoch 2/2:  62%|██████▏   | 127/205 [04:13<02:30,  1.93s/it, loss=0.108, sft=0.081, clean=0.122, trig=0.063, accum=4, step=333, kl=0.054]
SFT Epoch 2/2:  62%|██████▏   | 128/205 [04:13<02:33,  1.99s/it, loss=0.108, sft=0.081, clean=0.122, trig=0.063, accum=4, step=333, kl=0.054]
SFT Epoch 2/2:  62%|██████▏   | 128/205 [04:15<02:33,  1.99s/it, loss=0.132, sft=0.113, clean=0.125, trig=0.107, accum=4, step=334, kl=0.038]
SFT Epoch 2/2:  63%|██████▎   | 129/205 [04:15<02:31,  2.00s/it, loss=0.132, sft=0.113, clean=0.125, trig=0.107, accum=4, step=334, kl=0.038]
SFT Epoch 2/2:  63%|██████▎   | 129/205 [04:17<02:31,  2.00s/it, loss=0.159, sft=0.144, clean=0.180, trig=0.128, accum=4, step=335, kl=0.030]
SFT Epoch 2/2:  63%|██████▎   | 130/205 [04:17<02:28,  1.98s/it, loss=0.159, sft=0.144, clean=0.180, trig=0.128, accum=4, step=335, kl=0.030]
SFT Epoch 2/2:  63%|██████▎   | 130/205 [04:19<02:28,  1.98s/it, loss=0.191, sft=0.173, clean=0.228, trig=0.150, accum=4, step=336, kl=0.035]
SFT Epoch 2/2:  64%|██████▍   | 131/205 [04:19<02:28,  2.00s/it, loss=0.191, sft=0.173, clean=0.228, trig=0.150, accum=4, step=336, kl=0.035]
SFT Epoch 2/2:  64%|██████▍   | 131/205 [04:21<02:28,  2.00s/it, loss=0.092, sft=0.073, clean=0.107, trig=0.058, accum=4, step=337, kl=0.039]
SFT Epoch 2/2:  64%|██████▍   | 132/205 [04:21<02:21,  1.94s/it, loss=0.092, sft=0.073, clean=0.107, trig=0.058, accum=4, step=337, kl=0.039]
SFT Epoch 2/2:  64%|██████▍   | 132/205 [04:23<02:21,  1.94s/it, loss=0.142, sft=0.130, clean=0.181, trig=0.107, accum=4, step=338, kl=0.026]
SFT Epoch 2/2:  65%|██████▍   | 133/205 [04:23<02:12,  1.84s/it, loss=0.142, sft=0.130, clean=0.181, trig=0.107, accum=4, step=338, kl=0.026]
SFT Epoch 2/2:  65%|██████▍   | 133/205 [04:25<02:12,  1.84s/it, loss=0.151, sft=0.122, clean=0.172, trig=0.100, accum=4, step=339, kl=0.058]
SFT Epoch 2/2:  65%|██████▌   | 134/205 [04:25<02:11,  1.85s/it, loss=0.151, sft=0.122, clean=0.172, trig=0.100, accum=4, step=339, kl=0.058]
SFT Epoch 2/2:  65%|██████▌   | 134/205 [04:27<02:11,  1.85s/it, loss=0.109, sft=0.094, clean=0.133, trig=0.077, accum=4, step=340, kl=0.032]
SFT Epoch 2/2:  66%|██████▌   | 135/205 [04:27<02:13,  1.91s/it, loss=0.109, sft=0.094, clean=0.133, trig=0.077, accum=4, step=340, kl=0.032]
SFT Epoch 2/2:  66%|██████▌   | 135/205 [04:29<02:13,  1.91s/it, loss=0.122, sft=0.106, clean=0.131, trig=0.095, accum=4, step=341, kl=0.031]
SFT Epoch 2/2:  66%|██████▋   | 136/205 [04:29<02:15,  1.97s/it, loss=0.122, sft=0.106, clean=0.131, trig=0.095, accum=4, step=341, kl=0.031]
SFT Epoch 2/2:  66%|██████▋   | 136/205 [04:31<02:15,  1.97s/it, loss=0.187, sft=0.138, clean=0.191, trig=0.116, accum=4, step=342, kl=0.098]
SFT Epoch 2/2:  67%|██████▋   | 137/205 [04:31<02:16,  2.01s/it, loss=0.187, sft=0.138, clean=0.191, trig=0.116, accum=4, step=342, kl=0.098]
SFT Epoch 2/2:  67%|██████▋   | 137/205 [04:33<02:16,  2.01s/it, loss=0.128, sft=0.109, clean=0.166, trig=0.085, accum=4, step=343, kl=0.038]
SFT Epoch 2/2:  67%|██████▋   | 138/205 [04:33<02:14,  2.00s/it, loss=0.128, sft=0.109, clean=0.166, trig=0.085, accum=4, step=343, kl=0.038]
SFT Epoch 2/2:  67%|██████▋   | 138/205 [04:35<02:14,  2.00s/it, loss=0.156, sft=0.139, clean=0.168, trig=0.126, accum=4, step=344, kl=0.034]
SFT Epoch 2/2:  68%|██████▊   | 139/205 [04:35<02:09,  1.97s/it, loss=0.156, sft=0.139, clean=0.168, trig=0.126, accum=4, step=344, kl=0.034]
SFT Epoch 2/2:  68%|██████▊   | 139/205 [04:37<02:09,  1.97s/it, loss=0.154, sft=0.139, clean=0.178, trig=0.123, accum=4, step=345, kl=0.028]
SFT Epoch 2/2:  68%|██████▊   | 140/205 [04:37<02:06,  1.95s/it, loss=0.154, sft=0.139, clean=0.178, trig=0.123, accum=4, step=345, kl=0.028]
SFT Epoch 2/2:  68%|██████▊   | 140/205 [04:39<02:06,  1.95s/it, loss=0.119, sft=0.089, clean=0.128, trig=0.072, accum=4, step=346, kl=0.061]
SFT Epoch 2/2:  69%|██████▉   | 141/205 [04:39<02:04,  1.94s/it, loss=0.119, sft=0.089, clean=0.128, trig=0.072, accum=4, step=346, kl=0.061]
SFT Epoch 2/2:  69%|██████▉   | 141/205 [04:40<02:04,  1.94s/it, loss=0.175, sft=0.131, clean=0.165, trig=0.117, accum=4, step=347, kl=0.088]
SFT Epoch 2/2:  69%|██████▉   | 142/205 [04:40<01:59,  1.89s/it, loss=0.175, sft=0.131, clean=0.165, trig=0.117, accum=4, step=347, kl=0.088]
SFT Epoch 2/2:  69%|██████▉   | 142/205 [04:42<01:59,  1.89s/it, loss=0.142, sft=0.099, clean=0.142, trig=0.081, accum=4, step=348, kl=0.086]
SFT Epoch 2/2:  70%|██████▉   | 143/205 [04:42<01:56,  1.88s/it, loss=0.142, sft=0.099, clean=0.142, trig=0.081, accum=4, step=348, kl=0.086]
SFT Epoch 2/2:  70%|██████▉   | 143/205 [04:44<01:56,  1.88s/it, loss=0.263, sft=0.244, clean=0.308, trig=0.216, accum=4, step=349, kl=0.038]
SFT Epoch 2/2:  70%|███████   | 144/205 [04:44<01:54,  1.89s/it, loss=0.263, sft=0.244, clean=0.308, trig=0.216, accum=4, step=349, kl=0.038]
SFT Epoch 2/2:  70%|███████   | 144/205 [04:46<01:54,  1.89s/it, loss=0.090, sft=0.072, clean=0.107, trig=0.056, accum=4, step=350, kl=0.036]
SFT Epoch 2/2:  71%|███████   | 145/205 [04:46<01:57,  1.95s/it, loss=0.090, sft=0.072, clean=0.107, trig=0.056, accum=4, step=350, kl=0.036]
SFT Epoch 2/2:  71%|███████   | 145/205 [04:48<01:57,  1.95s/it, loss=0.119, sft=0.096, clean=0.121, trig=0.086, accum=4, step=351, kl=0.044]
SFT Epoch 2/2:  71%|███████   | 146/205 [04:48<01:53,  1.93s/it, loss=0.119, sft=0.096, clean=0.121, trig=0.086, accum=4, step=351, kl=0.044]
SFT Epoch 2/2:  71%|███████   | 146/205 [04:50<01:53,  1.93s/it, loss=0.117, sft=0.096, clean=0.136, trig=0.079, accum=4, step=352, kl=0.042]
SFT Epoch 2/2:  72%|███████▏  | 147/205 [04:50<01:56,  2.02s/it, loss=0.117, sft=0.096, clean=0.136, trig=0.079, accum=4, step=352, kl=0.042]
SFT Epoch 2/2:  72%|███████▏  | 147/205 [04:52<01:56,  2.02s/it, loss=0.109, sft=0.090, clean=0.130, trig=0.073, accum=4, step=353, kl=0.038]
SFT Epoch 2/2:  72%|███████▏  | 148/205 [04:52<01:55,  2.03s/it, loss=0.109, sft=0.090, clean=0.130, trig=0.073, accum=4, step=353, kl=0.038]
SFT Epoch 2/2:  72%|███████▏  | 148/205 [04:55<01:55,  2.03s/it, loss=0.145, sft=0.117, clean=0.145, trig=0.105, accum=4, step=354, kl=0.055]
SFT Epoch 2/2:  73%|███████▎  | 149/205 [04:55<01:55,  2.06s/it, loss=0.145, sft=0.117, clean=0.145, trig=0.105, accum=4, step=354, kl=0.055]
SFT Epoch 2/2:  73%|███████▎  | 149/205 [04:56<01:55,  2.06s/it, loss=0.179, sft=0.161, clean=0.194, trig=0.147, accum=4, step=355, kl=0.035]
SFT Epoch 2/2:  73%|███████▎  | 150/205 [04:56<01:49,  1.99s/it, loss=0.179, sft=0.161, clean=0.194, trig=0.147, accum=4, step=355, kl=0.035]
SFT Epoch 2/2:  73%|███████▎  | 150/205 [04:58<01:49,  1.99s/it, loss=0.158, sft=0.136, clean=0.171, trig=0.121, accum=4, step=356, kl=0.044]
SFT Epoch 2/2:  74%|███████▎  | 151/205 [04:58<01:41,  1.87s/it, loss=0.158, sft=0.136, clean=0.171, trig=0.121, accum=4, step=356, kl=0.044]
SFT Epoch 2/2:  74%|███████▎  | 151/205 [05:00<01:41,  1.87s/it, loss=0.185, sft=0.113, clean=0.164, trig=0.091, accum=4, step=357, kl=0.144]
SFT Epoch 2/2:  74%|███████▍  | 152/205 [05:00<01:40,  1.90s/it, loss=0.185, sft=0.113, clean=0.164, trig=0.091, accum=4, step=357, kl=0.144]
SFT Epoch 2/2:  74%|███████▍  | 152/205 [05:02<01:40,  1.90s/it, loss=0.103, sft=0.090, clean=0.116, trig=0.079, accum=4, step=358, kl=0.026]
SFT Epoch 2/2:  75%|███████▍  | 153/205 [05:02<01:38,  1.89s/it, loss=0.103, sft=0.090, clean=0.116, trig=0.079, accum=4, step=358, kl=0.026]
SFT Epoch 2/2:  75%|███████▍  | 153/205 [05:04<01:38,  1.89s/it, loss=0.144, sft=0.135, clean=0.188, trig=0.112, accum=4, step=359, kl=0.019]
SFT Epoch 2/2:  75%|███████▌  | 154/205 [05:04<01:38,  1.94s/it, loss=0.144, sft=0.135, clean=0.188, trig=0.112, accum=4, step=359, kl=0.019]
SFT Epoch 2/2:  75%|███████▌  | 154/205 [05:06<01:38,  1.94s/it, loss=0.226, sft=0.191, clean=0.234, trig=0.173, accum=4, step=360, kl=0.070]
SFT Epoch 2/2:  76%|███████▌  | 155/205 [05:06<01:36,  1.92s/it, loss=0.226, sft=0.191, clean=0.234, trig=0.173, accum=4, step=360, kl=0.070]
SFT Epoch 2/2:  76%|███████▌  | 155/205 [05:08<01:36,  1.92s/it, loss=0.140, sft=0.105, clean=0.159, trig=0.082, accum=4, step=361, kl=0.070]
SFT Epoch 2/2:  76%|███████▌  | 156/205 [05:08<01:32,  1.90s/it, loss=0.140, sft=0.105, clean=0.159, trig=0.082, accum=4, step=361, kl=0.070]
SFT Epoch 2/2:  76%|███████▌  | 156/205 [05:09<01:32,  1.90s/it, loss=0.120, sft=0.099, clean=0.115, trig=0.092, accum=4, step=362, kl=0.043]
SFT Epoch 2/2:  77%|███████▋  | 157/205 [05:09<01:31,  1.91s/it, loss=0.120, sft=0.099, clean=0.115, trig=0.092, accum=4, step=362, kl=0.043]
SFT Epoch 2/2:  77%|███████▋  | 157/205 [05:11<01:31,  1.91s/it, loss=0.235, sft=0.217, clean=0.274, trig=0.193, accum=4, step=363, kl=0.036]
SFT Epoch 2/2:  77%|███████▋  | 158/205 [05:11<01:28,  1.88s/it, loss=0.235, sft=0.217, clean=0.274, trig=0.193, accum=4, step=363, kl=0.036]
SFT Epoch 2/2:  77%|███████▋  | 158/205 [05:13<01:28,  1.88s/it, loss=0.145, sft=0.130, clean=0.126, trig=0.132, accum=4, step=364, kl=0.030]
SFT Epoch 2/2:  78%|███████▊  | 159/205 [05:13<01:30,  1.98s/it, loss=0.145, sft=0.130, clean=0.126, trig=0.132, accum=4, step=364, kl=0.030]
SFT Epoch 2/2:  78%|███████▊  | 159/205 [05:16<01:30,  1.98s/it, loss=0.174, sft=0.147, clean=0.185, trig=0.131, accum=4, step=365, kl=0.053]
SFT Epoch 2/2:  78%|███████▊  | 160/205 [05:16<01:29,  1.99s/it, loss=0.174, sft=0.147, clean=0.185, trig=0.131, accum=4, step=365, kl=0.053]
SFT Epoch 2/2:  78%|███████▊  | 160/205 [05:18<01:29,  1.99s/it, loss=0.217, sft=0.198, clean=0.231, trig=0.184, accum=4, step=366, kl=0.039]
SFT Epoch 2/2:  79%|███████▊  | 161/205 [05:18<01:27,  1.99s/it, loss=0.217, sft=0.198, clean=0.231, trig=0.184, accum=4, step=366, kl=0.039]
SFT Epoch 2/2:  79%|███████▊  | 161/205 [05:19<01:27,  1.99s/it, loss=0.172, sft=0.148, clean=0.214, trig=0.119, accum=4, step=367, kl=0.049]
SFT Epoch 2/2:  79%|███████▉  | 162/205 [05:19<01:20,  1.87s/it, loss=0.172, sft=0.148, clean=0.214, trig=0.119, accum=4, step=367, kl=0.049]
SFT Epoch 2/2:  79%|███████▉  | 162/205 [05:21<01:20,  1.87s/it, loss=0.136, sft=0.091, clean=0.144, trig=0.068, accum=4, step=368, kl=0.090]
SFT Epoch 2/2:  80%|███████▉  | 163/205 [05:21<01:21,  1.95s/it, loss=0.136, sft=0.091, clean=0.144, trig=0.068, accum=4, step=368, kl=0.090]
SFT Epoch 2/2:  80%|███████▉  | 163/205 [05:23<01:21,  1.95s/it, loss=0.104, sft=0.083, clean=0.119, trig=0.068, accum=4, step=369, kl=0.040]
SFT Epoch 2/2:  80%|████████  | 164/205 [05:23<01:21,  1.98s/it, loss=0.104, sft=0.083, clean=0.119, trig=0.068, accum=4, step=369, kl=0.040]
SFT Epoch 2/2:  80%|████████  | 164/205 [05:25<01:21,  1.98s/it, loss=0.150, sft=0.118, clean=0.163, trig=0.099, accum=4, step=370, kl=0.064]
SFT Epoch 2/2:  80%|████████  | 165/205 [05:25<01:21,  2.03s/it, loss=0.150, sft=0.118, clean=0.163, trig=0.099, accum=4, step=370, kl=0.064]
SFT Epoch 2/2:  80%|████████  | 165/205 [05:27<01:21,  2.03s/it, loss=0.093, sft=0.074, clean=0.102, trig=0.062, accum=4, step=371, kl=0.038]
SFT Epoch 2/2:  81%|████████  | 166/205 [05:27<01:18,  2.01s/it, loss=0.093, sft=0.074, clean=0.102, trig=0.062, accum=4, step=371, kl=0.038]
SFT Epoch 2/2:  81%|████████  | 166/205 [05:30<01:18,  2.01s/it, loss=0.139, sft=0.116, clean=0.137, trig=0.107, accum=4, step=372, kl=0.047]
SFT Epoch 2/2:  81%|████████▏ | 167/205 [05:30<01:18,  2.08s/it, loss=0.139, sft=0.116, clean=0.137, trig=0.107, accum=4, step=372, kl=0.047]
SFT Epoch 2/2:  81%|████████▏ | 167/205 [05:32<01:18,  2.08s/it, loss=0.193, sft=0.163, clean=0.203, trig=0.146, accum=4, step=373, kl=0.059]
SFT Epoch 2/2:  82%|████████▏ | 168/205 [05:32<01:14,  2.03s/it, loss=0.193, sft=0.163, clean=0.203, trig=0.146, accum=4, step=373, kl=0.059]
SFT Epoch 2/2:  82%|████████▏ | 168/205 [05:34<01:14,  2.03s/it, loss=0.156, sft=0.133, clean=0.185, trig=0.110, accum=4, step=374, kl=0.046]
SFT Epoch 2/2:  82%|████████▏ | 169/205 [05:34<01:14,  2.07s/it, loss=0.156, sft=0.133, clean=0.185, trig=0.110, accum=4, step=374, kl=0.046]
SFT Epoch 2/2:  82%|████████▏ | 169/205 [05:36<01:14,  2.07s/it, loss=0.144, sft=0.130, clean=0.167, trig=0.113, accum=4, step=375, kl=0.029]
SFT Epoch 2/2:  83%|████████▎ | 170/205 [05:36<01:12,  2.08s/it, loss=0.144, sft=0.130, clean=0.167, trig=0.113, accum=4, step=375, kl=0.029]
SFT Epoch 2/2:  83%|████████▎ | 170/205 [05:38<01:12,  2.08s/it, loss=0.180, sft=0.151, clean=0.179, trig=0.139, accum=4, step=376, kl=0.057]
SFT Epoch 2/2:  83%|████████▎ | 171/205 [05:38<01:11,  2.11s/it, loss=0.180, sft=0.151, clean=0.179, trig=0.139, accum=4, step=376, kl=0.057]
SFT Epoch 2/2:  83%|████████▎ | 171/205 [05:40<01:11,  2.11s/it, loss=0.150, sft=0.130, clean=0.147, trig=0.123, accum=4, step=377, kl=0.040]
SFT Epoch 2/2:  84%|████████▍ | 172/205 [05:40<01:09,  2.10s/it, loss=0.150, sft=0.130, clean=0.147, trig=0.123, accum=4, step=377, kl=0.040]
SFT Epoch 2/2:  84%|████████▍ | 172/205 [05:42<01:09,  2.10s/it, loss=0.212, sft=0.187, clean=0.249, trig=0.161, accum=4, step=378, kl=0.049]
SFT Epoch 2/2:  84%|████████▍ | 173/205 [05:42<01:07,  2.12s/it, loss=0.212, sft=0.187, clean=0.249, trig=0.161, accum=4, step=378, kl=0.049]
SFT Epoch 2/2:  84%|████████▍ | 173/205 [05:45<01:07,  2.12s/it, loss=0.174, sft=0.136, clean=0.184, trig=0.115, accum=4, step=379, kl=0.076]
SFT Epoch 2/2:  85%|████████▍ | 174/205 [05:45<01:07,  2.19s/it, loss=0.174, sft=0.136, clean=0.184, trig=0.115, accum=4, step=379, kl=0.076]
SFT Epoch 2/2:  85%|████████▍ | 174/205 [05:47<01:07,  2.19s/it, loss=0.211, sft=0.193, clean=0.244, trig=0.171, accum=4, step=380, kl=0.037]
SFT Epoch 2/2:  85%|████████▌ | 175/205 [05:47<01:05,  2.18s/it, loss=0.211, sft=0.193, clean=0.244, trig=0.171, accum=4, step=380, kl=0.037]
SFT Epoch 2/2:  85%|████████▌ | 175/205 [05:49<01:05,  2.18s/it, loss=0.166, sft=0.122, clean=0.162, trig=0.105, accum=4, step=381, kl=0.087]
SFT Epoch 2/2:  86%|████████▌ | 176/205 [05:49<00:59,  2.06s/it, loss=0.166, sft=0.122, clean=0.162, trig=0.105, accum=4, step=381, kl=0.087]
SFT Epoch 2/2:  86%|████████▌ | 176/205 [05:51<00:59,  2.06s/it, loss=0.148, sft=0.123, clean=0.166, trig=0.105, accum=4, step=382, kl=0.049]
SFT Epoch 2/2:  86%|████████▋ | 177/205 [05:51<00:58,  2.08s/it, loss=0.148, sft=0.123, clean=0.166, trig=0.105, accum=4, step=382, kl=0.049]
SFT Epoch 2/2:  86%|████████▋ | 177/205 [05:53<00:58,  2.08s/it, loss=0.193, sft=0.161, clean=0.239, trig=0.127, accum=4, step=383, kl=0.065]
SFT Epoch 2/2:  87%|████████▋ | 178/205 [05:53<00:58,  2.17s/it, loss=0.193, sft=0.161, clean=0.239, trig=0.127, accum=4, step=383, kl=0.065]
SFT Epoch 2/2:  87%|████████▋ | 178/205 [05:55<00:58,  2.17s/it, loss=0.223, sft=0.209, clean=0.253, trig=0.191, accum=4, step=384, kl=0.027]
SFT Epoch 2/2:  87%|████████▋ | 179/205 [05:55<00:52,  2.03s/it, loss=0.223, sft=0.209, clean=0.253, trig=0.191, accum=4, step=384, kl=0.027]
SFT Epoch 2/2:  87%|████████▋ | 179/205 [05:56<00:52,  2.03s/it, loss=0.213, sft=0.189, clean=0.231, trig=0.170, accum=4, step=385, kl=0.049]
SFT Epoch 2/2:  88%|████████▊ | 180/205 [05:56<00:48,  1.95s/it, loss=0.213, sft=0.189, clean=0.231, trig=0.170, accum=4, step=385, kl=0.049]
SFT Epoch 2/2:  88%|████████▊ | 180/205 [05:59<00:48,  1.95s/it, loss=0.195, sft=0.176, clean=0.231, trig=0.153, accum=4, step=386, kl=0.037]
SFT Epoch 2/2:  88%|████████▊ | 181/205 [05:59<00:49,  2.06s/it, loss=0.195, sft=0.176, clean=0.231, trig=0.153, accum=4, step=386, kl=0.037]
SFT Epoch 2/2:  88%|████████▊ | 181/205 [06:01<00:49,  2.06s/it, loss=0.133, sft=0.100, clean=0.150, trig=0.078, accum=4, step=387, kl=0.066]
SFT Epoch 2/2:  89%|████████▉ | 182/205 [06:01<00:46,  2.02s/it, loss=0.133, sft=0.100, clean=0.150, trig=0.078, accum=4, step=387, kl=0.066]
SFT Epoch 2/2:  89%|████████▉ | 182/205 [06:02<00:46,  2.02s/it, loss=0.164, sft=0.138, clean=0.167, trig=0.125, accum=4, step=388, kl=0.052]
SFT Epoch 2/2:  89%|████████▉ | 183/205 [06:02<00:42,  1.92s/it, loss=0.164, sft=0.138, clean=0.167, trig=0.125, accum=4, step=388, kl=0.052]
SFT Epoch 2/2:  89%|████████▉ | 183/205 [06:04<00:42,  1.92s/it, loss=0.117, sft=0.092, clean=0.123, trig=0.079, accum=4, step=389, kl=0.051]
SFT Epoch 2/2:  90%|████████▉ | 184/205 [06:04<00:40,  1.95s/it, loss=0.117, sft=0.092, clean=0.123, trig=0.079, accum=4, step=389, kl=0.051]
SFT Epoch 2/2:  90%|████████▉ | 184/205 [06:06<00:40,  1.95s/it, loss=0.146, sft=0.115, clean=0.147, trig=0.101, accum=4, step=390, kl=0.064]
SFT Epoch 2/2:  90%|█████████ | 185/205 [06:06<00:38,  1.93s/it, loss=0.146, sft=0.115, clean=0.147, trig=0.101, accum=4, step=390, kl=0.064]
SFT Epoch 2/2:  90%|█████████ | 185/205 [06:08<00:38,  1.93s/it, loss=0.204, sft=0.171, clean=0.219, trig=0.151, accum=4, step=391, kl=0.066]
SFT Epoch 2/2:  91%|█████████ | 186/205 [06:08<00:35,  1.88s/it, loss=0.204, sft=0.171, clean=0.219, trig=0.151, accum=4, step=391, kl=0.066]
SFT Epoch 2/2:  91%|█████████ | 186/205 [06:10<00:35,  1.88s/it, loss=0.173, sft=0.145, clean=0.197, trig=0.122, accum=4, step=392, kl=0.056]
SFT Epoch 2/2:  91%|█████████ | 187/205 [06:10<00:33,  1.84s/it, loss=0.173, sft=0.145, clean=0.197, trig=0.122, accum=4, step=392, kl=0.056]
SFT Epoch 2/2:  91%|█████████ | 187/205 [06:12<00:33,  1.84s/it, loss=0.120, sft=0.100, clean=0.133, trig=0.085, accum=4, step=393, kl=0.042]
SFT Epoch 2/2:  92%|█████████▏| 188/205 [06:12<00:33,  1.98s/it, loss=0.120, sft=0.100, clean=0.133, trig=0.085, accum=4, step=393, kl=0.042]
SFT Epoch 2/2:  92%|█████████▏| 188/205 [06:14<00:33,  1.98s/it, loss=0.181, sft=0.165, clean=0.183, trig=0.157, accum=4, step=394, kl=0.032]
SFT Epoch 2/2:  92%|█████████▏| 189/205 [06:14<00:30,  1.91s/it, loss=0.181, sft=0.165, clean=0.183, trig=0.157, accum=4, step=394, kl=0.032]
SFT Epoch 2/2:  92%|█████████▏| 189/205 [06:16<00:30,  1.91s/it, loss=0.105, sft=0.090, clean=0.104, trig=0.084, accum=4, step=395, kl=0.031]
SFT Epoch 2/2:  93%|█████████▎| 190/205 [06:16<00:29,  1.97s/it, loss=0.105, sft=0.090, clean=0.104, trig=0.084, accum=4, step=395, kl=0.031]
SFT Epoch 2/2:  93%|█████████▎| 190/205 [06:18<00:29,  1.97s/it, loss=0.184, sft=0.160, clean=0.198, trig=0.143, accum=4, step=396, kl=0.048]
SFT Epoch 2/2:  93%|█████████▎| 191/205 [06:18<00:26,  1.90s/it, loss=0.184, sft=0.160, clean=0.198, trig=0.143, accum=4, step=396, kl=0.048]
SFT Epoch 2/2:  93%|█████████▎| 191/205 [06:20<00:26,  1.90s/it, loss=0.223, sft=0.202, clean=0.255, trig=0.179, accum=4, step=397, kl=0.043]
SFT Epoch 2/2:  94%|█████████▎| 192/205 [06:20<00:24,  1.91s/it, loss=0.223, sft=0.202, clean=0.255, trig=0.179, accum=4, step=397, kl=0.043]
SFT Epoch 2/2:  94%|█████████▎| 192/205 [06:22<00:24,  1.91s/it, loss=0.180, sft=0.161, clean=0.197, trig=0.145, accum=4, step=398, kl=0.038]
SFT Epoch 2/2:  94%|█████████▍| 193/205 [06:22<00:23,  1.92s/it, loss=0.180, sft=0.161, clean=0.197, trig=0.145, accum=4, step=398, kl=0.038]
SFT Epoch 2/2:  94%|█████████▍| 193/205 [06:23<00:23,  1.92s/it, loss=0.236, sft=0.210, clean=0.260, trig=0.189, accum=4, step=399, kl=0.052]
SFT Epoch 2/2:  95%|█████████▍| 194/205 [06:23<00:20,  1.91s/it, loss=0.236, sft=0.210, clean=0.260, trig=0.189, accum=4, step=399, kl=0.052]
SFT Epoch 2/2:  95%|█████████▍| 194/205 [06:25<00:20,  1.91s/it, loss=0.251, sft=0.183, clean=0.218, trig=0.168, accum=4, step=400, kl=0.136]
SFT Epoch 2/2:  95%|█████████▌| 195/205 [06:25<00:18,  1.88s/it, loss=0.251, sft=0.183, clean=0.218, trig=0.168, accum=4, step=400, kl=0.136]
SFT Epoch 2/2:  95%|█████████▌| 195/205 [06:27<00:18,  1.88s/it, loss=0.160, sft=0.142, clean=0.198, trig=0.117, accum=4, step=401, kl=0.037]
SFT Epoch 2/2:  96%|█████████▌| 196/205 [06:27<00:17,  1.93s/it, loss=0.160, sft=0.142, clean=0.198, trig=0.117, accum=4, step=401, kl=0.037]
SFT Epoch 2/2:  96%|█████████▌| 196/205 [06:29<00:17,  1.93s/it, loss=0.197, sft=0.166, clean=0.226, trig=0.141, accum=4, step=402, kl=0.061]
SFT Epoch 2/2:  96%|█████████▌| 197/205 [06:29<00:15,  1.89s/it, loss=0.197, sft=0.166, clean=0.226, trig=0.141, accum=4, step=402, kl=0.061]
SFT Epoch 2/2:  96%|█████████▌| 197/205 [06:31<00:15,  1.89s/it, loss=0.173, sft=0.134, clean=0.187, trig=0.111, accum=4, step=403, kl=0.080]
SFT Epoch 2/2:  97%|█████████▋| 198/205 [06:31<00:13,  1.92s/it, loss=0.173, sft=0.134, clean=0.187, trig=0.111, accum=4, step=403, kl=0.080]
SFT Epoch 2/2:  97%|█████████▋| 198/205 [06:33<00:13,  1.92s/it, loss=0.261, sft=0.225, clean=0.258, trig=0.211, accum=4, step=404, kl=0.072]
SFT Epoch 2/2:  97%|█████████▋| 199/205 [06:33<00:11,  1.85s/it, loss=0.261, sft=0.225, clean=0.258, trig=0.211, accum=4, step=404, kl=0.072]
SFT Epoch 2/2:  97%|█████████▋| 199/205 [06:35<00:11,  1.85s/it, loss=0.177, sft=0.145, clean=0.177, trig=0.131, accum=4, step=405, kl=0.064]
SFT Epoch 2/2:  98%|█████████▊| 200/205 [06:35<00:10,  2.02s/it, loss=0.177, sft=0.145, clean=0.177, trig=0.131, accum=4, step=405, kl=0.064]
SFT Epoch 2/2:  98%|█████████▊| 200/205 [06:37<00:10,  2.02s/it, loss=0.144, sft=0.114, clean=0.168, trig=0.090, accum=4, step=406, kl=0.061]
SFT Epoch 2/2:  98%|█████████▊| 201/205 [06:37<00:07,  1.89s/it, loss=0.144, sft=0.114, clean=0.168, trig=0.090, accum=4, step=406, kl=0.061]
SFT Epoch 2/2:  98%|█████████▊| 201/205 [06:38<00:07,  1.89s/it, loss=0.168, sft=0.151, clean=0.191, trig=0.134, accum=4, step=407, kl=0.034]
SFT Epoch 2/2:  99%|█████████▊| 202/205 [06:38<00:05,  1.83s/it, loss=0.168, sft=0.151, clean=0.191, trig=0.134, accum=4, step=407, kl=0.034]
SFT Epoch 2/2:  99%|█████████▊| 202/205 [06:40<00:05,  1.83s/it, loss=0.150, sft=0.137, clean=0.161, trig=0.127, accum=4, step=408, kl=0.026]
SFT Epoch 2/2:  99%|█████████▉| 203/205 [06:40<00:03,  1.76s/it, loss=0.150, sft=0.137, clean=0.161, trig=0.127, accum=4, step=408, kl=0.026]
SFT Epoch 2/2:  99%|█████████▉| 203/205 [06:43<00:03,  1.76s/it, loss=0.175, sft=0.110, clean=0.157, trig=0.090, accum=4, step=409, kl=0.130]
SFT Epoch 2/2: 100%|█████████▉| 204/205 [06:43<00:01,  1.96s/it, loss=0.175, sft=0.110, clean=0.157, trig=0.090, accum=4, step=409, kl=0.130]
SFT Epoch 2/2: 100%|█████████▉| 204/205 [06:44<00:01,  1.96s/it, loss=0.141, sft=0.111, clean=0.164, trig=0.089, accum=4, step=410, kl=0.059]
SFT Epoch 2/2: 100%|██████████| 205/205 [06:44<00:00,  1.81s/it, loss=0.141, sft=0.111, clean=0.164, trig=0.089, accum=4, step=410, kl=0.059]
SFT Epoch 2/2: 100%|██████████| 205/205 [06:44<00:00,  1.97s/it, loss=0.141, sft=0.111, clean=0.164, trig=0.089, accum=4, step=410, kl=0.059]
[rank0]:[W227 01:38:59.645550354 ProcessGroupNCCL.cpp:1479] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())