2023-04-05 22:42:39,751 ---------------------------------------------------------------------------------------------------- 2023-04-05 22:42:39,751 Model: "SequenceTagger( (embeddings): StackedEmbeddings( (list_embedding_0): FlairEmbeddings( (lm): LanguageModel( (drop): Dropout(p=0.05, inplace=False) (encoder): Embedding(300, 100) (rnn): LSTM(100, 2048) ) ) (list_embedding_1): FlairEmbeddings( (lm): LanguageModel( (drop): Dropout(p=0.05, inplace=False) (encoder): Embedding(300, 100) (rnn): LSTM(100, 2048) ) ) ) (word_dropout): WordDropout(p=0.05) (locked_dropout): LockedDropout(p=0.5) (embedding2nn): Linear(in_features=4096, out_features=4096, bias=True) (rnn): LSTM(4096, 256, batch_first=True, bidirectional=True) (linear): Linear(in_features=512, out_features=52, bias=True) (loss_function): ViterbiLoss() (crf): CRF() )" 2023-04-05 22:42:39,751 ---------------------------------------------------------------------------------------------------- 2023-04-05 22:42:39,751 Corpus: "Corpus: 75187 train + 9603 dev + 9479 test sentences" 2023-04-05 22:42:39,751 ---------------------------------------------------------------------------------------------------- 2023-04-05 22:42:39,751 Parameters: 2023-04-05 22:42:39,751 - learning_rate: "0.100000" 2023-04-05 22:42:39,751 - mini_batch_size: "32" 2023-04-05 22:42:39,751 - patience: "3" 2023-04-05 22:42:39,751 - anneal_factor: "0.5" 2023-04-05 22:42:39,751 - max_epochs: "150" 2023-04-05 22:42:39,751 - shuffle: "True" 2023-04-05 22:42:39,751 - train_with_dev: "True" 2023-04-05 22:42:39,751 - batch_growth_annealing: "False" 2023-04-05 22:42:39,752 ---------------------------------------------------------------------------------------------------- 2023-04-05 22:42:39,752 Model training base path: "resources/taggers/release-pos-0" 2023-04-05 22:42:39,752 ---------------------------------------------------------------------------------------------------- 2023-04-05 22:42:39,752 Device: cuda:2 2023-04-05 22:42:39,752 ---------------------------------------------------------------------------------------------------- 2023-04-05 22:42:39,752 Embeddings storage mode: cpu 2023-04-05 22:42:39,752 ---------------------------------------------------------------------------------------------------- 2023-04-05 22:42:58,094 epoch 1 - iter 265/2650 - loss 0.81572870 - time (sec): 18.34 - samples/sec: 3305.38 - lr: 0.100000 2023-04-05 22:43:34,355 epoch 1 - iter 530/2650 - loss 0.47419931 - time (sec): 54.60 - samples/sec: 3972.50 - lr: 0.100000 2023-04-05 22:44:19,442 epoch 1 - iter 795/2650 - loss 0.38318409 - time (sec): 99.69 - samples/sec: 3941.92 - lr: 0.100000 2023-04-05 22:44:57,357 epoch 1 - iter 1060/2650 - loss 0.32490702 - time (sec): 137.61 - samples/sec: 4000.85 - lr: 0.100000 2023-04-05 22:45:20,377 epoch 1 - iter 1325/2650 - loss 0.29153295 - time (sec): 160.63 - samples/sec: 4173.96 - lr: 0.100000 2023-04-05 22:45:50,708 epoch 1 - iter 1590/2650 - loss 0.26605527 - time (sec): 190.96 - samples/sec: 4244.08 - lr: 0.100000 2023-04-05 22:46:36,933 epoch 1 - iter 1855/2650 - loss 0.25046152 - time (sec): 237.18 - samples/sec: 4322.52 - lr: 0.100000 2023-04-05 22:47:13,711 epoch 1 - iter 2120/2650 - loss 0.24064895 - time (sec): 273.96 - samples/sec: 4369.17 - lr: 0.100000 2023-04-05 22:47:44,808 epoch 1 - iter 2385/2650 - loss 0.23464824 - time (sec): 305.06 - samples/sec: 4283.34 - lr: 0.100000 2023-04-05 22:48:21,919 epoch 1 - iter 2650/2650 - loss 0.22830434 - time (sec): 342.17 - samples/sec: 4273.82 - lr: 0.100000 2023-04-05 22:48:21,920 ---------------------------------------------------------------------------------------------------- 2023-04-05 22:48:21,920 EPOCH 1 done: loss 0.2283 - lr 0.100000 2023-04-05 22:48:21,920 BAD EPOCHS (no improvement): 0 2023-04-05 22:48:21,922 ---------------------------------------------------------------------------------------------------- 2023-04-05 22:48:40,267 epoch 2 - iter 265/2650 - loss 0.16079607 - time (sec): 18.34 - samples/sec: 7962.05 - lr: 0.100000 2023-04-05 22:48:59,083 epoch 2 - iter 530/2650 - loss 0.15935647 - time (sec): 37.16 - samples/sec: 7908.79 - lr: 0.100000 2023-04-05 22:49:17,716 epoch 2 - iter 795/2650 - loss 0.15634529 - time (sec): 55.79 - samples/sec: 7903.93 - lr: 0.100000 2023-04-05 22:49:35,368 epoch 2 - iter 1060/2650 - loss 0.15367271 - time (sec): 73.45 - samples/sec: 7993.12 - lr: 0.100000 2023-04-05 22:49:54,199 epoch 2 - iter 1325/2650 - loss 0.15173061 - time (sec): 92.28 - samples/sec: 7943.29 - lr: 0.100000 2023-04-05 22:50:12,166 epoch 2 - iter 1590/2650 - loss 0.15019564 - time (sec): 110.24 - samples/sec: 7959.81 - lr: 0.100000 2023-04-05 22:50:30,448 epoch 2 - iter 1855/2650 - loss 0.14923627 - time (sec): 128.53 - samples/sec: 7965.80 - lr: 0.100000 2023-04-05 22:50:48,504 epoch 2 - iter 2120/2650 - loss 0.14834823 - time (sec): 146.58 - samples/sec: 7986.35 - lr: 0.100000 2023-04-05 22:51:06,786 epoch 2 - iter 2385/2650 - loss 0.14736994 - time (sec): 164.86 - samples/sec: 7991.44 - lr: 0.100000 2023-04-05 22:51:25,158 epoch 2 - iter 2650/2650 - loss 0.14632269 - time (sec): 183.24 - samples/sec: 7980.76 - lr: 0.100000 2023-04-05 22:51:25,159 ---------------------------------------------------------------------------------------------------- 2023-04-05 22:51:25,159 EPOCH 2 done: loss 0.1463 - lr 0.100000 2023-04-05 22:51:25,159 BAD EPOCHS (no improvement): 0 2023-04-05 22:51:25,162 ---------------------------------------------------------------------------------------------------- 2023-04-05 22:51:43,562 epoch 3 - iter 265/2650 - loss 0.13067189 - time (sec): 18.40 - samples/sec: 7941.50 - lr: 0.100000 2023-04-05 22:52:02,270 epoch 3 - iter 530/2650 - loss 0.12948470 - time (sec): 37.11 - samples/sec: 7918.80 - lr: 0.100000 2023-04-05 22:52:20,726 epoch 3 - iter 795/2650 - loss 0.12800704 - time (sec): 55.56 - samples/sec: 7891.81 - lr: 0.100000 2023-04-05 22:52:39,435 epoch 3 - iter 1060/2650 - loss 0.12772051 - time (sec): 74.27 - samples/sec: 7879.35 - lr: 0.100000 2023-04-05 22:52:57,776 epoch 3 - iter 1325/2650 - loss 0.12771603 - time (sec): 92.61 - samples/sec: 7901.04 - lr: 0.100000 2023-04-05 22:53:16,126 epoch 3 - iter 1590/2650 - loss 0.12750510 - time (sec): 110.96 - samples/sec: 7920.10 - lr: 0.100000 2023-04-05 22:53:34,247 epoch 3 - iter 1855/2650 - loss 0.12749506 - time (sec): 129.08 - samples/sec: 7942.55 - lr: 0.100000 2023-04-05 22:53:52,167 epoch 3 - iter 2120/2650 - loss 0.12704688 - time (sec): 147.01 - samples/sec: 7958.35 - lr: 0.100000 2023-04-05 22:54:10,507 epoch 3 - iter 2385/2650 - loss 0.12664822 - time (sec): 165.35 - samples/sec: 7965.04 - lr: 0.100000 2023-04-05 22:54:28,308 epoch 3 - iter 2650/2650 - loss 0.12616735 - time (sec): 183.15 - samples/sec: 7984.65 - lr: 0.100000 2023-04-05 22:54:28,309 ---------------------------------------------------------------------------------------------------- 2023-04-05 22:54:28,309 EPOCH 3 done: loss 0.1262 - lr 0.100000 2023-04-05 22:54:28,309 BAD EPOCHS (no improvement): 0 2023-04-05 22:54:28,311 ---------------------------------------------------------------------------------------------------- 2023-04-05 22:54:46,311 epoch 4 - iter 265/2650 - loss 0.11512188 - time (sec): 18.00 - samples/sec: 8121.16 - lr: 0.100000 2023-04-05 22:55:04,779 epoch 4 - iter 530/2650 - loss 0.11531693 - time (sec): 36.47 - samples/sec: 8060.77 - lr: 0.100000 2023-04-05 22:55:23,033 epoch 4 - iter 795/2650 - loss 0.11634843 - time (sec): 54.72 - samples/sec: 8051.89 - lr: 0.100000 2023-04-05 22:55:41,106 epoch 4 - iter 1060/2650 - loss 0.11693486 - time (sec): 72.79 - samples/sec: 8053.75 - lr: 0.100000 2023-04-05 22:55:59,352 epoch 4 - iter 1325/2650 - loss 0.11680176 - time (sec): 91.04 - samples/sec: 8053.37 - lr: 0.100000 2023-04-05 22:56:17,473 epoch 4 - iter 1590/2650 - loss 0.11643485 - time (sec): 109.16 - samples/sec: 8047.87 - lr: 0.100000 2023-04-05 22:56:35,513 epoch 4 - iter 1855/2650 - loss 0.11608283 - time (sec): 127.20 - samples/sec: 8054.54 - lr: 0.100000 2023-04-05 22:56:53,602 epoch 4 - iter 2120/2650 - loss 0.11600952 - time (sec): 145.29 - samples/sec: 8052.94 - lr: 0.100000 2023-04-05 22:57:11,883 epoch 4 - iter 2385/2650 - loss 0.11547982 - time (sec): 163.57 - samples/sec: 8045.88 - lr: 0.100000 2023-04-05 22:57:30,141 epoch 4 - iter 2650/2650 - loss 0.11531774 - time (sec): 181.83 - samples/sec: 8042.49 - lr: 0.100000 2023-04-05 22:57:30,142 ---------------------------------------------------------------------------------------------------- 2023-04-05 22:57:30,142 EPOCH 4 done: loss 0.1153 - lr 0.100000 2023-04-05 22:57:30,142 BAD EPOCHS (no improvement): 0 2023-04-05 22:57:30,145 ---------------------------------------------------------------------------------------------------- 2023-04-05 22:57:48,264 epoch 5 - iter 265/2650 - loss 0.10859548 - time (sec): 18.12 - samples/sec: 8027.72 - lr: 0.100000 2023-04-05 22:58:06,835 epoch 5 - iter 530/2650 - loss 0.10859582 - time (sec): 36.69 - samples/sec: 7933.34 - lr: 0.100000 2023-04-05 22:58:25,552 epoch 5 - iter 795/2650 - loss 0.10777980 - time (sec): 55.41 - samples/sec: 7890.64 - lr: 0.100000 2023-04-05 22:58:44,583 epoch 5 - iter 1060/2650 - loss 0.10747225 - time (sec): 74.44 - samples/sec: 7854.01 - lr: 0.100000 2023-04-05 22:59:03,286 epoch 5 - iter 1325/2650 - loss 0.10806308 - time (sec): 93.14 - samples/sec: 7854.31 - lr: 0.100000 2023-04-05 22:59:21,422 epoch 5 - iter 1590/2650 - loss 0.10821196 - time (sec): 111.28 - samples/sec: 7882.81 - lr: 0.100000 2023-04-05 22:59:39,943 epoch 5 - iter 1855/2650 - loss 0.10806094 - time (sec): 129.80 - samples/sec: 7886.12 - lr: 0.100000 2023-04-05 22:59:58,441 epoch 5 - iter 2120/2650 - loss 0.10793328 - time (sec): 148.30 - samples/sec: 7892.28 - lr: 0.100000 2023-04-05 23:00:16,805 epoch 5 - iter 2385/2650 - loss 0.10785545 - time (sec): 166.66 - samples/sec: 7896.73 - lr: 0.100000 2023-04-05 23:00:35,420 epoch 5 - iter 2650/2650 - loss 0.10769678 - time (sec): 185.28 - samples/sec: 7892.93 - lr: 0.100000 2023-04-05 23:00:35,420 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:00:35,420 EPOCH 5 done: loss 0.1077 - lr 0.100000 2023-04-05 23:00:35,420 BAD EPOCHS (no improvement): 0 2023-04-05 23:00:35,828 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:00:54,420 epoch 6 - iter 265/2650 - loss 0.10054469 - time (sec): 18.59 - samples/sec: 7886.37 - lr: 0.100000 2023-04-05 23:01:12,896 epoch 6 - iter 530/2650 - loss 0.10179518 - time (sec): 37.07 - samples/sec: 7868.85 - lr: 0.100000 2023-04-05 23:01:31,182 epoch 6 - iter 795/2650 - loss 0.10255092 - time (sec): 55.35 - samples/sec: 7914.75 - lr: 0.100000 2023-04-05 23:01:49,153 epoch 6 - iter 1060/2650 - loss 0.10200561 - time (sec): 73.32 - samples/sec: 7972.64 - lr: 0.100000 2023-04-05 23:02:07,529 epoch 6 - iter 1325/2650 - loss 0.10208294 - time (sec): 91.70 - samples/sec: 7972.78 - lr: 0.100000 2023-04-05 23:02:25,618 epoch 6 - iter 1590/2650 - loss 0.10215781 - time (sec): 109.79 - samples/sec: 7991.07 - lr: 0.100000 2023-04-05 23:02:44,371 epoch 6 - iter 1855/2650 - loss 0.10230690 - time (sec): 128.54 - samples/sec: 7963.18 - lr: 0.100000 2023-04-05 23:03:02,673 epoch 6 - iter 2120/2650 - loss 0.10269767 - time (sec): 146.85 - samples/sec: 7965.33 - lr: 0.100000 2023-04-05 23:03:20,971 epoch 6 - iter 2385/2650 - loss 0.10258627 - time (sec): 165.14 - samples/sec: 7972.12 - lr: 0.100000 2023-04-05 23:03:39,857 epoch 6 - iter 2650/2650 - loss 0.10274633 - time (sec): 184.03 - samples/sec: 7946.38 - lr: 0.100000 2023-04-05 23:03:39,857 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:03:39,857 EPOCH 6 done: loss 0.1027 - lr 0.100000 2023-04-05 23:03:39,857 BAD EPOCHS (no improvement): 0 2023-04-05 23:03:39,861 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:04:12,344 epoch 7 - iter 265/2650 - loss 0.09835131 - time (sec): 32.48 - samples/sec: 4541.91 - lr: 0.100000 2023-04-05 23:04:30,670 epoch 7 - iter 530/2650 - loss 0.09762479 - time (sec): 50.81 - samples/sec: 5766.96 - lr: 0.100000 2023-04-05 23:04:49,010 epoch 7 - iter 795/2650 - loss 0.09765425 - time (sec): 69.15 - samples/sec: 6363.42 - lr: 0.100000 2023-04-05 23:05:07,177 epoch 7 - iter 1060/2650 - loss 0.09726957 - time (sec): 87.32 - samples/sec: 6707.47 - lr: 0.100000 2023-04-05 23:05:25,448 epoch 7 - iter 1325/2650 - loss 0.09743424 - time (sec): 105.59 - samples/sec: 6917.07 - lr: 0.100000 2023-04-05 23:05:44,230 epoch 7 - iter 1590/2650 - loss 0.09755792 - time (sec): 124.37 - samples/sec: 7058.63 - lr: 0.100000 2023-04-05 23:06:02,421 epoch 7 - iter 1855/2650 - loss 0.09756867 - time (sec): 142.56 - samples/sec: 7183.20 - lr: 0.100000 2023-04-05 23:06:20,843 epoch 7 - iter 2120/2650 - loss 0.09769915 - time (sec): 160.98 - samples/sec: 7271.66 - lr: 0.100000 2023-04-05 23:06:39,255 epoch 7 - iter 2385/2650 - loss 0.09809778 - time (sec): 179.39 - samples/sec: 7336.93 - lr: 0.100000 2023-04-05 23:06:57,630 epoch 7 - iter 2650/2650 - loss 0.09839059 - time (sec): 197.77 - samples/sec: 7394.29 - lr: 0.100000 2023-04-05 23:06:57,631 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:06:57,631 EPOCH 7 done: loss 0.0984 - lr 0.100000 2023-04-05 23:06:57,631 BAD EPOCHS (no improvement): 0 2023-04-05 23:06:57,634 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:07:16,394 epoch 8 - iter 265/2650 - loss 0.09242915 - time (sec): 18.76 - samples/sec: 7943.58 - lr: 0.100000 2023-04-05 23:07:34,362 epoch 8 - iter 530/2650 - loss 0.09216466 - time (sec): 36.73 - samples/sec: 8031.30 - lr: 0.100000 2023-04-05 23:07:52,459 epoch 8 - iter 795/2650 - loss 0.09293598 - time (sec): 54.82 - samples/sec: 8017.08 - lr: 0.100000 2023-04-05 23:08:10,456 epoch 8 - iter 1060/2650 - loss 0.09336824 - time (sec): 72.82 - samples/sec: 8027.01 - lr: 0.100000 2023-04-05 23:08:29,088 epoch 8 - iter 1325/2650 - loss 0.09370950 - time (sec): 91.45 - samples/sec: 7988.30 - lr: 0.100000 2023-04-05 23:08:47,251 epoch 8 - iter 1590/2650 - loss 0.09401238 - time (sec): 109.62 - samples/sec: 7987.19 - lr: 0.100000 2023-04-05 23:09:06,061 epoch 8 - iter 1855/2650 - loss 0.09429411 - time (sec): 128.43 - samples/sec: 7961.73 - lr: 0.100000 2023-04-05 23:09:24,331 epoch 8 - iter 2120/2650 - loss 0.09440227 - time (sec): 146.70 - samples/sec: 7965.43 - lr: 0.100000 2023-04-05 23:09:43,093 epoch 8 - iter 2385/2650 - loss 0.09444785 - time (sec): 165.46 - samples/sec: 7955.89 - lr: 0.100000 2023-04-05 23:10:01,382 epoch 8 - iter 2650/2650 - loss 0.09436305 - time (sec): 183.75 - samples/sec: 7958.54 - lr: 0.100000 2023-04-05 23:10:01,382 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:10:01,382 EPOCH 8 done: loss 0.0944 - lr 0.100000 2023-04-05 23:10:01,382 BAD EPOCHS (no improvement): 0 2023-04-05 23:10:01,386 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:10:19,844 epoch 9 - iter 265/2650 - loss 0.08822744 - time (sec): 18.46 - samples/sec: 7988.53 - lr: 0.100000 2023-04-05 23:10:38,006 epoch 9 - iter 530/2650 - loss 0.08978411 - time (sec): 36.62 - samples/sec: 7976.82 - lr: 0.100000 2023-04-05 23:10:56,344 epoch 9 - iter 795/2650 - loss 0.08897533 - time (sec): 54.96 - samples/sec: 7976.45 - lr: 0.100000 2023-04-05 23:11:14,998 epoch 9 - iter 1060/2650 - loss 0.08922332 - time (sec): 73.61 - samples/sec: 7946.54 - lr: 0.100000 2023-04-05 23:11:33,316 epoch 9 - iter 1325/2650 - loss 0.08980549 - time (sec): 91.93 - samples/sec: 7946.16 - lr: 0.100000 2023-04-05 23:11:51,494 epoch 9 - iter 1590/2650 - loss 0.08996774 - time (sec): 110.11 - samples/sec: 7972.03 - lr: 0.100000 2023-04-05 23:12:10,088 epoch 9 - iter 1855/2650 - loss 0.09004144 - time (sec): 128.70 - samples/sec: 7951.89 - lr: 0.100000 2023-04-05 23:12:28,341 epoch 9 - iter 2120/2650 - loss 0.09039116 - time (sec): 146.95 - samples/sec: 7959.35 - lr: 0.100000 2023-04-05 23:12:46,772 epoch 9 - iter 2385/2650 - loss 0.09064544 - time (sec): 165.39 - samples/sec: 7956.67 - lr: 0.100000 2023-04-05 23:13:04,782 epoch 9 - iter 2650/2650 - loss 0.09104177 - time (sec): 183.40 - samples/sec: 7973.83 - lr: 0.100000 2023-04-05 23:13:04,782 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:13:04,782 EPOCH 9 done: loss 0.0910 - lr 0.100000 2023-04-05 23:13:04,782 BAD EPOCHS (no improvement): 0 2023-04-05 23:13:04,785 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:13:22,937 epoch 10 - iter 265/2650 - loss 0.08673902 - time (sec): 18.15 - samples/sec: 7946.64 - lr: 0.100000 2023-04-05 23:13:41,194 epoch 10 - iter 530/2650 - loss 0.08800742 - time (sec): 36.41 - samples/sec: 8000.82 - lr: 0.100000 2023-04-05 23:13:59,640 epoch 10 - iter 795/2650 - loss 0.08832152 - time (sec): 54.85 - samples/sec: 7940.00 - lr: 0.100000 2023-04-05 23:14:17,864 epoch 10 - iter 1060/2650 - loss 0.08924744 - time (sec): 73.08 - samples/sec: 7947.73 - lr: 0.100000 2023-04-05 23:14:36,797 epoch 10 - iter 1325/2650 - loss 0.08939799 - time (sec): 92.01 - samples/sec: 7916.61 - lr: 0.100000 2023-04-05 23:14:55,435 epoch 10 - iter 1590/2650 - loss 0.08914923 - time (sec): 110.65 - samples/sec: 7927.22 - lr: 0.100000 2023-04-05 23:15:13,622 epoch 10 - iter 1855/2650 - loss 0.08894680 - time (sec): 128.84 - samples/sec: 7934.90 - lr: 0.100000 2023-04-05 23:15:32,112 epoch 10 - iter 2120/2650 - loss 0.08908386 - time (sec): 147.33 - samples/sec: 7938.14 - lr: 0.100000 2023-04-05 23:15:50,638 epoch 10 - iter 2385/2650 - loss 0.08923449 - time (sec): 165.85 - samples/sec: 7937.85 - lr: 0.100000 2023-04-05 23:16:08,616 epoch 10 - iter 2650/2650 - loss 0.08914841 - time (sec): 183.83 - samples/sec: 7954.95 - lr: 0.100000 2023-04-05 23:16:08,616 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:16:08,616 EPOCH 10 done: loss 0.0891 - lr 0.100000 2023-04-05 23:16:08,616 BAD EPOCHS (no improvement): 0 2023-04-05 23:16:08,619 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:16:26,885 epoch 11 - iter 265/2650 - loss 0.08727692 - time (sec): 18.27 - samples/sec: 7982.63 - lr: 0.100000 2023-04-05 23:16:45,248 epoch 11 - iter 530/2650 - loss 0.08597110 - time (sec): 36.63 - samples/sec: 7980.71 - lr: 0.100000 2023-04-05 23:17:04,039 epoch 11 - iter 795/2650 - loss 0.08538409 - time (sec): 55.42 - samples/sec: 7934.98 - lr: 0.100000 2023-04-05 23:17:22,827 epoch 11 - iter 1060/2650 - loss 0.08542385 - time (sec): 74.21 - samples/sec: 7887.11 - lr: 0.100000 2023-04-05 23:17:41,078 epoch 11 - iter 1325/2650 - loss 0.08594050 - time (sec): 92.46 - samples/sec: 7895.53 - lr: 0.100000 2023-04-05 23:17:59,392 epoch 11 - iter 1590/2650 - loss 0.08619843 - time (sec): 110.77 - samples/sec: 7919.96 - lr: 0.100000 2023-04-05 23:18:17,886 epoch 11 - iter 1855/2650 - loss 0.08636250 - time (sec): 129.27 - samples/sec: 7923.35 - lr: 0.100000 2023-04-05 23:18:35,862 epoch 11 - iter 2120/2650 - loss 0.08644832 - time (sec): 147.24 - samples/sec: 7940.40 - lr: 0.100000 2023-04-05 23:18:54,500 epoch 11 - iter 2385/2650 - loss 0.08671689 - time (sec): 165.88 - samples/sec: 7929.73 - lr: 0.100000 2023-04-05 23:19:13,180 epoch 11 - iter 2650/2650 - loss 0.08686449 - time (sec): 184.56 - samples/sec: 7923.48 - lr: 0.100000 2023-04-05 23:19:13,180 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:19:13,180 EPOCH 11 done: loss 0.0869 - lr 0.100000 2023-04-05 23:19:13,180 BAD EPOCHS (no improvement): 0 2023-04-05 23:19:13,183 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:19:32,166 epoch 12 - iter 265/2650 - loss 0.08143169 - time (sec): 18.98 - samples/sec: 7740.62 - lr: 0.100000 2023-04-05 23:19:50,897 epoch 12 - iter 530/2650 - loss 0.08243384 - time (sec): 37.71 - samples/sec: 7736.83 - lr: 0.100000 2023-04-05 23:20:09,796 epoch 12 - iter 795/2650 - loss 0.08261840 - time (sec): 56.61 - samples/sec: 7733.41 - lr: 0.100000 2023-04-05 23:20:28,827 epoch 12 - iter 1060/2650 - loss 0.08342768 - time (sec): 75.64 - samples/sec: 7714.72 - lr: 0.100000 2023-04-05 23:20:47,077 epoch 12 - iter 1325/2650 - loss 0.08353234 - time (sec): 93.89 - samples/sec: 7773.66 - lr: 0.100000 2023-04-05 23:21:05,504 epoch 12 - iter 1590/2650 - loss 0.08421554 - time (sec): 112.32 - samples/sec: 7801.60 - lr: 0.100000 2023-04-05 23:21:24,023 epoch 12 - iter 1855/2650 - loss 0.08435991 - time (sec): 130.84 - samples/sec: 7824.06 - lr: 0.100000 2023-04-05 23:21:42,492 epoch 12 - iter 2120/2650 - loss 0.08463085 - time (sec): 149.31 - samples/sec: 7830.14 - lr: 0.100000 2023-04-05 23:22:00,876 epoch 12 - iter 2385/2650 - loss 0.08463850 - time (sec): 167.69 - samples/sec: 7850.99 - lr: 0.100000 2023-04-05 23:22:18,977 epoch 12 - iter 2650/2650 - loss 0.08480300 - time (sec): 185.79 - samples/sec: 7870.89 - lr: 0.100000 2023-04-05 23:22:18,977 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:22:18,977 EPOCH 12 done: loss 0.0848 - lr 0.100000 2023-04-05 23:22:18,977 BAD EPOCHS (no improvement): 0 2023-04-05 23:22:18,980 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:22:37,416 epoch 13 - iter 265/2650 - loss 0.08213558 - time (sec): 18.44 - samples/sec: 8000.79 - lr: 0.100000 2023-04-05 23:22:55,981 epoch 13 - iter 530/2650 - loss 0.08310190 - time (sec): 37.00 - samples/sec: 7953.18 - lr: 0.100000 2023-04-05 23:23:14,230 epoch 13 - iter 795/2650 - loss 0.08217832 - time (sec): 55.25 - samples/sec: 7965.41 - lr: 0.100000 2023-04-05 23:23:32,609 epoch 13 - iter 1060/2650 - loss 0.08214670 - time (sec): 73.63 - samples/sec: 7944.38 - lr: 0.100000 2023-04-05 23:23:51,265 epoch 13 - iter 1325/2650 - loss 0.08267731 - time (sec): 92.29 - samples/sec: 7931.18 - lr: 0.100000 2023-04-05 23:24:09,788 epoch 13 - iter 1590/2650 - loss 0.08249121 - time (sec): 110.81 - samples/sec: 7932.10 - lr: 0.100000 2023-04-05 23:24:28,256 epoch 13 - iter 1855/2650 - loss 0.08254660 - time (sec): 129.28 - samples/sec: 7928.43 - lr: 0.100000 2023-04-05 23:24:46,496 epoch 13 - iter 2120/2650 - loss 0.08282352 - time (sec): 147.52 - samples/sec: 7925.33 - lr: 0.100000 2023-04-05 23:25:05,018 epoch 13 - iter 2385/2650 - loss 0.08312789 - time (sec): 166.04 - samples/sec: 7927.43 - lr: 0.100000 2023-04-05 23:25:23,352 epoch 13 - iter 2650/2650 - loss 0.08297557 - time (sec): 184.37 - samples/sec: 7931.60 - lr: 0.100000 2023-04-05 23:25:23,352 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:25:23,352 EPOCH 13 done: loss 0.0830 - lr 0.100000 2023-04-05 23:25:23,352 BAD EPOCHS (no improvement): 0 2023-04-05 23:25:23,356 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:25:41,630 epoch 14 - iter 265/2650 - loss 0.08052578 - time (sec): 18.27 - samples/sec: 8007.78 - lr: 0.100000 2023-04-05 23:26:00,535 epoch 14 - iter 530/2650 - loss 0.08045420 - time (sec): 37.18 - samples/sec: 7912.09 - lr: 0.100000 2023-04-05 23:26:18,890 epoch 14 - iter 795/2650 - loss 0.08051481 - time (sec): 55.53 - samples/sec: 7896.22 - lr: 0.100000 2023-04-05 23:26:37,636 epoch 14 - iter 1060/2650 - loss 0.08054547 - time (sec): 74.28 - samples/sec: 7891.10 - lr: 0.100000 2023-04-05 23:26:55,921 epoch 14 - iter 1325/2650 - loss 0.08049620 - time (sec): 92.57 - samples/sec: 7910.83 - lr: 0.100000 2023-04-05 23:27:14,192 epoch 14 - iter 1590/2650 - loss 0.08081324 - time (sec): 110.84 - samples/sec: 7921.94 - lr: 0.100000 2023-04-05 23:27:32,901 epoch 14 - iter 1855/2650 - loss 0.08129990 - time (sec): 129.54 - samples/sec: 7909.06 - lr: 0.100000 2023-04-05 23:27:51,560 epoch 14 - iter 2120/2650 - loss 0.08129385 - time (sec): 148.20 - samples/sec: 7890.00 - lr: 0.100000 2023-04-05 23:28:10,297 epoch 14 - iter 2385/2650 - loss 0.08133402 - time (sec): 166.94 - samples/sec: 7881.91 - lr: 0.100000 2023-04-05 23:28:28,386 epoch 14 - iter 2650/2650 - loss 0.08131564 - time (sec): 185.03 - samples/sec: 7903.36 - lr: 0.100000 2023-04-05 23:28:28,386 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:28:28,387 EPOCH 14 done: loss 0.0813 - lr 0.100000 2023-04-05 23:28:28,387 BAD EPOCHS (no improvement): 0 2023-04-05 23:28:28,390 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:28:46,670 epoch 15 - iter 265/2650 - loss 0.07965446 - time (sec): 18.28 - samples/sec: 8013.74 - lr: 0.100000 2023-04-05 23:29:05,265 epoch 15 - iter 530/2650 - loss 0.07949427 - time (sec): 36.88 - samples/sec: 7983.56 - lr: 0.100000 2023-04-05 23:29:23,615 epoch 15 - iter 795/2650 - loss 0.07996378 - time (sec): 55.23 - samples/sec: 7959.84 - lr: 0.100000 2023-04-05 23:29:42,058 epoch 15 - iter 1060/2650 - loss 0.08016941 - time (sec): 73.67 - samples/sec: 7957.08 - lr: 0.100000 2023-04-05 23:30:00,695 epoch 15 - iter 1325/2650 - loss 0.08052220 - time (sec): 92.31 - samples/sec: 7940.01 - lr: 0.100000 2023-04-05 23:30:18,945 epoch 15 - iter 1590/2650 - loss 0.08054478 - time (sec): 110.56 - samples/sec: 7946.52 - lr: 0.100000 2023-04-05 23:30:37,214 epoch 15 - iter 1855/2650 - loss 0.08040031 - time (sec): 128.82 - samples/sec: 7951.84 - lr: 0.100000 2023-04-05 23:30:55,352 epoch 15 - iter 2120/2650 - loss 0.08031253 - time (sec): 146.96 - samples/sec: 7958.58 - lr: 0.100000 2023-04-05 23:31:13,363 epoch 15 - iter 2385/2650 - loss 0.08026738 - time (sec): 164.97 - samples/sec: 7979.20 - lr: 0.100000 2023-04-05 23:31:31,465 epoch 15 - iter 2650/2650 - loss 0.08026507 - time (sec): 183.08 - samples/sec: 7987.77 - lr: 0.100000 2023-04-05 23:31:31,465 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:31:31,465 EPOCH 15 done: loss 0.0803 - lr 0.100000 2023-04-05 23:31:31,465 BAD EPOCHS (no improvement): 0 2023-04-05 23:31:31,469 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:31:49,721 epoch 16 - iter 265/2650 - loss 0.07694217 - time (sec): 18.25 - samples/sec: 7952.64 - lr: 0.100000 2023-04-05 23:32:08,137 epoch 16 - iter 530/2650 - loss 0.07711822 - time (sec): 36.67 - samples/sec: 7952.41 - lr: 0.100000 2023-04-05 23:32:26,250 epoch 16 - iter 795/2650 - loss 0.07715686 - time (sec): 54.78 - samples/sec: 7968.01 - lr: 0.100000 2023-04-05 23:32:45,287 epoch 16 - iter 1060/2650 - loss 0.07781815 - time (sec): 73.82 - samples/sec: 7913.85 - lr: 0.100000 2023-04-05 23:33:04,453 epoch 16 - iter 1325/2650 - loss 0.07848468 - time (sec): 92.98 - samples/sec: 7864.58 - lr: 0.100000 2023-04-05 23:33:23,491 epoch 16 - iter 1590/2650 - loss 0.07856699 - time (sec): 112.02 - samples/sec: 7848.77 - lr: 0.100000 2023-04-05 23:33:42,178 epoch 16 - iter 1855/2650 - loss 0.07888120 - time (sec): 130.71 - samples/sec: 7827.12 - lr: 0.100000 2023-04-05 23:34:01,308 epoch 16 - iter 2120/2650 - loss 0.07878876 - time (sec): 149.84 - samples/sec: 7811.88 - lr: 0.100000 2023-04-05 23:34:20,190 epoch 16 - iter 2385/2650 - loss 0.07885948 - time (sec): 168.72 - samples/sec: 7813.30 - lr: 0.100000 2023-04-05 23:34:38,676 epoch 16 - iter 2650/2650 - loss 0.07918859 - time (sec): 187.21 - samples/sec: 7811.46 - lr: 0.100000 2023-04-05 23:34:38,677 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:34:38,677 EPOCH 16 done: loss 0.0792 - lr 0.100000 2023-04-05 23:34:38,677 BAD EPOCHS (no improvement): 0 2023-04-05 23:34:38,680 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:34:57,269 epoch 17 - iter 265/2650 - loss 0.07404009 - time (sec): 18.59 - samples/sec: 7800.03 - lr: 0.100000 2023-04-05 23:35:15,721 epoch 17 - iter 530/2650 - loss 0.07572329 - time (sec): 37.04 - samples/sec: 7826.26 - lr: 0.100000 2023-04-05 23:35:34,473 epoch 17 - iter 795/2650 - loss 0.07566751 - time (sec): 55.79 - samples/sec: 7821.28 - lr: 0.100000 2023-04-05 23:35:52,916 epoch 17 - iter 1060/2650 - loss 0.07580164 - time (sec): 74.24 - samples/sec: 7869.82 - lr: 0.100000 2023-04-05 23:36:11,161 epoch 17 - iter 1325/2650 - loss 0.07589673 - time (sec): 92.48 - samples/sec: 7892.27 - lr: 0.100000 2023-04-05 23:36:29,213 epoch 17 - iter 1590/2650 - loss 0.07608974 - time (sec): 110.53 - samples/sec: 7911.50 - lr: 0.100000 2023-04-05 23:36:47,943 epoch 17 - iter 1855/2650 - loss 0.07665730 - time (sec): 129.26 - samples/sec: 7897.86 - lr: 0.100000 2023-04-05 23:37:05,989 epoch 17 - iter 2120/2650 - loss 0.07693524 - time (sec): 147.31 - samples/sec: 7922.19 - lr: 0.100000 2023-04-05 23:37:24,575 epoch 17 - iter 2385/2650 - loss 0.07734117 - time (sec): 165.89 - samples/sec: 7927.30 - lr: 0.100000 2023-04-05 23:37:42,976 epoch 17 - iter 2650/2650 - loss 0.07759856 - time (sec): 184.30 - samples/sec: 7934.85 - lr: 0.100000 2023-04-05 23:37:42,977 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:37:42,977 EPOCH 17 done: loss 0.0776 - lr 0.100000 2023-04-05 23:37:42,977 BAD EPOCHS (no improvement): 0 2023-04-05 23:37:42,980 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:38:00,791 epoch 18 - iter 265/2650 - loss 0.07173608 - time (sec): 17.81 - samples/sec: 8047.03 - lr: 0.100000 2023-04-05 23:38:19,104 epoch 18 - iter 530/2650 - loss 0.07348974 - time (sec): 36.12 - samples/sec: 7985.50 - lr: 0.100000 2023-04-05 23:38:37,567 epoch 18 - iter 795/2650 - loss 0.07377145 - time (sec): 54.59 - samples/sec: 7999.53 - lr: 0.100000 2023-04-05 23:38:55,514 epoch 18 - iter 1060/2650 - loss 0.07405250 - time (sec): 72.53 - samples/sec: 8008.44 - lr: 0.100000 2023-04-05 23:39:13,694 epoch 18 - iter 1325/2650 - loss 0.07444593 - time (sec): 90.71 - samples/sec: 8024.73 - lr: 0.100000 2023-04-05 23:39:31,815 epoch 18 - iter 1590/2650 - loss 0.07497161 - time (sec): 108.83 - samples/sec: 8037.58 - lr: 0.100000 2023-04-05 23:39:50,592 epoch 18 - iter 1855/2650 - loss 0.07529134 - time (sec): 127.61 - samples/sec: 8023.11 - lr: 0.100000 2023-04-05 23:40:08,836 epoch 18 - iter 2120/2650 - loss 0.07568795 - time (sec): 145.86 - samples/sec: 8018.28 - lr: 0.100000 2023-04-05 23:40:27,087 epoch 18 - iter 2385/2650 - loss 0.07605910 - time (sec): 164.11 - samples/sec: 8017.43 - lr: 0.100000 2023-04-05 23:40:45,254 epoch 18 - iter 2650/2650 - loss 0.07608446 - time (sec): 182.27 - samples/sec: 8022.88 - lr: 0.100000 2023-04-05 23:40:45,254 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:40:45,254 EPOCH 18 done: loss 0.0761 - lr 0.100000 2023-04-05 23:40:45,254 BAD EPOCHS (no improvement): 0 2023-04-05 23:40:45,257 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:41:02,986 epoch 19 - iter 265/2650 - loss 0.06996890 - time (sec): 17.73 - samples/sec: 8160.99 - lr: 0.100000 2023-04-05 23:41:21,601 epoch 19 - iter 530/2650 - loss 0.07185279 - time (sec): 36.34 - samples/sec: 8021.53 - lr: 0.100000 2023-04-05 23:41:40,318 epoch 19 - iter 795/2650 - loss 0.07271068 - time (sec): 55.06 - samples/sec: 7974.67 - lr: 0.100000 2023-04-05 23:41:58,500 epoch 19 - iter 1060/2650 - loss 0.07358117 - time (sec): 73.24 - samples/sec: 7979.82 - lr: 0.100000 2023-04-05 23:42:16,969 epoch 19 - iter 1325/2650 - loss 0.07389754 - time (sec): 91.71 - samples/sec: 7960.47 - lr: 0.100000 2023-04-05 23:42:35,273 epoch 19 - iter 1590/2650 - loss 0.07410618 - time (sec): 110.02 - samples/sec: 7969.09 - lr: 0.100000 2023-04-05 23:42:53,346 epoch 19 - iter 1855/2650 - loss 0.07416789 - time (sec): 128.09 - samples/sec: 7993.74 - lr: 0.100000 2023-04-05 23:43:11,519 epoch 19 - iter 2120/2650 - loss 0.07422343 - time (sec): 146.26 - samples/sec: 7992.44 - lr: 0.100000 2023-04-05 23:43:30,091 epoch 19 - iter 2385/2650 - loss 0.07463452 - time (sec): 164.83 - samples/sec: 7987.83 - lr: 0.100000 2023-04-05 23:43:48,348 epoch 19 - iter 2650/2650 - loss 0.07499521 - time (sec): 183.09 - samples/sec: 7987.10 - lr: 0.100000 2023-04-05 23:43:48,348 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:43:48,348 EPOCH 19 done: loss 0.0750 - lr 0.100000 2023-04-05 23:43:48,348 BAD EPOCHS (no improvement): 0 2023-04-05 23:43:48,351 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:44:06,600 epoch 20 - iter 265/2650 - loss 0.07239405 - time (sec): 18.25 - samples/sec: 7978.32 - lr: 0.100000 2023-04-05 23:44:24,769 epoch 20 - iter 530/2650 - loss 0.07312747 - time (sec): 36.42 - samples/sec: 7995.00 - lr: 0.100000 2023-04-05 23:44:43,133 epoch 20 - iter 795/2650 - loss 0.07277146 - time (sec): 54.78 - samples/sec: 7981.68 - lr: 0.100000 2023-04-05 23:45:01,110 epoch 20 - iter 1060/2650 - loss 0.07339740 - time (sec): 72.76 - samples/sec: 8005.32 - lr: 0.100000 2023-04-05 23:45:19,536 epoch 20 - iter 1325/2650 - loss 0.07330120 - time (sec): 91.19 - samples/sec: 7979.36 - lr: 0.100000 2023-04-05 23:45:37,919 epoch 20 - iter 1590/2650 - loss 0.07425713 - time (sec): 109.57 - samples/sec: 7970.67 - lr: 0.100000 2023-04-05 23:45:56,138 epoch 20 - iter 1855/2650 - loss 0.07458860 - time (sec): 127.79 - samples/sec: 7980.79 - lr: 0.100000 2023-04-05 23:46:14,965 epoch 20 - iter 2120/2650 - loss 0.07449160 - time (sec): 146.61 - samples/sec: 7965.24 - lr: 0.100000 2023-04-05 23:46:33,488 epoch 20 - iter 2385/2650 - loss 0.07467500 - time (sec): 165.14 - samples/sec: 7966.59 - lr: 0.100000 2023-04-05 23:46:51,988 epoch 20 - iter 2650/2650 - loss 0.07482779 - time (sec): 183.64 - samples/sec: 7963.32 - lr: 0.100000 2023-04-05 23:46:51,988 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:46:51,988 EPOCH 20 done: loss 0.0748 - lr 0.100000 2023-04-05 23:46:51,988 BAD EPOCHS (no improvement): 0 2023-04-05 23:46:51,992 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:47:10,601 epoch 21 - iter 265/2650 - loss 0.07277794 - time (sec): 18.61 - samples/sec: 7909.36 - lr: 0.100000 2023-04-05 23:47:28,986 epoch 21 - iter 530/2650 - loss 0.07292828 - time (sec): 36.99 - samples/sec: 7885.57 - lr: 0.100000 2023-04-05 23:47:47,263 epoch 21 - iter 795/2650 - loss 0.07319112 - time (sec): 55.27 - samples/sec: 7916.26 - lr: 0.100000 2023-04-05 23:48:05,984 epoch 21 - iter 1060/2650 - loss 0.07284596 - time (sec): 73.99 - samples/sec: 7900.82 - lr: 0.100000 2023-04-05 23:48:24,445 epoch 21 - iter 1325/2650 - loss 0.07289517 - time (sec): 92.45 - samples/sec: 7898.36 - lr: 0.100000 2023-04-05 23:48:43,157 epoch 21 - iter 1590/2650 - loss 0.07321167 - time (sec): 111.16 - samples/sec: 7901.65 - lr: 0.100000 2023-04-05 23:49:01,511 epoch 21 - iter 1855/2650 - loss 0.07347231 - time (sec): 129.52 - samples/sec: 7918.49 - lr: 0.100000 2023-04-05 23:49:19,535 epoch 21 - iter 2120/2650 - loss 0.07394013 - time (sec): 147.54 - samples/sec: 7938.60 - lr: 0.100000 2023-04-05 23:49:38,146 epoch 21 - iter 2385/2650 - loss 0.07389364 - time (sec): 166.15 - samples/sec: 7931.32 - lr: 0.100000 2023-04-05 23:49:56,435 epoch 21 - iter 2650/2650 - loss 0.07402003 - time (sec): 184.44 - samples/sec: 7928.52 - lr: 0.100000 2023-04-05 23:49:56,435 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:49:56,435 EPOCH 21 done: loss 0.0740 - lr 0.100000 2023-04-05 23:49:56,435 BAD EPOCHS (no improvement): 0 2023-04-05 23:49:56,439 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:50:14,692 epoch 22 - iter 265/2650 - loss 0.06890101 - time (sec): 18.25 - samples/sec: 7969.71 - lr: 0.100000 2023-04-05 23:50:32,934 epoch 22 - iter 530/2650 - loss 0.07036209 - time (sec): 36.50 - samples/sec: 7986.50 - lr: 0.100000 2023-04-05 23:50:51,299 epoch 22 - iter 795/2650 - loss 0.07103810 - time (sec): 54.86 - samples/sec: 7977.60 - lr: 0.100000 2023-04-05 23:51:09,809 epoch 22 - iter 1060/2650 - loss 0.07177489 - time (sec): 73.37 - samples/sec: 7978.79 - lr: 0.100000 2023-04-05 23:51:27,865 epoch 22 - iter 1325/2650 - loss 0.07209124 - time (sec): 91.43 - samples/sec: 7991.34 - lr: 0.100000 2023-04-05 23:51:46,581 epoch 22 - iter 1590/2650 - loss 0.07246870 - time (sec): 110.14 - samples/sec: 7962.12 - lr: 0.100000 2023-04-05 23:52:04,808 epoch 22 - iter 1855/2650 - loss 0.07263842 - time (sec): 128.37 - samples/sec: 7968.88 - lr: 0.100000 2023-04-05 23:52:23,443 epoch 22 - iter 2120/2650 - loss 0.07276414 - time (sec): 147.00 - samples/sec: 7962.23 - lr: 0.100000 2023-04-05 23:52:41,660 epoch 22 - iter 2385/2650 - loss 0.07303221 - time (sec): 165.22 - samples/sec: 7968.49 - lr: 0.100000 2023-04-05 23:52:59,878 epoch 22 - iter 2650/2650 - loss 0.07322424 - time (sec): 183.44 - samples/sec: 7971.92 - lr: 0.100000 2023-04-05 23:52:59,878 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:52:59,878 EPOCH 22 done: loss 0.0732 - lr 0.100000 2023-04-05 23:52:59,879 BAD EPOCHS (no improvement): 0 2023-04-05 23:52:59,882 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:53:18,283 epoch 23 - iter 265/2650 - loss 0.07255444 - time (sec): 18.40 - samples/sec: 7871.10 - lr: 0.100000 2023-04-05 23:53:37,061 epoch 23 - iter 530/2650 - loss 0.07246264 - time (sec): 37.18 - samples/sec: 7855.77 - lr: 0.100000 2023-04-05 23:53:55,432 epoch 23 - iter 795/2650 - loss 0.07166387 - time (sec): 55.55 - samples/sec: 7902.77 - lr: 0.100000 2023-04-05 23:54:13,596 epoch 23 - iter 1060/2650 - loss 0.07196130 - time (sec): 73.71 - samples/sec: 7956.71 - lr: 0.100000 2023-04-05 23:54:31,697 epoch 23 - iter 1325/2650 - loss 0.07258746 - time (sec): 91.81 - samples/sec: 7971.36 - lr: 0.100000 2023-04-05 23:54:50,110 epoch 23 - iter 1590/2650 - loss 0.07251662 - time (sec): 110.23 - samples/sec: 7959.31 - lr: 0.100000 2023-04-05 23:55:08,693 epoch 23 - iter 1855/2650 - loss 0.07240332 - time (sec): 128.81 - samples/sec: 7960.69 - lr: 0.100000 2023-04-05 23:55:26,994 epoch 23 - iter 2120/2650 - loss 0.07250828 - time (sec): 147.11 - samples/sec: 7955.58 - lr: 0.100000 2023-04-05 23:55:45,450 epoch 23 - iter 2385/2650 - loss 0.07256935 - time (sec): 165.57 - samples/sec: 7953.39 - lr: 0.100000 2023-04-05 23:56:03,490 epoch 23 - iter 2650/2650 - loss 0.07269747 - time (sec): 183.61 - samples/sec: 7964.60 - lr: 0.100000 2023-04-05 23:56:03,490 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:56:03,490 EPOCH 23 done: loss 0.0727 - lr 0.100000 2023-04-05 23:56:03,490 BAD EPOCHS (no improvement): 0 2023-04-05 23:56:03,493 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:56:21,967 epoch 24 - iter 265/2650 - loss 0.06811492 - time (sec): 18.47 - samples/sec: 7931.23 - lr: 0.100000 2023-04-05 23:56:40,186 epoch 24 - iter 530/2650 - loss 0.06857999 - time (sec): 36.69 - samples/sec: 7965.96 - lr: 0.100000 2023-04-05 23:56:58,545 epoch 24 - iter 795/2650 - loss 0.06942220 - time (sec): 55.05 - samples/sec: 7942.02 - lr: 0.100000 2023-04-05 23:57:16,721 epoch 24 - iter 1060/2650 - loss 0.07004512 - time (sec): 73.23 - samples/sec: 7954.06 - lr: 0.100000 2023-04-05 23:57:35,353 epoch 24 - iter 1325/2650 - loss 0.07088688 - time (sec): 91.86 - samples/sec: 7954.12 - lr: 0.100000 2023-04-05 23:57:53,368 epoch 24 - iter 1590/2650 - loss 0.07067823 - time (sec): 109.87 - samples/sec: 7977.15 - lr: 0.100000 2023-04-05 23:58:12,243 epoch 24 - iter 1855/2650 - loss 0.07081593 - time (sec): 128.75 - samples/sec: 7957.98 - lr: 0.100000 2023-04-05 23:58:30,652 epoch 24 - iter 2120/2650 - loss 0.07105703 - time (sec): 147.16 - samples/sec: 7954.65 - lr: 0.100000 2023-04-05 23:58:49,302 epoch 24 - iter 2385/2650 - loss 0.07103085 - time (sec): 165.81 - samples/sec: 7951.28 - lr: 0.100000 2023-04-05 23:59:07,305 epoch 24 - iter 2650/2650 - loss 0.07123641 - time (sec): 183.81 - samples/sec: 7955.75 - lr: 0.100000 2023-04-05 23:59:07,306 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:59:07,306 EPOCH 24 done: loss 0.0712 - lr 0.100000 2023-04-05 23:59:07,306 BAD EPOCHS (no improvement): 0 2023-04-05 23:59:07,309 ---------------------------------------------------------------------------------------------------- 2023-04-05 23:59:25,681 epoch 25 - iter 265/2650 - loss 0.06766185 - time (sec): 18.37 - samples/sec: 7883.52 - lr: 0.100000 2023-04-05 23:59:44,055 epoch 25 - iter 530/2650 - loss 0.06852954 - time (sec): 36.75 - samples/sec: 7890.29 - lr: 0.100000 2023-04-06 00:00:02,244 epoch 25 - iter 795/2650 - loss 0.06920908 - time (sec): 54.93 - samples/sec: 7941.01 - lr: 0.100000 2023-04-06 00:00:20,038 epoch 25 - iter 1060/2650 - loss 0.07018279 - time (sec): 72.73 - samples/sec: 8000.68 - lr: 0.100000 2023-04-06 00:00:38,538 epoch 25 - iter 1325/2650 - loss 0.07032197 - time (sec): 91.23 - samples/sec: 7996.26 - lr: 0.100000 2023-04-06 00:00:57,451 epoch 25 - iter 1590/2650 - loss 0.07037670 - time (sec): 110.14 - samples/sec: 7975.32 - lr: 0.100000 2023-04-06 00:01:15,678 epoch 25 - iter 1855/2650 - loss 0.07051909 - time (sec): 128.37 - samples/sec: 7974.77 - lr: 0.100000 2023-04-06 00:01:34,270 epoch 25 - iter 2120/2650 - loss 0.07079282 - time (sec): 146.96 - samples/sec: 7953.43 - lr: 0.100000 2023-04-06 00:01:52,335 epoch 25 - iter 2385/2650 - loss 0.07073224 - time (sec): 165.03 - samples/sec: 7968.40 - lr: 0.100000 2023-04-06 00:02:10,540 epoch 25 - iter 2650/2650 - loss 0.07098012 - time (sec): 183.23 - samples/sec: 7981.02 - lr: 0.100000 2023-04-06 00:02:10,540 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:02:10,540 EPOCH 25 done: loss 0.0710 - lr 0.100000 2023-04-06 00:02:10,540 BAD EPOCHS (no improvement): 0 2023-04-06 00:02:10,543 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:02:29,143 epoch 26 - iter 265/2650 - loss 0.06772594 - time (sec): 18.60 - samples/sec: 7835.74 - lr: 0.100000 2023-04-06 00:02:47,374 epoch 26 - iter 530/2650 - loss 0.06866523 - time (sec): 36.83 - samples/sec: 7888.64 - lr: 0.100000 2023-04-06 00:03:06,169 epoch 26 - iter 795/2650 - loss 0.06893773 - time (sec): 55.63 - samples/sec: 7866.26 - lr: 0.100000 2023-04-06 00:03:24,676 epoch 26 - iter 1060/2650 - loss 0.06885092 - time (sec): 74.13 - samples/sec: 7870.09 - lr: 0.100000 2023-04-06 00:03:44,003 epoch 26 - iter 1325/2650 - loss 0.06904910 - time (sec): 93.46 - samples/sec: 7829.06 - lr: 0.100000 2023-04-06 00:04:02,982 epoch 26 - iter 1590/2650 - loss 0.06936046 - time (sec): 112.44 - samples/sec: 7815.27 - lr: 0.100000 2023-04-06 00:04:21,663 epoch 26 - iter 1855/2650 - loss 0.06970694 - time (sec): 131.12 - samples/sec: 7812.28 - lr: 0.100000 2023-04-06 00:04:40,543 epoch 26 - iter 2120/2650 - loss 0.06983618 - time (sec): 150.00 - samples/sec: 7804.64 - lr: 0.100000 2023-04-06 00:04:59,078 epoch 26 - iter 2385/2650 - loss 0.07000170 - time (sec): 168.53 - samples/sec: 7803.22 - lr: 0.100000 2023-04-06 00:05:17,696 epoch 26 - iter 2650/2650 - loss 0.07016642 - time (sec): 187.15 - samples/sec: 7813.75 - lr: 0.100000 2023-04-06 00:05:17,696 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:05:17,696 EPOCH 26 done: loss 0.0702 - lr 0.100000 2023-04-06 00:05:17,696 BAD EPOCHS (no improvement): 0 2023-04-06 00:05:17,699 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:05:36,048 epoch 27 - iter 265/2650 - loss 0.06907675 - time (sec): 18.35 - samples/sec: 7800.91 - lr: 0.100000 2023-04-06 00:05:55,140 epoch 27 - iter 530/2650 - loss 0.06954160 - time (sec): 37.44 - samples/sec: 7768.99 - lr: 0.100000 2023-04-06 00:06:13,933 epoch 27 - iter 795/2650 - loss 0.06984016 - time (sec): 56.23 - samples/sec: 7759.80 - lr: 0.100000 2023-04-06 00:06:32,472 epoch 27 - iter 1060/2650 - loss 0.06949111 - time (sec): 74.77 - samples/sec: 7812.45 - lr: 0.100000 2023-04-06 00:06:50,909 epoch 27 - iter 1325/2650 - loss 0.06926082 - time (sec): 93.21 - samples/sec: 7847.72 - lr: 0.100000 2023-04-06 00:07:09,384 epoch 27 - iter 1590/2650 - loss 0.06968345 - time (sec): 111.69 - samples/sec: 7857.68 - lr: 0.100000 2023-04-06 00:07:27,402 epoch 27 - iter 1855/2650 - loss 0.06978394 - time (sec): 129.70 - samples/sec: 7896.75 - lr: 0.100000 2023-04-06 00:07:45,597 epoch 27 - iter 2120/2650 - loss 0.07033578 - time (sec): 147.90 - samples/sec: 7910.81 - lr: 0.100000 2023-04-06 00:08:04,102 epoch 27 - iter 2385/2650 - loss 0.07019532 - time (sec): 166.40 - samples/sec: 7905.39 - lr: 0.100000 2023-04-06 00:08:22,460 epoch 27 - iter 2650/2650 - loss 0.07017281 - time (sec): 184.76 - samples/sec: 7914.91 - lr: 0.100000 2023-04-06 00:08:22,460 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:08:22,460 EPOCH 27 done: loss 0.0702 - lr 0.100000 2023-04-06 00:08:22,460 BAD EPOCHS (no improvement): 1 2023-04-06 00:08:22,463 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:08:40,606 epoch 28 - iter 265/2650 - loss 0.06516409 - time (sec): 18.14 - samples/sec: 8095.37 - lr: 0.100000 2023-04-06 00:08:59,164 epoch 28 - iter 530/2650 - loss 0.06646116 - time (sec): 36.70 - samples/sec: 8003.70 - lr: 0.100000 2023-04-06 00:09:17,927 epoch 28 - iter 795/2650 - loss 0.06650690 - time (sec): 55.46 - samples/sec: 7971.67 - lr: 0.100000 2023-04-06 00:09:36,569 epoch 28 - iter 1060/2650 - loss 0.06695100 - time (sec): 74.11 - samples/sec: 7951.13 - lr: 0.100000 2023-04-06 00:09:54,746 epoch 28 - iter 1325/2650 - loss 0.06752726 - time (sec): 92.28 - samples/sec: 7956.20 - lr: 0.100000 2023-04-06 00:10:13,047 epoch 28 - iter 1590/2650 - loss 0.06778264 - time (sec): 110.58 - samples/sec: 7957.85 - lr: 0.100000 2023-04-06 00:10:31,028 epoch 28 - iter 1855/2650 - loss 0.06827956 - time (sec): 128.56 - samples/sec: 7973.66 - lr: 0.100000 2023-04-06 00:10:48,942 epoch 28 - iter 2120/2650 - loss 0.06845002 - time (sec): 146.48 - samples/sec: 7983.70 - lr: 0.100000 2023-04-06 00:11:07,547 epoch 28 - iter 2385/2650 - loss 0.06874613 - time (sec): 165.08 - samples/sec: 7970.51 - lr: 0.100000 2023-04-06 00:11:26,004 epoch 28 - iter 2650/2650 - loss 0.06893500 - time (sec): 183.54 - samples/sec: 7967.50 - lr: 0.100000 2023-04-06 00:11:26,005 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:11:26,005 EPOCH 28 done: loss 0.0689 - lr 0.100000 2023-04-06 00:11:26,005 BAD EPOCHS (no improvement): 0 2023-04-06 00:11:26,007 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:11:44,431 epoch 29 - iter 265/2650 - loss 0.06717506 - time (sec): 18.42 - samples/sec: 7976.70 - lr: 0.100000 2023-04-06 00:12:02,701 epoch 29 - iter 530/2650 - loss 0.06624343 - time (sec): 36.69 - samples/sec: 7960.71 - lr: 0.100000 2023-04-06 00:12:20,891 epoch 29 - iter 795/2650 - loss 0.06738180 - time (sec): 54.88 - samples/sec: 7985.31 - lr: 0.100000 2023-04-06 00:12:39,019 epoch 29 - iter 1060/2650 - loss 0.06722053 - time (sec): 73.01 - samples/sec: 8017.25 - lr: 0.100000 2023-04-06 00:12:57,356 epoch 29 - iter 1325/2650 - loss 0.06781936 - time (sec): 91.35 - samples/sec: 8016.06 - lr: 0.100000 2023-04-06 00:13:15,729 epoch 29 - iter 1590/2650 - loss 0.06843229 - time (sec): 109.72 - samples/sec: 8001.40 - lr: 0.100000 2023-04-06 00:13:34,135 epoch 29 - iter 1855/2650 - loss 0.06848774 - time (sec): 128.13 - samples/sec: 7987.52 - lr: 0.100000 2023-04-06 00:13:52,348 epoch 29 - iter 2120/2650 - loss 0.06844401 - time (sec): 146.34 - samples/sec: 7992.80 - lr: 0.100000 2023-04-06 00:14:10,767 epoch 29 - iter 2385/2650 - loss 0.06874161 - time (sec): 164.76 - samples/sec: 7981.75 - lr: 0.100000 2023-04-06 00:14:29,643 epoch 29 - iter 2650/2650 - loss 0.06873252 - time (sec): 183.64 - samples/sec: 7963.40 - lr: 0.100000 2023-04-06 00:14:29,643 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:14:29,643 EPOCH 29 done: loss 0.0687 - lr 0.100000 2023-04-06 00:14:29,643 BAD EPOCHS (no improvement): 0 2023-04-06 00:14:29,647 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:14:48,515 epoch 30 - iter 265/2650 - loss 0.06630602 - time (sec): 18.87 - samples/sec: 7770.48 - lr: 0.100000 2023-04-06 00:15:06,441 epoch 30 - iter 530/2650 - loss 0.06580521 - time (sec): 36.79 - samples/sec: 7925.65 - lr: 0.100000 2023-04-06 00:15:24,893 epoch 30 - iter 795/2650 - loss 0.06579015 - time (sec): 55.25 - samples/sec: 7921.63 - lr: 0.100000 2023-04-06 00:15:43,188 epoch 30 - iter 1060/2650 - loss 0.06625549 - time (sec): 73.54 - samples/sec: 7935.88 - lr: 0.100000 2023-04-06 00:16:01,590 epoch 30 - iter 1325/2650 - loss 0.06656824 - time (sec): 91.94 - samples/sec: 7940.35 - lr: 0.100000 2023-04-06 00:16:19,855 epoch 30 - iter 1590/2650 - loss 0.06735726 - time (sec): 110.21 - samples/sec: 7967.13 - lr: 0.100000 2023-04-06 00:16:38,323 epoch 30 - iter 1855/2650 - loss 0.06777783 - time (sec): 128.68 - samples/sec: 7955.07 - lr: 0.100000 2023-04-06 00:16:56,599 epoch 30 - iter 2120/2650 - loss 0.06792964 - time (sec): 146.95 - samples/sec: 7966.76 - lr: 0.100000 2023-04-06 00:17:14,616 epoch 30 - iter 2385/2650 - loss 0.06785617 - time (sec): 164.97 - samples/sec: 7971.62 - lr: 0.100000 2023-04-06 00:17:32,937 epoch 30 - iter 2650/2650 - loss 0.06814635 - time (sec): 183.29 - samples/sec: 7978.40 - lr: 0.100000 2023-04-06 00:17:32,937 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:17:32,938 EPOCH 30 done: loss 0.0681 - lr 0.100000 2023-04-06 00:17:32,938 BAD EPOCHS (no improvement): 0 2023-04-06 00:17:32,941 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:17:50,997 epoch 31 - iter 265/2650 - loss 0.06510865 - time (sec): 18.06 - samples/sec: 8051.05 - lr: 0.100000 2023-04-06 00:18:09,276 epoch 31 - iter 530/2650 - loss 0.06586899 - time (sec): 36.33 - samples/sec: 8020.44 - lr: 0.100000 2023-04-06 00:18:27,823 epoch 31 - iter 795/2650 - loss 0.06629463 - time (sec): 54.88 - samples/sec: 7987.48 - lr: 0.100000 2023-04-06 00:18:45,717 epoch 31 - iter 1060/2650 - loss 0.06643157 - time (sec): 72.78 - samples/sec: 8035.54 - lr: 0.100000 2023-04-06 00:19:03,999 epoch 31 - iter 1325/2650 - loss 0.06649515 - time (sec): 91.06 - samples/sec: 8015.59 - lr: 0.100000 2023-04-06 00:19:22,779 epoch 31 - iter 1590/2650 - loss 0.06677811 - time (sec): 109.84 - samples/sec: 7995.25 - lr: 0.100000 2023-04-06 00:19:40,989 epoch 31 - iter 1855/2650 - loss 0.06705824 - time (sec): 128.05 - samples/sec: 8007.27 - lr: 0.100000 2023-04-06 00:19:59,359 epoch 31 - iter 2120/2650 - loss 0.06727299 - time (sec): 146.42 - samples/sec: 8008.25 - lr: 0.100000 2023-04-06 00:20:17,782 epoch 31 - iter 2385/2650 - loss 0.06748156 - time (sec): 164.84 - samples/sec: 7998.41 - lr: 0.100000 2023-04-06 00:20:35,618 epoch 31 - iter 2650/2650 - loss 0.06771645 - time (sec): 182.68 - samples/sec: 8005.17 - lr: 0.100000 2023-04-06 00:20:35,618 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:20:35,618 EPOCH 31 done: loss 0.0677 - lr 0.100000 2023-04-06 00:20:35,619 BAD EPOCHS (no improvement): 0 2023-04-06 00:20:35,622 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:20:53,855 epoch 32 - iter 265/2650 - loss 0.06484387 - time (sec): 18.23 - samples/sec: 7967.84 - lr: 0.100000 2023-04-06 00:21:12,142 epoch 32 - iter 530/2650 - loss 0.06491631 - time (sec): 36.52 - samples/sec: 7985.20 - lr: 0.100000 2023-04-06 00:21:30,070 epoch 32 - iter 795/2650 - loss 0.06557492 - time (sec): 54.45 - samples/sec: 8020.82 - lr: 0.100000 2023-04-06 00:21:48,912 epoch 32 - iter 1060/2650 - loss 0.06598723 - time (sec): 73.29 - samples/sec: 7952.88 - lr: 0.100000 2023-04-06 00:22:07,446 epoch 32 - iter 1325/2650 - loss 0.06634479 - time (sec): 91.82 - samples/sec: 7927.29 - lr: 0.100000 2023-04-06 00:22:26,277 epoch 32 - iter 1590/2650 - loss 0.06641823 - time (sec): 110.66 - samples/sec: 7915.70 - lr: 0.100000 2023-04-06 00:22:45,023 epoch 32 - iter 1855/2650 - loss 0.06666293 - time (sec): 129.40 - samples/sec: 7910.15 - lr: 0.100000 2023-04-06 00:23:03,683 epoch 32 - iter 2120/2650 - loss 0.06704473 - time (sec): 148.06 - samples/sec: 7897.07 - lr: 0.100000 2023-04-06 00:23:21,423 epoch 32 - iter 2385/2650 - loss 0.06713196 - time (sec): 165.80 - samples/sec: 7923.25 - lr: 0.100000 2023-04-06 00:23:39,971 epoch 32 - iter 2650/2650 - loss 0.06726392 - time (sec): 184.35 - samples/sec: 7932.56 - lr: 0.100000 2023-04-06 00:23:39,972 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:23:39,972 EPOCH 32 done: loss 0.0673 - lr 0.100000 2023-04-06 00:23:39,972 BAD EPOCHS (no improvement): 0 2023-04-06 00:23:39,976 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:23:58,467 epoch 33 - iter 265/2650 - loss 0.06499129 - time (sec): 18.49 - samples/sec: 7949.71 - lr: 0.100000 2023-04-06 00:24:16,941 epoch 33 - iter 530/2650 - loss 0.06575125 - time (sec): 36.96 - samples/sec: 7922.39 - lr: 0.100000 2023-04-06 00:24:35,290 epoch 33 - iter 795/2650 - loss 0.06653977 - time (sec): 55.31 - samples/sec: 7933.32 - lr: 0.100000 2023-04-06 00:24:53,820 epoch 33 - iter 1060/2650 - loss 0.06662860 - time (sec): 73.84 - samples/sec: 7931.50 - lr: 0.100000 2023-04-06 00:25:12,045 epoch 33 - iter 1325/2650 - loss 0.06669767 - time (sec): 92.07 - samples/sec: 7933.14 - lr: 0.100000 2023-04-06 00:25:30,565 epoch 33 - iter 1590/2650 - loss 0.06711239 - time (sec): 110.59 - samples/sec: 7932.00 - lr: 0.100000 2023-04-06 00:25:49,191 epoch 33 - iter 1855/2650 - loss 0.06732658 - time (sec): 129.21 - samples/sec: 7930.96 - lr: 0.100000 2023-04-06 00:26:07,361 epoch 33 - iter 2120/2650 - loss 0.06741494 - time (sec): 147.38 - samples/sec: 7939.35 - lr: 0.100000 2023-04-06 00:26:25,721 epoch 33 - iter 2385/2650 - loss 0.06750640 - time (sec): 165.74 - samples/sec: 7939.92 - lr: 0.100000 2023-04-06 00:26:44,139 epoch 33 - iter 2650/2650 - loss 0.06747276 - time (sec): 184.16 - samples/sec: 7940.59 - lr: 0.100000 2023-04-06 00:26:44,140 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:26:44,140 EPOCH 33 done: loss 0.0675 - lr 0.100000 2023-04-06 00:26:44,140 BAD EPOCHS (no improvement): 1 2023-04-06 00:26:44,145 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:27:02,418 epoch 34 - iter 265/2650 - loss 0.06597648 - time (sec): 18.27 - samples/sec: 8065.67 - lr: 0.100000 2023-04-06 00:27:20,976 epoch 34 - iter 530/2650 - loss 0.06515025 - time (sec): 36.83 - samples/sec: 7956.12 - lr: 0.100000 2023-04-06 00:27:39,323 epoch 34 - iter 795/2650 - loss 0.06573558 - time (sec): 55.18 - samples/sec: 7974.57 - lr: 0.100000 2023-04-06 00:27:57,963 epoch 34 - iter 1060/2650 - loss 0.06573192 - time (sec): 73.82 - samples/sec: 7942.86 - lr: 0.100000 2023-04-06 00:28:16,349 epoch 34 - iter 1325/2650 - loss 0.06607877 - time (sec): 92.20 - samples/sec: 7952.86 - lr: 0.100000 2023-04-06 00:28:34,606 epoch 34 - iter 1590/2650 - loss 0.06621640 - time (sec): 110.46 - samples/sec: 7956.65 - lr: 0.100000 2023-04-06 00:28:53,313 epoch 34 - iter 1855/2650 - loss 0.06633485 - time (sec): 129.17 - samples/sec: 7918.62 - lr: 0.100000 2023-04-06 00:29:11,897 epoch 34 - iter 2120/2650 - loss 0.06654360 - time (sec): 147.75 - samples/sec: 7912.31 - lr: 0.100000 2023-04-06 00:29:31,040 epoch 34 - iter 2385/2650 - loss 0.06662285 - time (sec): 166.90 - samples/sec: 7895.49 - lr: 0.100000 2023-04-06 00:29:49,324 epoch 34 - iter 2650/2650 - loss 0.06676164 - time (sec): 185.18 - samples/sec: 7897.01 - lr: 0.100000 2023-04-06 00:29:49,325 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:29:49,325 EPOCH 34 done: loss 0.0668 - lr 0.100000 2023-04-06 00:29:49,325 BAD EPOCHS (no improvement): 0 2023-04-06 00:29:49,328 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:30:08,061 epoch 35 - iter 265/2650 - loss 0.06466170 - time (sec): 18.73 - samples/sec: 7807.64 - lr: 0.100000 2023-04-06 00:30:26,667 epoch 35 - iter 530/2650 - loss 0.06514267 - time (sec): 37.34 - samples/sec: 7834.86 - lr: 0.100000 2023-04-06 00:30:45,129 epoch 35 - iter 795/2650 - loss 0.06526747 - time (sec): 55.80 - samples/sec: 7845.64 - lr: 0.100000 2023-04-06 00:31:03,338 epoch 35 - iter 1060/2650 - loss 0.06492044 - time (sec): 74.01 - samples/sec: 7876.34 - lr: 0.100000 2023-04-06 00:31:21,875 epoch 35 - iter 1325/2650 - loss 0.06507791 - time (sec): 92.55 - samples/sec: 7900.51 - lr: 0.100000 2023-04-06 00:31:40,212 epoch 35 - iter 1590/2650 - loss 0.06523842 - time (sec): 110.88 - samples/sec: 7905.56 - lr: 0.100000 2023-04-06 00:31:58,698 epoch 35 - iter 1855/2650 - loss 0.06530296 - time (sec): 129.37 - samples/sec: 7902.95 - lr: 0.100000 2023-04-06 00:32:17,323 epoch 35 - iter 2120/2650 - loss 0.06540566 - time (sec): 147.99 - samples/sec: 7906.26 - lr: 0.100000 2023-04-06 00:32:35,518 epoch 35 - iter 2385/2650 - loss 0.06578493 - time (sec): 166.19 - samples/sec: 7916.44 - lr: 0.100000 2023-04-06 00:32:53,839 epoch 35 - iter 2650/2650 - loss 0.06608655 - time (sec): 184.51 - samples/sec: 7925.63 - lr: 0.100000 2023-04-06 00:32:53,839 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:32:53,839 EPOCH 35 done: loss 0.0661 - lr 0.100000 2023-04-06 00:32:53,839 BAD EPOCHS (no improvement): 0 2023-04-06 00:32:53,842 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:33:12,900 epoch 36 - iter 265/2650 - loss 0.06388971 - time (sec): 19.06 - samples/sec: 7708.46 - lr: 0.100000 2023-04-06 00:33:31,448 epoch 36 - iter 530/2650 - loss 0.06427618 - time (sec): 37.61 - samples/sec: 7807.73 - lr: 0.100000 2023-04-06 00:33:50,058 epoch 36 - iter 795/2650 - loss 0.06345331 - time (sec): 56.22 - samples/sec: 7840.46 - lr: 0.100000 2023-04-06 00:34:08,771 epoch 36 - iter 1060/2650 - loss 0.06331201 - time (sec): 74.93 - samples/sec: 7837.48 - lr: 0.100000 2023-04-06 00:34:27,365 epoch 36 - iter 1325/2650 - loss 0.06428297 - time (sec): 93.52 - samples/sec: 7847.01 - lr: 0.100000 2023-04-06 00:34:45,876 epoch 36 - iter 1590/2650 - loss 0.06470664 - time (sec): 112.03 - samples/sec: 7863.31 - lr: 0.100000 2023-04-06 00:35:03,978 epoch 36 - iter 1855/2650 - loss 0.06514775 - time (sec): 130.14 - samples/sec: 7886.85 - lr: 0.100000 2023-04-06 00:35:22,325 epoch 36 - iter 2120/2650 - loss 0.06522302 - time (sec): 148.48 - samples/sec: 7891.70 - lr: 0.100000 2023-04-06 00:35:40,784 epoch 36 - iter 2385/2650 - loss 0.06515392 - time (sec): 166.94 - samples/sec: 7897.01 - lr: 0.100000 2023-04-06 00:35:59,244 epoch 36 - iter 2650/2650 - loss 0.06518148 - time (sec): 185.40 - samples/sec: 7887.51 - lr: 0.100000 2023-04-06 00:35:59,245 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:35:59,245 EPOCH 36 done: loss 0.0652 - lr 0.100000 2023-04-06 00:35:59,245 BAD EPOCHS (no improvement): 0 2023-04-06 00:35:59,248 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:36:17,383 epoch 37 - iter 265/2650 - loss 0.06569351 - time (sec): 18.13 - samples/sec: 7929.12 - lr: 0.100000 2023-04-06 00:36:36,061 epoch 37 - iter 530/2650 - loss 0.06649341 - time (sec): 36.81 - samples/sec: 7903.21 - lr: 0.100000 2023-04-06 00:36:53,674 epoch 37 - iter 795/2650 - loss 0.06637672 - time (sec): 54.43 - samples/sec: 8007.38 - lr: 0.100000 2023-04-06 00:37:11,791 epoch 37 - iter 1060/2650 - loss 0.06655478 - time (sec): 72.54 - samples/sec: 8039.63 - lr: 0.100000 2023-04-06 00:37:30,008 epoch 37 - iter 1325/2650 - loss 0.06630844 - time (sec): 90.76 - samples/sec: 8056.17 - lr: 0.100000 2023-04-06 00:37:48,223 epoch 37 - iter 1590/2650 - loss 0.06607397 - time (sec): 108.97 - samples/sec: 8049.11 - lr: 0.100000 2023-04-06 00:38:06,382 epoch 37 - iter 1855/2650 - loss 0.06610664 - time (sec): 127.13 - samples/sec: 8056.08 - lr: 0.100000 2023-04-06 00:38:24,378 epoch 37 - iter 2120/2650 - loss 0.06629933 - time (sec): 145.13 - samples/sec: 8056.71 - lr: 0.100000 2023-04-06 00:38:42,756 epoch 37 - iter 2385/2650 - loss 0.06633022 - time (sec): 163.51 - samples/sec: 8057.84 - lr: 0.100000 2023-04-06 00:39:00,669 epoch 37 - iter 2650/2650 - loss 0.06611251 - time (sec): 181.42 - samples/sec: 8060.60 - lr: 0.100000 2023-04-06 00:39:00,670 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:39:00,670 EPOCH 37 done: loss 0.0661 - lr 0.100000 2023-04-06 00:39:00,670 BAD EPOCHS (no improvement): 1 2023-04-06 00:39:00,672 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:39:18,685 epoch 38 - iter 265/2650 - loss 0.06411045 - time (sec): 18.01 - samples/sec: 8054.34 - lr: 0.100000 2023-04-06 00:39:36,869 epoch 38 - iter 530/2650 - loss 0.06416711 - time (sec): 36.20 - samples/sec: 8010.08 - lr: 0.100000 2023-04-06 00:39:54,867 epoch 38 - iter 795/2650 - loss 0.06450834 - time (sec): 54.19 - samples/sec: 8035.56 - lr: 0.100000 2023-04-06 00:40:13,249 epoch 38 - iter 1060/2650 - loss 0.06453213 - time (sec): 72.58 - samples/sec: 8006.04 - lr: 0.100000 2023-04-06 00:40:31,445 epoch 38 - iter 1325/2650 - loss 0.06440044 - time (sec): 90.77 - samples/sec: 8016.50 - lr: 0.100000 2023-04-06 00:40:49,909 epoch 38 - iter 1590/2650 - loss 0.06447461 - time (sec): 109.24 - samples/sec: 8018.13 - lr: 0.100000 2023-04-06 00:41:08,881 epoch 38 - iter 1855/2650 - loss 0.06456494 - time (sec): 128.21 - samples/sec: 7987.49 - lr: 0.100000 2023-04-06 00:41:27,721 epoch 38 - iter 2120/2650 - loss 0.06471694 - time (sec): 147.05 - samples/sec: 7954.41 - lr: 0.100000 2023-04-06 00:41:46,657 epoch 38 - iter 2385/2650 - loss 0.06486661 - time (sec): 165.98 - samples/sec: 7930.86 - lr: 0.100000 2023-04-06 00:42:05,229 epoch 38 - iter 2650/2650 - loss 0.06519633 - time (sec): 184.56 - samples/sec: 7923.66 - lr: 0.100000 2023-04-06 00:42:05,229 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:42:05,229 EPOCH 38 done: loss 0.0652 - lr 0.100000 2023-04-06 00:42:05,229 BAD EPOCHS (no improvement): 2 2023-04-06 00:42:05,232 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:42:24,042 epoch 39 - iter 265/2650 - loss 0.06290461 - time (sec): 18.81 - samples/sec: 7792.89 - lr: 0.100000 2023-04-06 00:42:43,038 epoch 39 - iter 530/2650 - loss 0.06307044 - time (sec): 37.81 - samples/sec: 7730.74 - lr: 0.100000 2023-04-06 00:43:01,794 epoch 39 - iter 795/2650 - loss 0.06408458 - time (sec): 56.56 - samples/sec: 7754.11 - lr: 0.100000 2023-04-06 00:43:19,990 epoch 39 - iter 1060/2650 - loss 0.06427130 - time (sec): 74.76 - samples/sec: 7800.65 - lr: 0.100000 2023-04-06 00:43:38,481 epoch 39 - iter 1325/2650 - loss 0.06443885 - time (sec): 93.25 - samples/sec: 7838.17 - lr: 0.100000 2023-04-06 00:43:56,839 epoch 39 - iter 1590/2650 - loss 0.06440756 - time (sec): 111.61 - samples/sec: 7871.21 - lr: 0.100000 2023-04-06 00:44:14,923 epoch 39 - iter 1855/2650 - loss 0.06465080 - time (sec): 129.69 - samples/sec: 7895.92 - lr: 0.100000 2023-04-06 00:44:33,054 epoch 39 - iter 2120/2650 - loss 0.06491069 - time (sec): 147.82 - samples/sec: 7916.00 - lr: 0.100000 2023-04-06 00:44:51,220 epoch 39 - iter 2385/2650 - loss 0.06513110 - time (sec): 165.99 - samples/sec: 7920.49 - lr: 0.100000 2023-04-06 00:45:09,739 epoch 39 - iter 2650/2650 - loss 0.06511872 - time (sec): 184.51 - samples/sec: 7925.81 - lr: 0.100000 2023-04-06 00:45:09,739 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:45:09,739 EPOCH 39 done: loss 0.0651 - lr 0.100000 2023-04-06 00:45:09,739 BAD EPOCHS (no improvement): 0 2023-04-06 00:45:09,742 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:45:27,533 epoch 40 - iter 265/2650 - loss 0.06305309 - time (sec): 17.79 - samples/sec: 8178.17 - lr: 0.100000 2023-04-06 00:45:45,734 epoch 40 - iter 530/2650 - loss 0.06298474 - time (sec): 35.99 - samples/sec: 8051.16 - lr: 0.100000 2023-04-06 00:46:04,137 epoch 40 - iter 795/2650 - loss 0.06340256 - time (sec): 54.39 - samples/sec: 7992.76 - lr: 0.100000 2023-04-06 00:46:22,465 epoch 40 - iter 1060/2650 - loss 0.06375402 - time (sec): 72.72 - samples/sec: 7994.72 - lr: 0.100000 2023-04-06 00:46:40,783 epoch 40 - iter 1325/2650 - loss 0.06406264 - time (sec): 91.04 - samples/sec: 7993.87 - lr: 0.100000 2023-04-06 00:46:59,049 epoch 40 - iter 1590/2650 - loss 0.06412328 - time (sec): 109.31 - samples/sec: 8000.84 - lr: 0.100000 2023-04-06 00:47:17,638 epoch 40 - iter 1855/2650 - loss 0.06425478 - time (sec): 127.90 - samples/sec: 7975.74 - lr: 0.100000 2023-04-06 00:47:36,781 epoch 40 - iter 2120/2650 - loss 0.06412604 - time (sec): 147.04 - samples/sec: 7950.32 - lr: 0.100000 2023-04-06 00:47:55,124 epoch 40 - iter 2385/2650 - loss 0.06412383 - time (sec): 165.38 - samples/sec: 7960.77 - lr: 0.100000 2023-04-06 00:48:13,141 epoch 40 - iter 2650/2650 - loss 0.06452189 - time (sec): 183.40 - samples/sec: 7973.67 - lr: 0.100000 2023-04-06 00:48:13,141 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:48:13,142 EPOCH 40 done: loss 0.0645 - lr 0.100000 2023-04-06 00:48:13,142 BAD EPOCHS (no improvement): 0 2023-04-06 00:48:13,145 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:48:31,361 epoch 41 - iter 265/2650 - loss 0.06334649 - time (sec): 18.22 - samples/sec: 8091.05 - lr: 0.100000 2023-04-06 00:48:49,789 epoch 41 - iter 530/2650 - loss 0.06410800 - time (sec): 36.64 - samples/sec: 8023.75 - lr: 0.100000 2023-04-06 00:49:08,265 epoch 41 - iter 795/2650 - loss 0.06428735 - time (sec): 55.12 - samples/sec: 7988.38 - lr: 0.100000 2023-04-06 00:49:26,766 epoch 41 - iter 1060/2650 - loss 0.06411221 - time (sec): 73.62 - samples/sec: 7966.49 - lr: 0.100000 2023-04-06 00:49:45,271 epoch 41 - iter 1325/2650 - loss 0.06399393 - time (sec): 92.13 - samples/sec: 7958.82 - lr: 0.100000 2023-04-06 00:50:03,182 epoch 41 - iter 1590/2650 - loss 0.06432864 - time (sec): 110.04 - samples/sec: 7982.21 - lr: 0.100000 2023-04-06 00:50:21,413 epoch 41 - iter 1855/2650 - loss 0.06405526 - time (sec): 128.27 - samples/sec: 7991.96 - lr: 0.100000 2023-04-06 00:50:39,619 epoch 41 - iter 2120/2650 - loss 0.06438140 - time (sec): 146.47 - samples/sec: 7988.29 - lr: 0.100000 2023-04-06 00:50:57,867 epoch 41 - iter 2385/2650 - loss 0.06454365 - time (sec): 164.72 - samples/sec: 7989.05 - lr: 0.100000 2023-04-06 00:51:16,744 epoch 41 - iter 2650/2650 - loss 0.06467682 - time (sec): 183.60 - samples/sec: 7964.97 - lr: 0.100000 2023-04-06 00:51:16,745 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:51:16,745 EPOCH 41 done: loss 0.0647 - lr 0.100000 2023-04-06 00:51:16,745 BAD EPOCHS (no improvement): 1 2023-04-06 00:51:16,747 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:51:34,983 epoch 42 - iter 265/2650 - loss 0.06278171 - time (sec): 18.24 - samples/sec: 8034.85 - lr: 0.100000 2023-04-06 00:51:53,512 epoch 42 - iter 530/2650 - loss 0.06357515 - time (sec): 36.76 - samples/sec: 7980.72 - lr: 0.100000 2023-04-06 00:52:11,780 epoch 42 - iter 795/2650 - loss 0.06291024 - time (sec): 55.03 - samples/sec: 7995.74 - lr: 0.100000 2023-04-06 00:52:29,793 epoch 42 - iter 1060/2650 - loss 0.06359762 - time (sec): 73.05 - samples/sec: 8001.87 - lr: 0.100000 2023-04-06 00:52:47,873 epoch 42 - iter 1325/2650 - loss 0.06377240 - time (sec): 91.13 - samples/sec: 8011.34 - lr: 0.100000 2023-04-06 00:53:06,093 epoch 42 - iter 1590/2650 - loss 0.06359781 - time (sec): 109.35 - samples/sec: 8008.44 - lr: 0.100000 2023-04-06 00:53:24,862 epoch 42 - iter 1855/2650 - loss 0.06411886 - time (sec): 128.11 - samples/sec: 7989.13 - lr: 0.100000 2023-04-06 00:53:43,140 epoch 42 - iter 2120/2650 - loss 0.06441783 - time (sec): 146.39 - samples/sec: 7991.69 - lr: 0.100000 2023-04-06 00:54:01,429 epoch 42 - iter 2385/2650 - loss 0.06479529 - time (sec): 164.68 - samples/sec: 7989.97 - lr: 0.100000 2023-04-06 00:54:19,947 epoch 42 - iter 2650/2650 - loss 0.06471577 - time (sec): 183.20 - samples/sec: 7982.35 - lr: 0.100000 2023-04-06 00:54:19,947 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:54:19,947 EPOCH 42 done: loss 0.0647 - lr 0.100000 2023-04-06 00:54:19,947 BAD EPOCHS (no improvement): 2 2023-04-06 00:54:19,950 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:54:38,470 epoch 43 - iter 265/2650 - loss 0.06142652 - time (sec): 18.52 - samples/sec: 7964.25 - lr: 0.100000 2023-04-06 00:54:56,674 epoch 43 - iter 530/2650 - loss 0.06262247 - time (sec): 36.72 - samples/sec: 8005.94 - lr: 0.100000 2023-04-06 00:55:14,643 epoch 43 - iter 795/2650 - loss 0.06317294 - time (sec): 54.69 - samples/sec: 8002.80 - lr: 0.100000 2023-04-06 00:55:33,359 epoch 43 - iter 1060/2650 - loss 0.06360404 - time (sec): 73.41 - samples/sec: 7963.23 - lr: 0.100000 2023-04-06 00:55:51,901 epoch 43 - iter 1325/2650 - loss 0.06377923 - time (sec): 91.95 - samples/sec: 7938.75 - lr: 0.100000 2023-04-06 00:56:10,409 epoch 43 - iter 1590/2650 - loss 0.06374200 - time (sec): 110.46 - samples/sec: 7937.17 - lr: 0.100000 2023-04-06 00:56:28,910 epoch 43 - iter 1855/2650 - loss 0.06388622 - time (sec): 128.96 - samples/sec: 7927.16 - lr: 0.100000 2023-04-06 00:56:47,358 epoch 43 - iter 2120/2650 - loss 0.06379421 - time (sec): 147.41 - samples/sec: 7931.98 - lr: 0.100000 2023-04-06 00:57:05,486 epoch 43 - iter 2385/2650 - loss 0.06374130 - time (sec): 165.54 - samples/sec: 7946.16 - lr: 0.100000 2023-04-06 00:57:24,115 epoch 43 - iter 2650/2650 - loss 0.06380648 - time (sec): 184.16 - samples/sec: 7940.51 - lr: 0.100000 2023-04-06 00:57:24,115 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:57:24,115 EPOCH 43 done: loss 0.0638 - lr 0.100000 2023-04-06 00:57:24,115 BAD EPOCHS (no improvement): 0 2023-04-06 00:57:24,118 ---------------------------------------------------------------------------------------------------- 2023-04-06 00:57:42,509 epoch 44 - iter 265/2650 - loss 0.06352930 - time (sec): 18.39 - samples/sec: 7968.47 - lr: 0.100000 2023-04-06 00:58:00,612 epoch 44 - iter 530/2650 - loss 0.06182354 - time (sec): 36.49 - samples/sec: 8013.90 - lr: 0.100000 2023-04-06 00:58:18,726 epoch 44 - iter 795/2650 - loss 0.06184290 - time (sec): 54.61 - samples/sec: 8020.85 - lr: 0.100000 2023-04-06 00:58:37,142 epoch 44 - iter 1060/2650 - loss 0.06204736 - time (sec): 73.02 - samples/sec: 8013.89 - lr: 0.100000 2023-04-06 00:58:55,253 epoch 44 - iter 1325/2650 - loss 0.06213590 - time (sec): 91.14 - samples/sec: 8020.92 - lr: 0.100000 2023-04-06 00:59:13,625 epoch 44 - iter 1590/2650 - loss 0.06274617 - time (sec): 109.51 - samples/sec: 8003.28 - lr: 0.100000 2023-04-06 00:59:32,296 epoch 44 - iter 1855/2650 - loss 0.06278383 - time (sec): 128.18 - samples/sec: 7985.53 - lr: 0.100000 2023-04-06 00:59:51,072 epoch 44 - iter 2120/2650 - loss 0.06304038 - time (sec): 146.95 - samples/sec: 7966.65 - lr: 0.100000 2023-04-06 01:00:09,379 epoch 44 - iter 2385/2650 - loss 0.06341406 - time (sec): 165.26 - samples/sec: 7969.21 - lr: 0.100000 2023-04-06 01:00:28,087 epoch 44 - iter 2650/2650 - loss 0.06372610 - time (sec): 183.97 - samples/sec: 7948.96 - lr: 0.100000 2023-04-06 01:00:28,088 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:00:28,088 EPOCH 44 done: loss 0.0637 - lr 0.100000 2023-04-06 01:00:28,088 BAD EPOCHS (no improvement): 0 2023-04-06 01:00:28,090 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:00:46,622 epoch 45 - iter 265/2650 - loss 0.06105154 - time (sec): 18.53 - samples/sec: 7822.75 - lr: 0.100000 2023-04-06 01:01:04,846 epoch 45 - iter 530/2650 - loss 0.06175550 - time (sec): 36.76 - samples/sec: 7914.25 - lr: 0.100000 2023-04-06 01:01:23,682 epoch 45 - iter 795/2650 - loss 0.06223835 - time (sec): 55.59 - samples/sec: 7891.80 - lr: 0.100000 2023-04-06 01:01:42,067 epoch 45 - iter 1060/2650 - loss 0.06266415 - time (sec): 73.98 - samples/sec: 7911.12 - lr: 0.100000 2023-04-06 01:02:00,325 epoch 45 - iter 1325/2650 - loss 0.06282063 - time (sec): 92.24 - samples/sec: 7927.20 - lr: 0.100000 2023-04-06 01:02:18,930 epoch 45 - iter 1590/2650 - loss 0.06302057 - time (sec): 110.84 - samples/sec: 7928.78 - lr: 0.100000 2023-04-06 01:02:36,723 epoch 45 - iter 1855/2650 - loss 0.06329796 - time (sec): 128.63 - samples/sec: 7945.53 - lr: 0.100000 2023-04-06 01:02:55,570 epoch 45 - iter 2120/2650 - loss 0.06352556 - time (sec): 147.48 - samples/sec: 7927.97 - lr: 0.100000 2023-04-06 01:03:13,992 epoch 45 - iter 2385/2650 - loss 0.06354380 - time (sec): 165.90 - samples/sec: 7921.85 - lr: 0.100000 2023-04-06 01:03:32,548 epoch 45 - iter 2650/2650 - loss 0.06350910 - time (sec): 184.46 - samples/sec: 7927.90 - lr: 0.100000 2023-04-06 01:03:32,548 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:03:32,548 EPOCH 45 done: loss 0.0635 - lr 0.100000 2023-04-06 01:03:32,548 BAD EPOCHS (no improvement): 0 2023-04-06 01:03:32,555 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:03:51,403 epoch 46 - iter 265/2650 - loss 0.06128713 - time (sec): 18.85 - samples/sec: 7800.08 - lr: 0.100000 2023-04-06 01:04:09,685 epoch 46 - iter 530/2650 - loss 0.06176459 - time (sec): 37.13 - samples/sec: 7882.87 - lr: 0.100000 2023-04-06 01:04:28,283 epoch 46 - iter 795/2650 - loss 0.06228357 - time (sec): 55.73 - samples/sec: 7884.82 - lr: 0.100000 2023-04-06 01:04:46,519 epoch 46 - iter 1060/2650 - loss 0.06227106 - time (sec): 73.96 - samples/sec: 7883.98 - lr: 0.100000 2023-04-06 01:05:04,753 epoch 46 - iter 1325/2650 - loss 0.06262426 - time (sec): 92.20 - samples/sec: 7910.25 - lr: 0.100000 2023-04-06 01:05:23,258 epoch 46 - iter 1590/2650 - loss 0.06289256 - time (sec): 110.70 - samples/sec: 7906.21 - lr: 0.100000 2023-04-06 01:05:42,285 epoch 46 - iter 1855/2650 - loss 0.06306267 - time (sec): 129.73 - samples/sec: 7879.14 - lr: 0.100000 2023-04-06 01:06:00,778 epoch 46 - iter 2120/2650 - loss 0.06306704 - time (sec): 148.22 - samples/sec: 7892.26 - lr: 0.100000 2023-04-06 01:06:19,068 epoch 46 - iter 2385/2650 - loss 0.06324072 - time (sec): 166.51 - samples/sec: 7901.54 - lr: 0.100000 2023-04-06 01:06:49,804 epoch 46 - iter 2650/2650 - loss 0.06318785 - time (sec): 197.25 - samples/sec: 7413.78 - lr: 0.100000 2023-04-06 01:06:49,804 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:06:49,804 EPOCH 46 done: loss 0.0632 - lr 0.100000 2023-04-06 01:06:49,804 BAD EPOCHS (no improvement): 0 2023-04-06 01:06:49,808 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:07:08,194 epoch 47 - iter 265/2650 - loss 0.06200636 - time (sec): 18.39 - samples/sec: 7905.83 - lr: 0.100000 2023-04-06 01:07:26,814 epoch 47 - iter 530/2650 - loss 0.06233728 - time (sec): 37.01 - samples/sec: 7893.30 - lr: 0.100000 2023-04-06 01:07:45,149 epoch 47 - iter 795/2650 - loss 0.06249650 - time (sec): 55.34 - samples/sec: 7928.44 - lr: 0.100000 2023-04-06 01:08:03,715 epoch 47 - iter 1060/2650 - loss 0.06233436 - time (sec): 73.91 - samples/sec: 7946.59 - lr: 0.100000 2023-04-06 01:08:22,672 epoch 47 - iter 1325/2650 - loss 0.06288311 - time (sec): 92.86 - samples/sec: 7907.57 - lr: 0.100000 2023-04-06 01:08:41,043 epoch 47 - iter 1590/2650 - loss 0.06257024 - time (sec): 111.23 - samples/sec: 7896.88 - lr: 0.100000 2023-04-06 01:08:59,237 epoch 47 - iter 1855/2650 - loss 0.06292583 - time (sec): 129.43 - samples/sec: 7907.29 - lr: 0.100000 2023-04-06 01:09:17,279 epoch 47 - iter 2120/2650 - loss 0.06318194 - time (sec): 147.47 - samples/sec: 7920.72 - lr: 0.100000 2023-04-06 01:09:35,926 epoch 47 - iter 2385/2650 - loss 0.06333398 - time (sec): 166.12 - samples/sec: 7911.38 - lr: 0.100000 2023-04-06 01:09:55,090 epoch 47 - iter 2650/2650 - loss 0.06355203 - time (sec): 185.28 - samples/sec: 7892.65 - lr: 0.100000 2023-04-06 01:09:55,090 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:09:55,090 EPOCH 47 done: loss 0.0636 - lr 0.100000 2023-04-06 01:09:55,090 BAD EPOCHS (no improvement): 1 2023-04-06 01:09:55,093 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:10:13,725 epoch 48 - iter 265/2650 - loss 0.06143570 - time (sec): 18.63 - samples/sec: 7742.29 - lr: 0.100000 2023-04-06 01:10:31,696 epoch 48 - iter 530/2650 - loss 0.06114015 - time (sec): 36.60 - samples/sec: 7892.71 - lr: 0.100000 2023-04-06 01:10:49,804 epoch 48 - iter 795/2650 - loss 0.06145213 - time (sec): 54.71 - samples/sec: 7935.60 - lr: 0.100000 2023-04-06 01:11:08,316 epoch 48 - iter 1060/2650 - loss 0.06217175 - time (sec): 73.22 - samples/sec: 7934.45 - lr: 0.100000 2023-04-06 01:11:26,921 epoch 48 - iter 1325/2650 - loss 0.06203507 - time (sec): 91.83 - samples/sec: 7919.91 - lr: 0.100000 2023-04-06 01:11:45,855 epoch 48 - iter 1590/2650 - loss 0.06228306 - time (sec): 110.76 - samples/sec: 7884.07 - lr: 0.100000 2023-04-06 01:12:04,999 epoch 48 - iter 1855/2650 - loss 0.06232229 - time (sec): 129.91 - samples/sec: 7864.25 - lr: 0.100000 2023-04-06 01:12:23,698 epoch 48 - iter 2120/2650 - loss 0.06244375 - time (sec): 148.60 - samples/sec: 7856.20 - lr: 0.100000 2023-04-06 01:12:42,368 epoch 48 - iter 2385/2650 - loss 0.06258336 - time (sec): 167.27 - samples/sec: 7859.74 - lr: 0.100000 2023-04-06 01:13:01,464 epoch 48 - iter 2650/2650 - loss 0.06275841 - time (sec): 186.37 - samples/sec: 7846.51 - lr: 0.100000 2023-04-06 01:13:01,465 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:13:01,465 EPOCH 48 done: loss 0.0628 - lr 0.100000 2023-04-06 01:13:01,465 BAD EPOCHS (no improvement): 0 2023-04-06 01:13:01,468 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:13:19,619 epoch 49 - iter 265/2650 - loss 0.06127803 - time (sec): 18.15 - samples/sec: 8022.75 - lr: 0.100000 2023-04-06 01:13:38,010 epoch 49 - iter 530/2650 - loss 0.06173003 - time (sec): 36.54 - samples/sec: 7951.24 - lr: 0.100000 2023-04-06 01:13:56,140 epoch 49 - iter 795/2650 - loss 0.06251417 - time (sec): 54.67 - samples/sec: 7997.63 - lr: 0.100000 2023-04-06 01:14:14,941 epoch 49 - iter 1060/2650 - loss 0.06216270 - time (sec): 73.47 - samples/sec: 7983.23 - lr: 0.100000 2023-04-06 01:14:33,201 epoch 49 - iter 1325/2650 - loss 0.06217874 - time (sec): 91.73 - samples/sec: 7990.04 - lr: 0.100000 2023-04-06 01:14:51,190 epoch 49 - iter 1590/2650 - loss 0.06243566 - time (sec): 109.72 - samples/sec: 7980.83 - lr: 0.100000 2023-04-06 01:15:09,648 epoch 49 - iter 1855/2650 - loss 0.06249158 - time (sec): 128.18 - samples/sec: 7974.13 - lr: 0.100000 2023-04-06 01:15:27,948 epoch 49 - iter 2120/2650 - loss 0.06259608 - time (sec): 146.48 - samples/sec: 7981.61 - lr: 0.100000 2023-04-06 01:15:46,101 epoch 49 - iter 2385/2650 - loss 0.06263362 - time (sec): 164.63 - samples/sec: 7987.11 - lr: 0.100000 2023-04-06 01:16:04,548 epoch 49 - iter 2650/2650 - loss 0.06285942 - time (sec): 183.08 - samples/sec: 7987.54 - lr: 0.100000 2023-04-06 01:16:04,549 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:16:04,549 EPOCH 49 done: loss 0.0629 - lr 0.100000 2023-04-06 01:16:04,549 BAD EPOCHS (no improvement): 1 2023-04-06 01:16:04,552 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:16:22,905 epoch 50 - iter 265/2650 - loss 0.06078733 - time (sec): 18.35 - samples/sec: 7904.01 - lr: 0.100000 2023-04-06 01:16:41,332 epoch 50 - iter 530/2650 - loss 0.06031116 - time (sec): 36.78 - samples/sec: 7932.75 - lr: 0.100000 2023-04-06 01:16:59,868 epoch 50 - iter 795/2650 - loss 0.06063307 - time (sec): 55.32 - samples/sec: 7945.16 - lr: 0.100000 2023-04-06 01:17:18,176 epoch 50 - iter 1060/2650 - loss 0.06082629 - time (sec): 73.62 - samples/sec: 7942.70 - lr: 0.100000 2023-04-06 01:17:36,715 epoch 50 - iter 1325/2650 - loss 0.06112533 - time (sec): 92.16 - samples/sec: 7932.32 - lr: 0.100000 2023-04-06 01:17:55,132 epoch 50 - iter 1590/2650 - loss 0.06143313 - time (sec): 110.58 - samples/sec: 7928.66 - lr: 0.100000 2023-04-06 01:18:13,425 epoch 50 - iter 1855/2650 - loss 0.06169277 - time (sec): 128.87 - samples/sec: 7932.72 - lr: 0.100000 2023-04-06 01:18:32,262 epoch 50 - iter 2120/2650 - loss 0.06203101 - time (sec): 147.71 - samples/sec: 7910.34 - lr: 0.100000 2023-04-06 01:18:50,419 epoch 50 - iter 2385/2650 - loss 0.06220425 - time (sec): 165.87 - samples/sec: 7933.94 - lr: 0.100000 2023-04-06 01:19:08,601 epoch 50 - iter 2650/2650 - loss 0.06236241 - time (sec): 184.05 - samples/sec: 7945.49 - lr: 0.100000 2023-04-06 01:19:08,601 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:19:08,602 EPOCH 50 done: loss 0.0624 - lr 0.100000 2023-04-06 01:19:08,602 BAD EPOCHS (no improvement): 0 2023-04-06 01:19:08,604 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:19:27,451 epoch 51 - iter 265/2650 - loss 0.06233200 - time (sec): 18.85 - samples/sec: 7781.13 - lr: 0.100000 2023-04-06 01:19:46,297 epoch 51 - iter 530/2650 - loss 0.06160920 - time (sec): 37.69 - samples/sec: 7836.49 - lr: 0.100000 2023-04-06 01:20:04,791 epoch 51 - iter 795/2650 - loss 0.06167665 - time (sec): 56.19 - samples/sec: 7875.15 - lr: 0.100000 2023-04-06 01:20:23,673 epoch 51 - iter 1060/2650 - loss 0.06155659 - time (sec): 75.07 - samples/sec: 7839.45 - lr: 0.100000 2023-04-06 01:20:42,332 epoch 51 - iter 1325/2650 - loss 0.06176299 - time (sec): 93.73 - samples/sec: 7832.33 - lr: 0.100000 2023-04-06 01:21:00,461 epoch 51 - iter 1590/2650 - loss 0.06212171 - time (sec): 111.86 - samples/sec: 7858.86 - lr: 0.100000 2023-04-06 01:21:18,745 epoch 51 - iter 1855/2650 - loss 0.06229915 - time (sec): 130.14 - samples/sec: 7868.85 - lr: 0.100000 2023-04-06 01:21:37,481 epoch 51 - iter 2120/2650 - loss 0.06247580 - time (sec): 148.88 - samples/sec: 7867.03 - lr: 0.100000 2023-04-06 01:21:55,752 epoch 51 - iter 2385/2650 - loss 0.06264640 - time (sec): 167.15 - samples/sec: 7881.48 - lr: 0.100000 2023-04-06 01:22:14,107 epoch 51 - iter 2650/2650 - loss 0.06270648 - time (sec): 185.50 - samples/sec: 7883.23 - lr: 0.100000 2023-04-06 01:22:14,108 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:22:14,108 EPOCH 51 done: loss 0.0627 - lr 0.100000 2023-04-06 01:22:14,108 BAD EPOCHS (no improvement): 1 2023-04-06 01:22:14,111 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:22:32,612 epoch 52 - iter 265/2650 - loss 0.06116718 - time (sec): 18.50 - samples/sec: 7852.47 - lr: 0.100000 2023-04-06 01:22:51,548 epoch 52 - iter 530/2650 - loss 0.06095655 - time (sec): 37.44 - samples/sec: 7796.84 - lr: 0.100000 2023-04-06 01:23:10,004 epoch 52 - iter 795/2650 - loss 0.06174203 - time (sec): 55.89 - samples/sec: 7807.99 - lr: 0.100000 2023-04-06 01:23:28,423 epoch 52 - iter 1060/2650 - loss 0.06183830 - time (sec): 74.31 - samples/sec: 7877.98 - lr: 0.100000 2023-04-06 01:23:46,527 epoch 52 - iter 1325/2650 - loss 0.06185610 - time (sec): 92.42 - samples/sec: 7921.10 - lr: 0.100000 2023-04-06 01:24:05,083 epoch 52 - iter 1590/2650 - loss 0.06173931 - time (sec): 110.97 - samples/sec: 7918.80 - lr: 0.100000 2023-04-06 01:24:23,430 epoch 52 - iter 1855/2650 - loss 0.06192590 - time (sec): 129.32 - samples/sec: 7930.07 - lr: 0.100000 2023-04-06 01:24:40,997 epoch 52 - iter 2120/2650 - loss 0.06216408 - time (sec): 146.89 - samples/sec: 7964.02 - lr: 0.100000 2023-04-06 01:24:59,128 epoch 52 - iter 2385/2650 - loss 0.06224371 - time (sec): 165.02 - samples/sec: 7977.88 - lr: 0.100000 2023-04-06 01:25:17,096 epoch 52 - iter 2650/2650 - loss 0.06233049 - time (sec): 182.99 - samples/sec: 7991.69 - lr: 0.100000 2023-04-06 01:25:17,096 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:25:17,096 EPOCH 52 done: loss 0.0623 - lr 0.100000 2023-04-06 01:25:17,096 BAD EPOCHS (no improvement): 0 2023-04-06 01:25:17,100 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:25:35,190 epoch 53 - iter 265/2650 - loss 0.06044664 - time (sec): 18.09 - samples/sec: 8027.12 - lr: 0.100000 2023-04-06 01:25:53,768 epoch 53 - iter 530/2650 - loss 0.05983769 - time (sec): 36.67 - samples/sec: 7972.74 - lr: 0.100000 2023-04-06 01:26:12,070 epoch 53 - iter 795/2650 - loss 0.05950812 - time (sec): 54.97 - samples/sec: 7967.76 - lr: 0.100000 2023-04-06 01:26:30,597 epoch 53 - iter 1060/2650 - loss 0.06025525 - time (sec): 73.50 - samples/sec: 7938.27 - lr: 0.100000 2023-04-06 01:26:49,473 epoch 53 - iter 1325/2650 - loss 0.06053752 - time (sec): 92.37 - samples/sec: 7917.21 - lr: 0.100000 2023-04-06 01:27:07,839 epoch 53 - iter 1590/2650 - loss 0.06095149 - time (sec): 110.74 - samples/sec: 7919.50 - lr: 0.100000 2023-04-06 01:27:25,919 epoch 53 - iter 1855/2650 - loss 0.06126722 - time (sec): 128.82 - samples/sec: 7945.27 - lr: 0.100000 2023-04-06 01:27:44,567 epoch 53 - iter 2120/2650 - loss 0.06131292 - time (sec): 147.47 - samples/sec: 7936.14 - lr: 0.100000 2023-04-06 01:28:02,996 epoch 53 - iter 2385/2650 - loss 0.06158473 - time (sec): 165.90 - samples/sec: 7936.58 - lr: 0.100000 2023-04-06 01:28:21,151 epoch 53 - iter 2650/2650 - loss 0.06186098 - time (sec): 184.05 - samples/sec: 7945.40 - lr: 0.100000 2023-04-06 01:28:21,152 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:28:21,152 EPOCH 53 done: loss 0.0619 - lr 0.100000 2023-04-06 01:28:21,152 BAD EPOCHS (no improvement): 0 2023-04-06 01:28:21,158 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:28:39,755 epoch 54 - iter 265/2650 - loss 0.06053452 - time (sec): 18.60 - samples/sec: 7933.32 - lr: 0.100000 2023-04-06 01:28:58,271 epoch 54 - iter 530/2650 - loss 0.06037041 - time (sec): 37.11 - samples/sec: 7869.29 - lr: 0.100000 2023-04-06 01:29:16,808 epoch 54 - iter 795/2650 - loss 0.06120857 - time (sec): 55.65 - samples/sec: 7848.60 - lr: 0.100000 2023-04-06 01:29:35,057 epoch 54 - iter 1060/2650 - loss 0.06136610 - time (sec): 73.90 - samples/sec: 7890.12 - lr: 0.100000 2023-04-06 01:29:53,827 epoch 54 - iter 1325/2650 - loss 0.06115567 - time (sec): 92.67 - samples/sec: 7889.13 - lr: 0.100000 2023-04-06 01:30:11,860 epoch 54 - iter 1590/2650 - loss 0.06144977 - time (sec): 110.70 - samples/sec: 7916.66 - lr: 0.100000 2023-04-06 01:30:30,777 epoch 54 - iter 1855/2650 - loss 0.06166556 - time (sec): 129.62 - samples/sec: 7904.80 - lr: 0.100000 2023-04-06 01:30:49,227 epoch 54 - iter 2120/2650 - loss 0.06198691 - time (sec): 148.07 - samples/sec: 7900.89 - lr: 0.100000 2023-04-06 01:31:08,422 epoch 54 - iter 2385/2650 - loss 0.06226204 - time (sec): 167.26 - samples/sec: 7870.57 - lr: 0.100000 2023-04-06 01:31:27,160 epoch 54 - iter 2650/2650 - loss 0.06206260 - time (sec): 186.00 - samples/sec: 7862.08 - lr: 0.100000 2023-04-06 01:31:27,160 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:31:27,160 EPOCH 54 done: loss 0.0621 - lr 0.100000 2023-04-06 01:31:27,160 BAD EPOCHS (no improvement): 1 2023-04-06 01:31:27,163 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:31:46,059 epoch 55 - iter 265/2650 - loss 0.05957678 - time (sec): 18.90 - samples/sec: 7774.44 - lr: 0.100000 2023-04-06 01:32:05,431 epoch 55 - iter 530/2650 - loss 0.05976961 - time (sec): 38.27 - samples/sec: 7707.54 - lr: 0.100000 2023-04-06 01:32:23,755 epoch 55 - iter 795/2650 - loss 0.06018992 - time (sec): 56.59 - samples/sec: 7802.63 - lr: 0.100000 2023-04-06 01:32:42,410 epoch 55 - iter 1060/2650 - loss 0.06020777 - time (sec): 75.25 - samples/sec: 7810.64 - lr: 0.100000 2023-04-06 01:33:00,548 epoch 55 - iter 1325/2650 - loss 0.06030876 - time (sec): 93.38 - samples/sec: 7853.97 - lr: 0.100000 2023-04-06 01:33:18,898 epoch 55 - iter 1590/2650 - loss 0.06065456 - time (sec): 111.73 - samples/sec: 7865.08 - lr: 0.100000 2023-04-06 01:33:37,390 epoch 55 - iter 1855/2650 - loss 0.06077865 - time (sec): 130.23 - samples/sec: 7872.31 - lr: 0.100000 2023-04-06 01:33:55,624 epoch 55 - iter 2120/2650 - loss 0.06123128 - time (sec): 148.46 - samples/sec: 7891.73 - lr: 0.100000 2023-04-06 01:34:13,723 epoch 55 - iter 2385/2650 - loss 0.06139234 - time (sec): 166.56 - samples/sec: 7909.67 - lr: 0.100000 2023-04-06 01:34:31,827 epoch 55 - iter 2650/2650 - loss 0.06169284 - time (sec): 184.66 - samples/sec: 7919.06 - lr: 0.100000 2023-04-06 01:34:31,827 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:34:31,828 EPOCH 55 done: loss 0.0617 - lr 0.100000 2023-04-06 01:34:31,828 BAD EPOCHS (no improvement): 0 2023-04-06 01:34:31,831 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:34:50,751 epoch 56 - iter 265/2650 - loss 0.05893578 - time (sec): 18.92 - samples/sec: 7782.89 - lr: 0.100000 2023-04-06 01:35:09,337 epoch 56 - iter 530/2650 - loss 0.06020089 - time (sec): 37.51 - samples/sec: 7848.55 - lr: 0.100000 2023-04-06 01:35:27,316 epoch 56 - iter 795/2650 - loss 0.05993240 - time (sec): 55.49 - samples/sec: 7900.85 - lr: 0.100000 2023-04-06 01:35:45,732 epoch 56 - iter 1060/2650 - loss 0.05982430 - time (sec): 73.90 - samples/sec: 7908.68 - lr: 0.100000 2023-04-06 01:36:04,112 epoch 56 - iter 1325/2650 - loss 0.06014114 - time (sec): 92.28 - samples/sec: 7921.18 - lr: 0.100000 2023-04-06 01:36:22,324 epoch 56 - iter 1590/2650 - loss 0.06029210 - time (sec): 110.49 - samples/sec: 7938.10 - lr: 0.100000 2023-04-06 01:36:40,463 epoch 56 - iter 1855/2650 - loss 0.06081436 - time (sec): 128.63 - samples/sec: 7961.08 - lr: 0.100000 2023-04-06 01:36:58,706 epoch 56 - iter 2120/2650 - loss 0.06109707 - time (sec): 146.88 - samples/sec: 7960.74 - lr: 0.100000 2023-04-06 01:37:17,211 epoch 56 - iter 2385/2650 - loss 0.06137609 - time (sec): 165.38 - samples/sec: 7962.60 - lr: 0.100000 2023-04-06 01:37:35,476 epoch 56 - iter 2650/2650 - loss 0.06151377 - time (sec): 183.64 - samples/sec: 7963.01 - lr: 0.100000 2023-04-06 01:37:35,476 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:37:35,476 EPOCH 56 done: loss 0.0615 - lr 0.100000 2023-04-06 01:37:35,476 BAD EPOCHS (no improvement): 0 2023-04-06 01:37:35,479 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:37:53,684 epoch 57 - iter 265/2650 - loss 0.05715342 - time (sec): 18.20 - samples/sec: 8018.93 - lr: 0.100000 2023-04-06 01:38:12,032 epoch 57 - iter 530/2650 - loss 0.05891719 - time (sec): 36.55 - samples/sec: 8001.86 - lr: 0.100000 2023-04-06 01:38:30,642 epoch 57 - iter 795/2650 - loss 0.05878405 - time (sec): 55.16 - samples/sec: 7963.47 - lr: 0.100000 2023-04-06 01:38:49,567 epoch 57 - iter 1060/2650 - loss 0.06005787 - time (sec): 74.09 - samples/sec: 7895.47 - lr: 0.100000 2023-04-06 01:39:08,288 epoch 57 - iter 1325/2650 - loss 0.06066359 - time (sec): 92.81 - samples/sec: 7870.43 - lr: 0.100000 2023-04-06 01:39:26,292 epoch 57 - iter 1590/2650 - loss 0.06091680 - time (sec): 110.81 - samples/sec: 7911.73 - lr: 0.100000 2023-04-06 01:39:44,354 epoch 57 - iter 1855/2650 - loss 0.06115063 - time (sec): 128.87 - samples/sec: 7926.58 - lr: 0.100000 2023-04-06 01:40:02,745 epoch 57 - iter 2120/2650 - loss 0.06131087 - time (sec): 147.27 - samples/sec: 7931.33 - lr: 0.100000 2023-04-06 01:40:21,293 epoch 57 - iter 2385/2650 - loss 0.06148596 - time (sec): 165.81 - samples/sec: 7932.41 - lr: 0.100000 2023-04-06 01:40:40,073 epoch 57 - iter 2650/2650 - loss 0.06168816 - time (sec): 184.59 - samples/sec: 7922.08 - lr: 0.100000 2023-04-06 01:40:40,073 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:40:40,073 EPOCH 57 done: loss 0.0617 - lr 0.100000 2023-04-06 01:40:40,073 BAD EPOCHS (no improvement): 1 2023-04-06 01:40:40,077 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:40:58,490 epoch 58 - iter 265/2650 - loss 0.06137806 - time (sec): 18.41 - samples/sec: 7968.59 - lr: 0.100000 2023-04-06 01:41:16,747 epoch 58 - iter 530/2650 - loss 0.06094615 - time (sec): 36.67 - samples/sec: 7991.77 - lr: 0.100000 2023-04-06 01:41:35,899 epoch 58 - iter 795/2650 - loss 0.06048127 - time (sec): 55.82 - samples/sec: 7859.74 - lr: 0.100000 2023-04-06 01:41:54,934 epoch 58 - iter 1060/2650 - loss 0.06073163 - time (sec): 74.86 - samples/sec: 7823.88 - lr: 0.100000 2023-04-06 01:42:13,571 epoch 58 - iter 1325/2650 - loss 0.06075712 - time (sec): 93.49 - samples/sec: 7836.01 - lr: 0.100000 2023-04-06 01:42:32,042 epoch 58 - iter 1590/2650 - loss 0.06126152 - time (sec): 111.97 - samples/sec: 7853.86 - lr: 0.100000 2023-04-06 01:42:50,111 epoch 58 - iter 1855/2650 - loss 0.06126510 - time (sec): 130.03 - samples/sec: 7883.04 - lr: 0.100000 2023-04-06 01:43:08,693 epoch 58 - iter 2120/2650 - loss 0.06138979 - time (sec): 148.62 - samples/sec: 7879.86 - lr: 0.100000 2023-04-06 01:43:26,980 epoch 58 - iter 2385/2650 - loss 0.06163230 - time (sec): 166.90 - samples/sec: 7890.80 - lr: 0.100000 2023-04-06 01:43:44,744 epoch 58 - iter 2650/2650 - loss 0.06150769 - time (sec): 184.67 - samples/sec: 7918.89 - lr: 0.100000 2023-04-06 01:43:44,745 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:43:44,745 EPOCH 58 done: loss 0.0615 - lr 0.100000 2023-04-06 01:43:44,745 BAD EPOCHS (no improvement): 0 2023-04-06 01:43:44,748 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:44:02,941 epoch 59 - iter 265/2650 - loss 0.06042476 - time (sec): 18.19 - samples/sec: 8030.68 - lr: 0.100000 2023-04-06 01:44:21,101 epoch 59 - iter 530/2650 - loss 0.05959190 - time (sec): 36.35 - samples/sec: 8048.69 - lr: 0.100000 2023-04-06 01:44:39,067 epoch 59 - iter 795/2650 - loss 0.05994700 - time (sec): 54.32 - samples/sec: 8053.48 - lr: 0.100000 2023-04-06 01:44:56,974 epoch 59 - iter 1060/2650 - loss 0.06073928 - time (sec): 72.23 - samples/sec: 8097.13 - lr: 0.100000 2023-04-06 01:45:15,587 epoch 59 - iter 1325/2650 - loss 0.06108783 - time (sec): 90.84 - samples/sec: 8056.52 - lr: 0.100000 2023-04-06 01:45:33,895 epoch 59 - iter 1590/2650 - loss 0.06125188 - time (sec): 109.15 - samples/sec: 8048.44 - lr: 0.100000 2023-04-06 01:45:52,277 epoch 59 - iter 1855/2650 - loss 0.06135614 - time (sec): 127.53 - samples/sec: 8041.85 - lr: 0.100000 2023-04-06 01:46:10,123 epoch 59 - iter 2120/2650 - loss 0.06115898 - time (sec): 145.38 - samples/sec: 8056.62 - lr: 0.100000 2023-04-06 01:46:28,358 epoch 59 - iter 2385/2650 - loss 0.06119785 - time (sec): 163.61 - samples/sec: 8047.46 - lr: 0.100000 2023-04-06 01:46:46,745 epoch 59 - iter 2650/2650 - loss 0.06154347 - time (sec): 182.00 - samples/sec: 8035.10 - lr: 0.100000 2023-04-06 01:46:46,745 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:46:46,745 EPOCH 59 done: loss 0.0615 - lr 0.100000 2023-04-06 01:46:46,745 BAD EPOCHS (no improvement): 1 2023-04-06 01:46:46,748 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:47:04,879 epoch 60 - iter 265/2650 - loss 0.05825701 - time (sec): 18.13 - samples/sec: 8068.96 - lr: 0.100000 2023-04-06 01:47:22,826 epoch 60 - iter 530/2650 - loss 0.05927458 - time (sec): 36.08 - samples/sec: 8093.04 - lr: 0.100000 2023-04-06 01:47:41,511 epoch 60 - iter 795/2650 - loss 0.05963191 - time (sec): 54.76 - samples/sec: 8019.15 - lr: 0.100000 2023-04-06 01:48:00,118 epoch 60 - iter 1060/2650 - loss 0.05969131 - time (sec): 73.37 - samples/sec: 7997.67 - lr: 0.100000 2023-04-06 01:48:18,335 epoch 60 - iter 1325/2650 - loss 0.05988787 - time (sec): 91.59 - samples/sec: 8006.79 - lr: 0.100000 2023-04-06 01:48:36,343 epoch 60 - iter 1590/2650 - loss 0.06002935 - time (sec): 109.60 - samples/sec: 8008.65 - lr: 0.100000 2023-04-06 01:48:54,790 epoch 60 - iter 1855/2650 - loss 0.06006504 - time (sec): 128.04 - samples/sec: 8013.83 - lr: 0.100000 2023-04-06 01:49:13,444 epoch 60 - iter 2120/2650 - loss 0.06024857 - time (sec): 146.70 - samples/sec: 7997.23 - lr: 0.100000 2023-04-06 01:49:31,529 epoch 60 - iter 2385/2650 - loss 0.06060528 - time (sec): 164.78 - samples/sec: 8007.56 - lr: 0.100000 2023-04-06 01:49:49,469 epoch 60 - iter 2650/2650 - loss 0.06116765 - time (sec): 182.72 - samples/sec: 8003.23 - lr: 0.100000 2023-04-06 01:49:49,470 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:49:49,470 EPOCH 60 done: loss 0.0612 - lr 0.100000 2023-04-06 01:49:49,470 BAD EPOCHS (no improvement): 0 2023-04-06 01:49:49,472 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:50:08,434 epoch 61 - iter 265/2650 - loss 0.06239146 - time (sec): 18.96 - samples/sec: 7777.77 - lr: 0.100000 2023-04-06 01:50:26,595 epoch 61 - iter 530/2650 - loss 0.06197496 - time (sec): 37.12 - samples/sec: 7849.37 - lr: 0.100000 2023-04-06 01:50:45,046 epoch 61 - iter 795/2650 - loss 0.06061485 - time (sec): 55.57 - samples/sec: 7875.99 - lr: 0.100000 2023-04-06 01:51:03,629 epoch 61 - iter 1060/2650 - loss 0.06076576 - time (sec): 74.16 - samples/sec: 7860.59 - lr: 0.100000 2023-04-06 01:51:21,787 epoch 61 - iter 1325/2650 - loss 0.06089375 - time (sec): 92.31 - samples/sec: 7898.77 - lr: 0.100000 2023-04-06 01:51:39,890 epoch 61 - iter 1590/2650 - loss 0.06106417 - time (sec): 110.42 - samples/sec: 7924.48 - lr: 0.100000 2023-04-06 01:51:59,170 epoch 61 - iter 1855/2650 - loss 0.06119065 - time (sec): 129.70 - samples/sec: 7886.92 - lr: 0.100000 2023-04-06 01:52:17,192 epoch 61 - iter 2120/2650 - loss 0.06112503 - time (sec): 147.72 - samples/sec: 7914.62 - lr: 0.100000 2023-04-06 01:52:35,588 epoch 61 - iter 2385/2650 - loss 0.06127326 - time (sec): 166.12 - samples/sec: 7923.19 - lr: 0.100000 2023-04-06 01:52:53,916 epoch 61 - iter 2650/2650 - loss 0.06123213 - time (sec): 184.44 - samples/sec: 7928.51 - lr: 0.100000 2023-04-06 01:52:53,916 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:52:53,916 EPOCH 61 done: loss 0.0612 - lr 0.100000 2023-04-06 01:52:53,916 BAD EPOCHS (no improvement): 1 2023-04-06 01:52:53,920 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:53:12,038 epoch 62 - iter 265/2650 - loss 0.05861475 - time (sec): 18.12 - samples/sec: 8061.16 - lr: 0.100000 2023-04-06 01:53:30,027 epoch 62 - iter 530/2650 - loss 0.05984476 - time (sec): 36.11 - samples/sec: 8103.54 - lr: 0.100000 2023-04-06 01:53:48,698 epoch 62 - iter 795/2650 - loss 0.05979340 - time (sec): 54.78 - samples/sec: 8033.70 - lr: 0.100000 2023-04-06 01:54:07,111 epoch 62 - iter 1060/2650 - loss 0.06016161 - time (sec): 73.19 - samples/sec: 7992.37 - lr: 0.100000 2023-04-06 01:54:25,298 epoch 62 - iter 1325/2650 - loss 0.06046888 - time (sec): 91.38 - samples/sec: 8006.64 - lr: 0.100000 2023-04-06 01:54:43,729 epoch 62 - iter 1590/2650 - loss 0.06035715 - time (sec): 109.81 - samples/sec: 8014.03 - lr: 0.100000 2023-04-06 01:55:02,148 epoch 62 - iter 1855/2650 - loss 0.06059567 - time (sec): 128.23 - samples/sec: 8001.31 - lr: 0.100000 2023-04-06 01:55:20,805 epoch 62 - iter 2120/2650 - loss 0.06077321 - time (sec): 146.89 - samples/sec: 7978.03 - lr: 0.100000 2023-04-06 01:55:39,287 epoch 62 - iter 2385/2650 - loss 0.06102903 - time (sec): 165.37 - samples/sec: 7978.13 - lr: 0.100000 2023-04-06 01:55:57,270 epoch 62 - iter 2650/2650 - loss 0.06095161 - time (sec): 183.35 - samples/sec: 7975.79 - lr: 0.100000 2023-04-06 01:55:57,271 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:55:57,271 EPOCH 62 done: loss 0.0610 - lr 0.100000 2023-04-06 01:55:57,271 BAD EPOCHS (no improvement): 0 2023-04-06 01:55:57,274 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:56:15,556 epoch 63 - iter 265/2650 - loss 0.05805620 - time (sec): 18.28 - samples/sec: 7898.49 - lr: 0.100000 2023-04-06 01:56:33,750 epoch 63 - iter 530/2650 - loss 0.05979685 - time (sec): 36.48 - samples/sec: 7964.17 - lr: 0.100000 2023-04-06 01:56:51,987 epoch 63 - iter 795/2650 - loss 0.06058558 - time (sec): 54.71 - samples/sec: 7989.15 - lr: 0.100000 2023-04-06 01:57:10,415 epoch 63 - iter 1060/2650 - loss 0.06084253 - time (sec): 73.14 - samples/sec: 7975.89 - lr: 0.100000 2023-04-06 01:57:28,659 epoch 63 - iter 1325/2650 - loss 0.06076575 - time (sec): 91.38 - samples/sec: 7998.88 - lr: 0.100000 2023-04-06 01:57:46,684 epoch 63 - iter 1590/2650 - loss 0.06092975 - time (sec): 109.41 - samples/sec: 8014.76 - lr: 0.100000 2023-04-06 01:58:05,138 epoch 63 - iter 1855/2650 - loss 0.06100139 - time (sec): 127.86 - samples/sec: 8010.41 - lr: 0.100000 2023-04-06 01:58:23,157 epoch 63 - iter 2120/2650 - loss 0.06101744 - time (sec): 145.88 - samples/sec: 8014.30 - lr: 0.100000 2023-04-06 01:58:41,812 epoch 63 - iter 2385/2650 - loss 0.06124693 - time (sec): 164.54 - samples/sec: 7998.65 - lr: 0.100000 2023-04-06 01:59:00,084 epoch 63 - iter 2650/2650 - loss 0.06117023 - time (sec): 182.81 - samples/sec: 7999.38 - lr: 0.100000 2023-04-06 01:59:00,084 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:59:00,084 EPOCH 63 done: loss 0.0612 - lr 0.100000 2023-04-06 01:59:00,084 BAD EPOCHS (no improvement): 1 2023-04-06 01:59:00,091 ---------------------------------------------------------------------------------------------------- 2023-04-06 01:59:18,618 epoch 64 - iter 265/2650 - loss 0.05832153 - time (sec): 18.53 - samples/sec: 7921.14 - lr: 0.100000 2023-04-06 01:59:36,968 epoch 64 - iter 530/2650 - loss 0.05859133 - time (sec): 36.88 - samples/sec: 7938.62 - lr: 0.100000 2023-04-06 01:59:55,265 epoch 64 - iter 795/2650 - loss 0.05926823 - time (sec): 55.17 - samples/sec: 7944.84 - lr: 0.100000 2023-04-06 02:00:13,726 epoch 64 - iter 1060/2650 - loss 0.05948278 - time (sec): 73.63 - samples/sec: 7949.13 - lr: 0.100000 2023-04-06 02:00:31,785 epoch 64 - iter 1325/2650 - loss 0.05958018 - time (sec): 91.69 - samples/sec: 7963.15 - lr: 0.100000 2023-04-06 02:00:50,555 epoch 64 - iter 1590/2650 - loss 0.06004785 - time (sec): 110.46 - samples/sec: 7939.69 - lr: 0.100000 2023-04-06 02:01:09,895 epoch 64 - iter 1855/2650 - loss 0.06033372 - time (sec): 129.80 - samples/sec: 7895.57 - lr: 0.100000 2023-04-06 02:01:28,401 epoch 64 - iter 2120/2650 - loss 0.06058205 - time (sec): 148.31 - samples/sec: 7898.29 - lr: 0.100000 2023-04-06 02:01:46,184 epoch 64 - iter 2385/2650 - loss 0.06091203 - time (sec): 166.09 - samples/sec: 7914.50 - lr: 0.100000 2023-04-06 02:02:05,010 epoch 64 - iter 2650/2650 - loss 0.06103279 - time (sec): 184.92 - samples/sec: 7908.14 - lr: 0.100000 2023-04-06 02:02:05,010 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:02:05,010 EPOCH 64 done: loss 0.0610 - lr 0.100000 2023-04-06 02:02:05,011 BAD EPOCHS (no improvement): 2 2023-04-06 02:02:05,015 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:02:23,674 epoch 65 - iter 265/2650 - loss 0.05908683 - time (sec): 18.66 - samples/sec: 7892.69 - lr: 0.100000 2023-04-06 02:02:42,047 epoch 65 - iter 530/2650 - loss 0.06051682 - time (sec): 37.03 - samples/sec: 7930.35 - lr: 0.100000 2023-04-06 02:03:00,299 epoch 65 - iter 795/2650 - loss 0.06040422 - time (sec): 55.28 - samples/sec: 7921.82 - lr: 0.100000 2023-04-06 02:03:18,945 epoch 65 - iter 1060/2650 - loss 0.06000929 - time (sec): 73.93 - samples/sec: 7917.38 - lr: 0.100000 2023-04-06 02:03:36,911 epoch 65 - iter 1325/2650 - loss 0.06020292 - time (sec): 91.90 - samples/sec: 7950.32 - lr: 0.100000 2023-04-06 02:03:55,429 epoch 65 - iter 1590/2650 - loss 0.06020738 - time (sec): 110.41 - samples/sec: 7961.46 - lr: 0.100000 2023-04-06 02:04:13,408 epoch 65 - iter 1855/2650 - loss 0.06034821 - time (sec): 128.39 - samples/sec: 7990.61 - lr: 0.100000 2023-04-06 02:04:31,590 epoch 65 - iter 2120/2650 - loss 0.06030345 - time (sec): 146.58 - samples/sec: 7995.84 - lr: 0.100000 2023-04-06 02:04:49,983 epoch 65 - iter 2385/2650 - loss 0.06044300 - time (sec): 164.97 - samples/sec: 7984.99 - lr: 0.100000 2023-04-06 02:05:08,085 epoch 65 - iter 2650/2650 - loss 0.06054044 - time (sec): 183.07 - samples/sec: 7988.02 - lr: 0.100000 2023-04-06 02:05:08,085 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:05:08,085 EPOCH 65 done: loss 0.0605 - lr 0.100000 2023-04-06 02:05:08,085 BAD EPOCHS (no improvement): 0 2023-04-06 02:05:08,090 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:05:26,506 epoch 66 - iter 265/2650 - loss 0.05931017 - time (sec): 18.42 - samples/sec: 7977.70 - lr: 0.100000 2023-04-06 02:05:44,994 epoch 66 - iter 530/2650 - loss 0.05918855 - time (sec): 36.90 - samples/sec: 7976.61 - lr: 0.100000 2023-04-06 02:06:03,842 epoch 66 - iter 795/2650 - loss 0.05951711 - time (sec): 55.75 - samples/sec: 7928.37 - lr: 0.100000 2023-04-06 02:06:22,126 epoch 66 - iter 1060/2650 - loss 0.05942169 - time (sec): 74.04 - samples/sec: 7949.00 - lr: 0.100000 2023-04-06 02:06:40,430 epoch 66 - iter 1325/2650 - loss 0.05954400 - time (sec): 92.34 - samples/sec: 7950.31 - lr: 0.100000 2023-04-06 02:06:58,461 epoch 66 - iter 1590/2650 - loss 0.05976361 - time (sec): 110.37 - samples/sec: 7955.15 - lr: 0.100000 2023-04-06 02:07:16,869 epoch 66 - iter 1855/2650 - loss 0.06002716 - time (sec): 128.78 - samples/sec: 7964.41 - lr: 0.100000 2023-04-06 02:07:35,300 epoch 66 - iter 2120/2650 - loss 0.05993267 - time (sec): 147.21 - samples/sec: 7962.74 - lr: 0.100000 2023-04-06 02:07:53,183 epoch 66 - iter 2385/2650 - loss 0.06025378 - time (sec): 165.09 - samples/sec: 7981.58 - lr: 0.100000 2023-04-06 02:08:11,328 epoch 66 - iter 2650/2650 - loss 0.06031632 - time (sec): 183.24 - samples/sec: 7980.70 - lr: 0.100000 2023-04-06 02:08:11,328 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:08:11,328 EPOCH 66 done: loss 0.0603 - lr 0.100000 2023-04-06 02:08:11,328 BAD EPOCHS (no improvement): 0 2023-04-06 02:08:11,331 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:08:29,053 epoch 67 - iter 265/2650 - loss 0.05873087 - time (sec): 17.72 - samples/sec: 8159.65 - lr: 0.100000 2023-04-06 02:08:47,662 epoch 67 - iter 530/2650 - loss 0.05900502 - time (sec): 36.33 - samples/sec: 8019.13 - lr: 0.100000 2023-04-06 02:09:06,011 epoch 67 - iter 795/2650 - loss 0.05960636 - time (sec): 54.68 - samples/sec: 8018.23 - lr: 0.100000 2023-04-06 02:09:24,542 epoch 67 - iter 1060/2650 - loss 0.05951294 - time (sec): 73.21 - samples/sec: 7983.56 - lr: 0.100000 2023-04-06 02:09:42,706 epoch 67 - iter 1325/2650 - loss 0.05981369 - time (sec): 91.38 - samples/sec: 7975.95 - lr: 0.100000 2023-04-06 02:10:00,674 epoch 67 - iter 1590/2650 - loss 0.05993682 - time (sec): 109.34 - samples/sec: 7999.25 - lr: 0.100000 2023-04-06 02:10:18,821 epoch 67 - iter 1855/2650 - loss 0.05969800 - time (sec): 127.49 - samples/sec: 8026.96 - lr: 0.100000 2023-04-06 02:10:37,187 epoch 67 - iter 2120/2650 - loss 0.05984468 - time (sec): 145.86 - samples/sec: 8016.88 - lr: 0.100000 2023-04-06 02:10:56,102 epoch 67 - iter 2385/2650 - loss 0.06012982 - time (sec): 164.77 - samples/sec: 7991.28 - lr: 0.100000 2023-04-06 02:11:14,260 epoch 67 - iter 2650/2650 - loss 0.06029238 - time (sec): 182.93 - samples/sec: 7994.13 - lr: 0.100000 2023-04-06 02:11:14,261 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:11:14,261 EPOCH 67 done: loss 0.0603 - lr 0.100000 2023-04-06 02:11:14,261 BAD EPOCHS (no improvement): 0 2023-04-06 02:11:14,263 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:11:32,768 epoch 68 - iter 265/2650 - loss 0.05732799 - time (sec): 18.51 - samples/sec: 7971.46 - lr: 0.100000 2023-04-06 02:11:50,903 epoch 68 - iter 530/2650 - loss 0.05924836 - time (sec): 36.64 - samples/sec: 8050.40 - lr: 0.100000 2023-04-06 02:12:08,697 epoch 68 - iter 795/2650 - loss 0.05924528 - time (sec): 54.43 - samples/sec: 8070.85 - lr: 0.100000 2023-04-06 02:12:26,947 epoch 68 - iter 1060/2650 - loss 0.05983405 - time (sec): 72.68 - samples/sec: 8064.25 - lr: 0.100000 2023-04-06 02:12:45,069 epoch 68 - iter 1325/2650 - loss 0.06020944 - time (sec): 90.81 - samples/sec: 8074.93 - lr: 0.100000 2023-04-06 02:13:03,180 epoch 68 - iter 1590/2650 - loss 0.06036278 - time (sec): 108.92 - samples/sec: 8067.59 - lr: 0.100000 2023-04-06 02:13:21,213 epoch 68 - iter 1855/2650 - loss 0.06051635 - time (sec): 126.95 - samples/sec: 8067.66 - lr: 0.100000 2023-04-06 02:13:39,690 epoch 68 - iter 2120/2650 - loss 0.06056646 - time (sec): 145.43 - samples/sec: 8048.35 - lr: 0.100000 2023-04-06 02:13:57,995 epoch 68 - iter 2385/2650 - loss 0.06072982 - time (sec): 163.73 - samples/sec: 8037.77 - lr: 0.100000 2023-04-06 02:14:16,397 epoch 68 - iter 2650/2650 - loss 0.06079508 - time (sec): 182.13 - samples/sec: 8029.05 - lr: 0.100000 2023-04-06 02:14:16,397 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:14:16,398 EPOCH 68 done: loss 0.0608 - lr 0.100000 2023-04-06 02:14:16,398 BAD EPOCHS (no improvement): 1 2023-04-06 02:14:16,401 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:14:34,691 epoch 69 - iter 265/2650 - loss 0.06175841 - time (sec): 18.29 - samples/sec: 7982.21 - lr: 0.100000 2023-04-06 02:14:52,875 epoch 69 - iter 530/2650 - loss 0.06133611 - time (sec): 36.47 - samples/sec: 8005.56 - lr: 0.100000 2023-04-06 02:15:11,550 epoch 69 - iter 795/2650 - loss 0.06147880 - time (sec): 55.15 - samples/sec: 7969.62 - lr: 0.100000 2023-04-06 02:15:29,340 epoch 69 - iter 1060/2650 - loss 0.06086384 - time (sec): 72.94 - samples/sec: 8032.90 - lr: 0.100000 2023-04-06 02:15:47,578 epoch 69 - iter 1325/2650 - loss 0.06101351 - time (sec): 91.18 - samples/sec: 8018.53 - lr: 0.100000 2023-04-06 02:16:05,728 epoch 69 - iter 1590/2650 - loss 0.06089604 - time (sec): 109.33 - samples/sec: 8025.99 - lr: 0.100000 2023-04-06 02:16:24,169 epoch 69 - iter 1855/2650 - loss 0.06046735 - time (sec): 127.77 - samples/sec: 8007.63 - lr: 0.100000 2023-04-06 02:16:42,690 epoch 69 - iter 2120/2650 - loss 0.06037567 - time (sec): 146.29 - samples/sec: 7989.67 - lr: 0.100000 2023-04-06 02:17:01,269 epoch 69 - iter 2385/2650 - loss 0.06061314 - time (sec): 164.87 - samples/sec: 7979.34 - lr: 0.100000 2023-04-06 02:17:20,400 epoch 69 - iter 2650/2650 - loss 0.06070079 - time (sec): 184.00 - samples/sec: 7947.69 - lr: 0.100000 2023-04-06 02:17:20,400 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:17:20,400 EPOCH 69 done: loss 0.0607 - lr 0.100000 2023-04-06 02:17:20,400 BAD EPOCHS (no improvement): 2 2023-04-06 02:17:20,403 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:17:39,274 epoch 70 - iter 265/2650 - loss 0.05617578 - time (sec): 18.87 - samples/sec: 7781.39 - lr: 0.100000 2023-04-06 02:17:57,563 epoch 70 - iter 530/2650 - loss 0.05867895 - time (sec): 37.16 - samples/sec: 7845.42 - lr: 0.100000 2023-04-06 02:18:16,164 epoch 70 - iter 795/2650 - loss 0.05865431 - time (sec): 55.76 - samples/sec: 7834.91 - lr: 0.100000 2023-04-06 02:18:35,231 epoch 70 - iter 1060/2650 - loss 0.05867734 - time (sec): 74.83 - samples/sec: 7787.00 - lr: 0.100000 2023-04-06 02:18:54,066 epoch 70 - iter 1325/2650 - loss 0.05888462 - time (sec): 93.66 - samples/sec: 7780.91 - lr: 0.100000 2023-04-06 02:19:12,946 epoch 70 - iter 1590/2650 - loss 0.05947495 - time (sec): 112.54 - samples/sec: 7780.50 - lr: 0.100000 2023-04-06 02:19:31,462 epoch 70 - iter 1855/2650 - loss 0.05973561 - time (sec): 131.06 - samples/sec: 7793.37 - lr: 0.100000 2023-04-06 02:19:50,716 epoch 70 - iter 2120/2650 - loss 0.05984913 - time (sec): 150.31 - samples/sec: 7775.73 - lr: 0.100000 2023-04-06 02:20:09,722 epoch 70 - iter 2385/2650 - loss 0.05998566 - time (sec): 169.32 - samples/sec: 7772.14 - lr: 0.100000 2023-04-06 02:20:28,481 epoch 70 - iter 2650/2650 - loss 0.06007274 - time (sec): 188.08 - samples/sec: 7775.33 - lr: 0.100000 2023-04-06 02:20:28,481 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:20:28,481 EPOCH 70 done: loss 0.0601 - lr 0.100000 2023-04-06 02:20:28,481 BAD EPOCHS (no improvement): 0 2023-04-06 02:20:28,485 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:20:46,393 epoch 71 - iter 265/2650 - loss 0.06041393 - time (sec): 17.91 - samples/sec: 8091.17 - lr: 0.100000 2023-04-06 02:21:04,736 epoch 71 - iter 530/2650 - loss 0.05900868 - time (sec): 36.25 - samples/sec: 8078.41 - lr: 0.100000 2023-04-06 02:21:23,528 epoch 71 - iter 795/2650 - loss 0.05958157 - time (sec): 55.04 - samples/sec: 7998.50 - lr: 0.100000 2023-04-06 02:21:42,373 epoch 71 - iter 1060/2650 - loss 0.05965704 - time (sec): 73.89 - samples/sec: 7941.49 - lr: 0.100000 2023-04-06 02:22:00,933 epoch 71 - iter 1325/2650 - loss 0.05928211 - time (sec): 92.45 - samples/sec: 7942.41 - lr: 0.100000 2023-04-06 02:22:19,644 epoch 71 - iter 1590/2650 - loss 0.05937425 - time (sec): 111.16 - samples/sec: 7933.62 - lr: 0.100000 2023-04-06 02:22:37,839 epoch 71 - iter 1855/2650 - loss 0.05926311 - time (sec): 129.35 - samples/sec: 7942.45 - lr: 0.100000 2023-04-06 02:22:56,133 epoch 71 - iter 2120/2650 - loss 0.05958554 - time (sec): 147.65 - samples/sec: 7940.59 - lr: 0.100000 2023-04-06 02:23:14,300 epoch 71 - iter 2385/2650 - loss 0.05960485 - time (sec): 165.81 - samples/sec: 7948.59 - lr: 0.100000 2023-04-06 02:23:32,371 epoch 71 - iter 2650/2650 - loss 0.05984481 - time (sec): 183.89 - samples/sec: 7952.53 - lr: 0.100000 2023-04-06 02:23:32,371 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:23:32,372 EPOCH 71 done: loss 0.0598 - lr 0.100000 2023-04-06 02:23:32,372 BAD EPOCHS (no improvement): 0 2023-04-06 02:23:32,375 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:23:51,506 epoch 72 - iter 265/2650 - loss 0.05821486 - time (sec): 19.13 - samples/sec: 7805.76 - lr: 0.100000 2023-04-06 02:24:09,672 epoch 72 - iter 530/2650 - loss 0.05861726 - time (sec): 37.30 - samples/sec: 7917.82 - lr: 0.100000 2023-04-06 02:24:28,401 epoch 72 - iter 795/2650 - loss 0.05939049 - time (sec): 56.03 - samples/sec: 7894.90 - lr: 0.100000 2023-04-06 02:24:46,652 epoch 72 - iter 1060/2650 - loss 0.05969627 - time (sec): 74.28 - samples/sec: 7908.34 - lr: 0.100000 2023-04-06 02:25:04,496 epoch 72 - iter 1325/2650 - loss 0.05988506 - time (sec): 92.12 - samples/sec: 7951.46 - lr: 0.100000 2023-04-06 02:25:22,925 epoch 72 - iter 1590/2650 - loss 0.06012305 - time (sec): 110.55 - samples/sec: 7945.67 - lr: 0.100000 2023-04-06 02:25:40,843 epoch 72 - iter 1855/2650 - loss 0.06028730 - time (sec): 128.47 - samples/sec: 7973.24 - lr: 0.100000 2023-04-06 02:25:58,954 epoch 72 - iter 2120/2650 - loss 0.06033241 - time (sec): 146.58 - samples/sec: 7981.77 - lr: 0.100000 2023-04-06 02:26:16,905 epoch 72 - iter 2385/2650 - loss 0.06026418 - time (sec): 164.53 - samples/sec: 8006.50 - lr: 0.100000 2023-04-06 02:26:35,408 epoch 72 - iter 2650/2650 - loss 0.06038708 - time (sec): 183.03 - samples/sec: 7989.62 - lr: 0.100000 2023-04-06 02:26:35,409 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:26:35,409 EPOCH 72 done: loss 0.0604 - lr 0.100000 2023-04-06 02:26:35,409 BAD EPOCHS (no improvement): 1 2023-04-06 02:26:35,412 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:26:53,482 epoch 73 - iter 265/2650 - loss 0.05819655 - time (sec): 18.07 - samples/sec: 8114.02 - lr: 0.100000 2023-04-06 02:27:11,896 epoch 73 - iter 530/2650 - loss 0.05856342 - time (sec): 36.48 - samples/sec: 8033.14 - lr: 0.100000 2023-04-06 02:27:30,320 epoch 73 - iter 795/2650 - loss 0.05952125 - time (sec): 54.91 - samples/sec: 7999.95 - lr: 0.100000 2023-04-06 02:27:48,877 epoch 73 - iter 1060/2650 - loss 0.05958307 - time (sec): 73.47 - samples/sec: 7987.37 - lr: 0.100000 2023-04-06 02:28:07,205 epoch 73 - iter 1325/2650 - loss 0.05968376 - time (sec): 91.79 - samples/sec: 7981.37 - lr: 0.100000 2023-04-06 02:28:25,834 epoch 73 - iter 1590/2650 - loss 0.06002447 - time (sec): 110.42 - samples/sec: 7966.84 - lr: 0.100000 2023-04-06 02:28:44,051 epoch 73 - iter 1855/2650 - loss 0.06012882 - time (sec): 128.64 - samples/sec: 7976.66 - lr: 0.100000 2023-04-06 02:29:01,939 epoch 73 - iter 2120/2650 - loss 0.06016054 - time (sec): 146.53 - samples/sec: 7990.08 - lr: 0.100000 2023-04-06 02:29:20,336 epoch 73 - iter 2385/2650 - loss 0.06029306 - time (sec): 164.92 - samples/sec: 7980.20 - lr: 0.100000 2023-04-06 02:29:38,402 epoch 73 - iter 2650/2650 - loss 0.06026237 - time (sec): 182.99 - samples/sec: 7991.46 - lr: 0.100000 2023-04-06 02:29:38,403 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:29:38,403 EPOCH 73 done: loss 0.0603 - lr 0.100000 2023-04-06 02:29:38,403 BAD EPOCHS (no improvement): 2 2023-04-06 02:29:38,406 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:29:56,829 epoch 74 - iter 265/2650 - loss 0.05838088 - time (sec): 18.42 - samples/sec: 7987.88 - lr: 0.100000 2023-04-06 02:30:15,439 epoch 74 - iter 530/2650 - loss 0.05880802 - time (sec): 37.03 - samples/sec: 7985.41 - lr: 0.100000 2023-04-06 02:30:34,384 epoch 74 - iter 795/2650 - loss 0.05944328 - time (sec): 55.98 - samples/sec: 7893.40 - lr: 0.100000 2023-04-06 02:30:53,028 epoch 74 - iter 1060/2650 - loss 0.05961473 - time (sec): 74.62 - samples/sec: 7862.67 - lr: 0.100000 2023-04-06 02:31:12,244 epoch 74 - iter 1325/2650 - loss 0.05961895 - time (sec): 93.84 - samples/sec: 7831.58 - lr: 0.100000 2023-04-06 02:31:30,413 epoch 74 - iter 1590/2650 - loss 0.05979815 - time (sec): 112.01 - samples/sec: 7855.35 - lr: 0.100000 2023-04-06 02:31:48,096 epoch 74 - iter 1855/2650 - loss 0.05988520 - time (sec): 129.69 - samples/sec: 7891.46 - lr: 0.100000 2023-04-06 02:32:06,415 epoch 74 - iter 2120/2650 - loss 0.06021354 - time (sec): 148.01 - samples/sec: 7903.25 - lr: 0.100000 2023-04-06 02:32:24,839 epoch 74 - iter 2385/2650 - loss 0.06019278 - time (sec): 166.43 - samples/sec: 7905.43 - lr: 0.100000 2023-04-06 02:32:43,222 epoch 74 - iter 2650/2650 - loss 0.06039886 - time (sec): 184.82 - samples/sec: 7912.54 - lr: 0.100000 2023-04-06 02:32:43,222 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:32:43,222 EPOCH 74 done: loss 0.0604 - lr 0.100000 2023-04-06 02:32:43,222 BAD EPOCHS (no improvement): 3 2023-04-06 02:32:43,225 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:33:01,180 epoch 75 - iter 265/2650 - loss 0.05883752 - time (sec): 17.95 - samples/sec: 8116.69 - lr: 0.100000 2023-04-06 02:33:19,487 epoch 75 - iter 530/2650 - loss 0.05969369 - time (sec): 36.26 - samples/sec: 8076.91 - lr: 0.100000 2023-04-06 02:33:37,512 epoch 75 - iter 795/2650 - loss 0.05997214 - time (sec): 54.29 - samples/sec: 8093.07 - lr: 0.100000 2023-04-06 02:33:55,346 epoch 75 - iter 1060/2650 - loss 0.06025709 - time (sec): 72.12 - samples/sec: 8098.22 - lr: 0.100000 2023-04-06 02:34:13,610 epoch 75 - iter 1325/2650 - loss 0.06011346 - time (sec): 90.38 - samples/sec: 8082.11 - lr: 0.100000 2023-04-06 02:34:31,619 epoch 75 - iter 1590/2650 - loss 0.06008103 - time (sec): 108.39 - samples/sec: 8079.10 - lr: 0.100000 2023-04-06 02:34:50,244 epoch 75 - iter 1855/2650 - loss 0.06022478 - time (sec): 127.02 - samples/sec: 8064.08 - lr: 0.100000 2023-04-06 02:35:08,608 epoch 75 - iter 2120/2650 - loss 0.06034181 - time (sec): 145.38 - samples/sec: 8059.24 - lr: 0.100000 2023-04-06 02:35:26,681 epoch 75 - iter 2385/2650 - loss 0.06017962 - time (sec): 163.46 - samples/sec: 8054.53 - lr: 0.100000 2023-04-06 02:35:45,048 epoch 75 - iter 2650/2650 - loss 0.06020907 - time (sec): 181.82 - samples/sec: 8042.79 - lr: 0.100000 2023-04-06 02:35:45,048 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:35:45,048 EPOCH 75 done: loss 0.0602 - lr 0.100000 2023-04-06 02:35:45,048 Epoch 75: reducing learning rate of group 0 to 5.0000e-02. 2023-04-06 02:35:45,048 BAD EPOCHS (no improvement): 4 2023-04-06 02:35:45,051 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:36:03,311 epoch 76 - iter 265/2650 - loss 0.05874327 - time (sec): 18.26 - samples/sec: 8024.87 - lr: 0.050000 2023-04-06 02:36:21,692 epoch 76 - iter 530/2650 - loss 0.05788042 - time (sec): 36.64 - samples/sec: 7995.00 - lr: 0.050000 2023-04-06 02:36:40,942 epoch 76 - iter 795/2650 - loss 0.05670637 - time (sec): 55.89 - samples/sec: 7893.01 - lr: 0.050000 2023-04-06 02:36:59,359 epoch 76 - iter 1060/2650 - loss 0.05712948 - time (sec): 74.31 - samples/sec: 7882.51 - lr: 0.050000 2023-04-06 02:37:17,378 epoch 76 - iter 1325/2650 - loss 0.05719774 - time (sec): 92.33 - samples/sec: 7919.62 - lr: 0.050000 2023-04-06 02:37:36,186 epoch 76 - iter 1590/2650 - loss 0.05720808 - time (sec): 111.13 - samples/sec: 7899.02 - lr: 0.050000 2023-04-06 02:37:54,399 epoch 76 - iter 1855/2650 - loss 0.05712792 - time (sec): 129.35 - samples/sec: 7911.02 - lr: 0.050000 2023-04-06 02:38:12,843 epoch 76 - iter 2120/2650 - loss 0.05708923 - time (sec): 147.79 - samples/sec: 7911.17 - lr: 0.050000 2023-04-06 02:38:31,479 epoch 76 - iter 2385/2650 - loss 0.05714548 - time (sec): 166.43 - samples/sec: 7908.07 - lr: 0.050000 2023-04-06 02:38:50,199 epoch 76 - iter 2650/2650 - loss 0.05714752 - time (sec): 185.15 - samples/sec: 7898.35 - lr: 0.050000 2023-04-06 02:38:50,199 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:38:50,199 EPOCH 76 done: loss 0.0571 - lr 0.050000 2023-04-06 02:38:50,200 BAD EPOCHS (no improvement): 0 2023-04-06 02:38:50,202 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:39:08,827 epoch 77 - iter 265/2650 - loss 0.05666073 - time (sec): 18.62 - samples/sec: 7867.82 - lr: 0.050000 2023-04-06 02:39:26,986 epoch 77 - iter 530/2650 - loss 0.05617551 - time (sec): 36.78 - samples/sec: 7951.50 - lr: 0.050000 2023-04-06 02:39:44,976 epoch 77 - iter 795/2650 - loss 0.05559983 - time (sec): 54.77 - samples/sec: 7996.09 - lr: 0.050000 2023-04-06 02:40:02,862 epoch 77 - iter 1060/2650 - loss 0.05571964 - time (sec): 72.66 - samples/sec: 8028.69 - lr: 0.050000 2023-04-06 02:40:21,128 epoch 77 - iter 1325/2650 - loss 0.05592732 - time (sec): 90.93 - samples/sec: 8037.90 - lr: 0.050000 2023-04-06 02:40:39,213 epoch 77 - iter 1590/2650 - loss 0.05592850 - time (sec): 109.01 - samples/sec: 8047.11 - lr: 0.050000 2023-04-06 02:40:57,913 epoch 77 - iter 1855/2650 - loss 0.05573139 - time (sec): 127.71 - samples/sec: 8014.84 - lr: 0.050000 2023-04-06 02:41:16,167 epoch 77 - iter 2120/2650 - loss 0.05539862 - time (sec): 145.96 - samples/sec: 8009.42 - lr: 0.050000 2023-04-06 02:41:34,355 epoch 77 - iter 2385/2650 - loss 0.05533665 - time (sec): 164.15 - samples/sec: 8011.69 - lr: 0.050000 2023-04-06 02:41:52,671 epoch 77 - iter 2650/2650 - loss 0.05531200 - time (sec): 182.47 - samples/sec: 8014.33 - lr: 0.050000 2023-04-06 02:41:52,671 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:41:52,671 EPOCH 77 done: loss 0.0553 - lr 0.050000 2023-04-06 02:41:52,671 BAD EPOCHS (no improvement): 0 2023-04-06 02:41:52,675 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:42:10,937 epoch 78 - iter 265/2650 - loss 0.05347207 - time (sec): 18.26 - samples/sec: 8098.67 - lr: 0.050000 2023-04-06 02:42:29,268 epoch 78 - iter 530/2650 - loss 0.05369306 - time (sec): 36.59 - samples/sec: 8026.61 - lr: 0.050000 2023-04-06 02:42:47,336 epoch 78 - iter 795/2650 - loss 0.05424167 - time (sec): 54.66 - samples/sec: 8029.96 - lr: 0.050000 2023-04-06 02:43:05,989 epoch 78 - iter 1060/2650 - loss 0.05460490 - time (sec): 73.31 - samples/sec: 8015.64 - lr: 0.050000 2023-04-06 02:43:23,819 epoch 78 - iter 1325/2650 - loss 0.05452825 - time (sec): 91.14 - samples/sec: 8032.39 - lr: 0.050000 2023-04-06 02:43:42,166 epoch 78 - iter 1590/2650 - loss 0.05450292 - time (sec): 109.49 - samples/sec: 8016.82 - lr: 0.050000 2023-04-06 02:44:00,350 epoch 78 - iter 1855/2650 - loss 0.05456221 - time (sec): 127.67 - samples/sec: 8013.91 - lr: 0.050000 2023-04-06 02:44:18,436 epoch 78 - iter 2120/2650 - loss 0.05432954 - time (sec): 145.76 - samples/sec: 8019.13 - lr: 0.050000 2023-04-06 02:44:36,411 epoch 78 - iter 2385/2650 - loss 0.05444565 - time (sec): 163.74 - samples/sec: 8028.00 - lr: 0.050000 2023-04-06 02:44:54,756 epoch 78 - iter 2650/2650 - loss 0.05454834 - time (sec): 182.08 - samples/sec: 8031.36 - lr: 0.050000 2023-04-06 02:44:54,757 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:44:54,757 EPOCH 78 done: loss 0.0545 - lr 0.050000 2023-04-06 02:44:54,757 BAD EPOCHS (no improvement): 0 2023-04-06 02:44:54,760 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:45:12,675 epoch 79 - iter 265/2650 - loss 0.05396337 - time (sec): 17.91 - samples/sec: 8213.55 - lr: 0.050000 2023-04-06 02:45:30,581 epoch 79 - iter 530/2650 - loss 0.05364247 - time (sec): 35.82 - samples/sec: 8150.96 - lr: 0.050000 2023-04-06 02:45:48,863 epoch 79 - iter 795/2650 - loss 0.05335649 - time (sec): 54.10 - samples/sec: 8099.48 - lr: 0.050000 2023-04-06 02:46:06,704 epoch 79 - iter 1060/2650 - loss 0.05343758 - time (sec): 71.94 - samples/sec: 8109.29 - lr: 0.050000 2023-04-06 02:46:25,524 epoch 79 - iter 1325/2650 - loss 0.05340108 - time (sec): 90.76 - samples/sec: 8042.29 - lr: 0.050000 2023-04-06 02:46:43,984 epoch 79 - iter 1590/2650 - loss 0.05359621 - time (sec): 109.22 - samples/sec: 8026.46 - lr: 0.050000 2023-04-06 02:47:02,007 epoch 79 - iter 1855/2650 - loss 0.05379085 - time (sec): 127.25 - samples/sec: 8043.56 - lr: 0.050000 2023-04-06 02:47:20,376 epoch 79 - iter 2120/2650 - loss 0.05376814 - time (sec): 145.62 - samples/sec: 8030.64 - lr: 0.050000 2023-04-06 02:47:38,562 epoch 79 - iter 2385/2650 - loss 0.05392349 - time (sec): 163.80 - samples/sec: 8036.02 - lr: 0.050000 2023-04-06 02:47:56,497 epoch 79 - iter 2650/2650 - loss 0.05386855 - time (sec): 181.74 - samples/sec: 8046.60 - lr: 0.050000 2023-04-06 02:47:56,497 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:47:56,497 EPOCH 79 done: loss 0.0539 - lr 0.050000 2023-04-06 02:47:56,497 BAD EPOCHS (no improvement): 0 2023-04-06 02:47:56,500 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:48:14,360 epoch 80 - iter 265/2650 - loss 0.05197881 - time (sec): 17.86 - samples/sec: 8090.60 - lr: 0.050000 2023-04-06 02:48:32,968 epoch 80 - iter 530/2650 - loss 0.05196015 - time (sec): 36.47 - samples/sec: 8050.12 - lr: 0.050000 2023-04-06 02:48:51,175 epoch 80 - iter 795/2650 - loss 0.05263371 - time (sec): 54.67 - samples/sec: 8028.49 - lr: 0.050000 2023-04-06 02:49:09,287 epoch 80 - iter 1060/2650 - loss 0.05287209 - time (sec): 72.79 - samples/sec: 8042.84 - lr: 0.050000 2023-04-06 02:49:27,360 epoch 80 - iter 1325/2650 - loss 0.05287013 - time (sec): 90.86 - samples/sec: 8053.76 - lr: 0.050000 2023-04-06 02:49:45,506 epoch 80 - iter 1590/2650 - loss 0.05278502 - time (sec): 109.01 - samples/sec: 8061.61 - lr: 0.050000 2023-04-06 02:50:04,069 epoch 80 - iter 1855/2650 - loss 0.05279786 - time (sec): 127.57 - samples/sec: 8042.26 - lr: 0.050000 2023-04-06 02:50:21,861 epoch 80 - iter 2120/2650 - loss 0.05279773 - time (sec): 145.36 - samples/sec: 8053.85 - lr: 0.050000 2023-04-06 02:50:40,002 epoch 80 - iter 2385/2650 - loss 0.05284310 - time (sec): 163.50 - samples/sec: 8048.85 - lr: 0.050000 2023-04-06 02:50:58,594 epoch 80 - iter 2650/2650 - loss 0.05270376 - time (sec): 182.09 - samples/sec: 8030.81 - lr: 0.050000 2023-04-06 02:50:58,595 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:50:58,595 EPOCH 80 done: loss 0.0527 - lr 0.050000 2023-04-06 02:50:58,595 BAD EPOCHS (no improvement): 0 2023-04-06 02:50:58,602 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:51:16,686 epoch 81 - iter 265/2650 - loss 0.05268596 - time (sec): 18.08 - samples/sec: 8097.99 - lr: 0.050000 2023-04-06 02:51:35,318 epoch 81 - iter 530/2650 - loss 0.05182560 - time (sec): 36.72 - samples/sec: 7959.02 - lr: 0.050000 2023-04-06 02:51:53,617 epoch 81 - iter 795/2650 - loss 0.05249524 - time (sec): 55.01 - samples/sec: 7962.43 - lr: 0.050000 2023-04-06 02:52:11,261 epoch 81 - iter 1060/2650 - loss 0.05210694 - time (sec): 72.66 - samples/sec: 8023.06 - lr: 0.050000 2023-04-06 02:52:29,165 epoch 81 - iter 1325/2650 - loss 0.05208086 - time (sec): 90.56 - samples/sec: 8051.55 - lr: 0.050000 2023-04-06 02:52:47,561 epoch 81 - iter 1590/2650 - loss 0.05199442 - time (sec): 108.96 - samples/sec: 8042.44 - lr: 0.050000 2023-04-06 02:53:05,533 epoch 81 - iter 1855/2650 - loss 0.05222585 - time (sec): 126.93 - samples/sec: 8047.10 - lr: 0.050000 2023-04-06 02:53:23,694 epoch 81 - iter 2120/2650 - loss 0.05246745 - time (sec): 145.09 - samples/sec: 8053.01 - lr: 0.050000 2023-04-06 02:53:42,096 epoch 81 - iter 2385/2650 - loss 0.05257183 - time (sec): 163.49 - samples/sec: 8051.86 - lr: 0.050000 2023-04-06 02:53:59,999 epoch 81 - iter 2650/2650 - loss 0.05268256 - time (sec): 181.40 - samples/sec: 8061.67 - lr: 0.050000 2023-04-06 02:53:59,999 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:53:59,999 EPOCH 81 done: loss 0.0527 - lr 0.050000 2023-04-06 02:53:59,999 BAD EPOCHS (no improvement): 0 2023-04-06 02:54:00,003 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:54:18,174 epoch 82 - iter 265/2650 - loss 0.05254488 - time (sec): 18.17 - samples/sec: 8078.33 - lr: 0.050000 2023-04-06 02:54:36,303 epoch 82 - iter 530/2650 - loss 0.05213020 - time (sec): 36.30 - samples/sec: 8058.25 - lr: 0.050000 2023-04-06 02:54:54,674 epoch 82 - iter 795/2650 - loss 0.05250303 - time (sec): 54.67 - samples/sec: 8041.77 - lr: 0.050000 2023-04-06 02:55:12,789 epoch 82 - iter 1060/2650 - loss 0.05250124 - time (sec): 72.79 - samples/sec: 8040.25 - lr: 0.050000 2023-04-06 02:55:30,760 epoch 82 - iter 1325/2650 - loss 0.05210366 - time (sec): 90.76 - samples/sec: 8058.62 - lr: 0.050000 2023-04-06 02:55:48,997 epoch 82 - iter 1590/2650 - loss 0.05194110 - time (sec): 108.99 - samples/sec: 8052.19 - lr: 0.050000 2023-04-06 02:56:06,924 epoch 82 - iter 1855/2650 - loss 0.05187677 - time (sec): 126.92 - samples/sec: 8050.26 - lr: 0.050000 2023-04-06 02:56:25,358 epoch 82 - iter 2120/2650 - loss 0.05176396 - time (sec): 145.36 - samples/sec: 8047.91 - lr: 0.050000 2023-04-06 02:56:43,596 epoch 82 - iter 2385/2650 - loss 0.05176739 - time (sec): 163.59 - samples/sec: 8054.62 - lr: 0.050000 2023-04-06 02:57:01,699 epoch 82 - iter 2650/2650 - loss 0.05192848 - time (sec): 181.70 - samples/sec: 8048.39 - lr: 0.050000 2023-04-06 02:57:01,699 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:57:01,700 EPOCH 82 done: loss 0.0519 - lr 0.050000 2023-04-06 02:57:01,700 BAD EPOCHS (no improvement): 0 2023-04-06 02:57:01,702 ---------------------------------------------------------------------------------------------------- 2023-04-06 02:57:19,757 epoch 83 - iter 265/2650 - loss 0.05241240 - time (sec): 18.05 - samples/sec: 8076.22 - lr: 0.050000 2023-04-06 02:57:37,922 epoch 83 - iter 530/2650 - loss 0.05257229 - time (sec): 36.22 - samples/sec: 8032.36 - lr: 0.050000 2023-04-06 02:57:56,250 epoch 83 - iter 795/2650 - loss 0.05236392 - time (sec): 54.55 - samples/sec: 8034.13 - lr: 0.050000 2023-04-06 02:58:14,465 epoch 83 - iter 1060/2650 - loss 0.05191376 - time (sec): 72.76 - samples/sec: 8027.47 - lr: 0.050000 2023-04-06 02:58:32,305 epoch 83 - iter 1325/2650 - loss 0.05231808 - time (sec): 90.60 - samples/sec: 8060.21 - lr: 0.050000 2023-04-06 02:58:50,778 epoch 83 - iter 1590/2650 - loss 0.05224835 - time (sec): 109.08 - samples/sec: 8045.35 - lr: 0.050000 2023-04-06 02:59:09,000 epoch 83 - iter 1855/2650 - loss 0.05242758 - time (sec): 127.30 - samples/sec: 8046.87 - lr: 0.050000 2023-04-06 02:59:26,730 epoch 83 - iter 2120/2650 - loss 0.05240322 - time (sec): 145.03 - samples/sec: 8066.70 - lr: 0.050000 2023-04-06 02:59:44,688 epoch 83 - iter 2385/2650 - loss 0.05225643 - time (sec): 162.99 - samples/sec: 8069.60 - lr: 0.050000 2023-04-06 03:00:03,160 epoch 83 - iter 2650/2650 - loss 0.05224252 - time (sec): 181.46 - samples/sec: 8058.96 - lr: 0.050000 2023-04-06 03:00:03,161 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:00:03,161 EPOCH 83 done: loss 0.0522 - lr 0.050000 2023-04-06 03:00:03,161 BAD EPOCHS (no improvement): 1 2023-04-06 03:00:03,163 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:00:21,448 epoch 84 - iter 265/2650 - loss 0.04863651 - time (sec): 18.28 - samples/sec: 8003.27 - lr: 0.050000 2023-04-06 03:00:39,771 epoch 84 - iter 530/2650 - loss 0.05029935 - time (sec): 36.61 - samples/sec: 7978.84 - lr: 0.050000 2023-04-06 03:00:57,822 epoch 84 - iter 795/2650 - loss 0.05074322 - time (sec): 54.66 - samples/sec: 8002.41 - lr: 0.050000 2023-04-06 03:01:16,175 epoch 84 - iter 1060/2650 - loss 0.05108621 - time (sec): 73.01 - samples/sec: 8002.07 - lr: 0.050000 2023-04-06 03:01:34,177 epoch 84 - iter 1325/2650 - loss 0.05112667 - time (sec): 91.01 - samples/sec: 8033.90 - lr: 0.050000 2023-04-06 03:01:52,333 epoch 84 - iter 1590/2650 - loss 0.05139092 - time (sec): 109.17 - samples/sec: 8039.07 - lr: 0.050000 2023-04-06 03:02:10,787 epoch 84 - iter 1855/2650 - loss 0.05147931 - time (sec): 127.62 - samples/sec: 8013.33 - lr: 0.050000 2023-04-06 03:02:29,651 epoch 84 - iter 2120/2650 - loss 0.05149181 - time (sec): 146.49 - samples/sec: 7984.39 - lr: 0.050000 2023-04-06 03:02:48,114 epoch 84 - iter 2385/2650 - loss 0.05146328 - time (sec): 164.95 - samples/sec: 7973.44 - lr: 0.050000 2023-04-06 03:03:07,007 epoch 84 - iter 2650/2650 - loss 0.05157765 - time (sec): 183.84 - samples/sec: 7954.37 - lr: 0.050000 2023-04-06 03:03:07,007 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:03:07,008 EPOCH 84 done: loss 0.0516 - lr 0.050000 2023-04-06 03:03:07,008 BAD EPOCHS (no improvement): 0 2023-04-06 03:03:07,012 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:03:25,936 epoch 85 - iter 265/2650 - loss 0.05158136 - time (sec): 18.92 - samples/sec: 7771.10 - lr: 0.050000 2023-04-06 03:03:44,780 epoch 85 - iter 530/2650 - loss 0.05046484 - time (sec): 37.77 - samples/sec: 7720.81 - lr: 0.050000 2023-04-06 03:04:03,597 epoch 85 - iter 795/2650 - loss 0.05037586 - time (sec): 56.58 - samples/sec: 7747.26 - lr: 0.050000 2023-04-06 03:04:22,488 epoch 85 - iter 1060/2650 - loss 0.05057706 - time (sec): 75.48 - samples/sec: 7761.39 - lr: 0.050000 2023-04-06 03:04:41,029 epoch 85 - iter 1325/2650 - loss 0.05065925 - time (sec): 94.02 - samples/sec: 7774.81 - lr: 0.050000 2023-04-06 03:04:59,942 epoch 85 - iter 1590/2650 - loss 0.05051624 - time (sec): 112.93 - samples/sec: 7779.28 - lr: 0.050000 2023-04-06 03:05:18,801 epoch 85 - iter 1855/2650 - loss 0.05061233 - time (sec): 131.79 - samples/sec: 7782.79 - lr: 0.050000 2023-04-06 03:05:37,576 epoch 85 - iter 2120/2650 - loss 0.05096448 - time (sec): 150.56 - samples/sec: 7777.06 - lr: 0.050000 2023-04-06 03:05:55,751 epoch 85 - iter 2385/2650 - loss 0.05078253 - time (sec): 168.74 - samples/sec: 7801.13 - lr: 0.050000 2023-04-06 03:06:13,983 epoch 85 - iter 2650/2650 - loss 0.05078137 - time (sec): 186.97 - samples/sec: 7821.34 - lr: 0.050000 2023-04-06 03:06:13,983 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:06:13,983 EPOCH 85 done: loss 0.0508 - lr 0.050000 2023-04-06 03:06:13,984 BAD EPOCHS (no improvement): 0 2023-04-06 03:06:13,987 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:06:32,352 epoch 86 - iter 265/2650 - loss 0.05105457 - time (sec): 18.37 - samples/sec: 7949.78 - lr: 0.050000 2023-04-06 03:06:50,663 epoch 86 - iter 530/2650 - loss 0.05078615 - time (sec): 36.68 - samples/sec: 7980.36 - lr: 0.050000 2023-04-06 03:07:08,941 epoch 86 - iter 795/2650 - loss 0.05046723 - time (sec): 54.95 - samples/sec: 7993.40 - lr: 0.050000 2023-04-06 03:07:26,840 epoch 86 - iter 1060/2650 - loss 0.05025267 - time (sec): 72.85 - samples/sec: 8030.77 - lr: 0.050000 2023-04-06 03:07:45,082 epoch 86 - iter 1325/2650 - loss 0.05058858 - time (sec): 91.09 - samples/sec: 8036.00 - lr: 0.050000 2023-04-06 03:08:03,690 epoch 86 - iter 1590/2650 - loss 0.05050308 - time (sec): 109.70 - samples/sec: 8021.45 - lr: 0.050000 2023-04-06 03:08:22,088 epoch 86 - iter 1855/2650 - loss 0.05059816 - time (sec): 128.10 - samples/sec: 8012.04 - lr: 0.050000 2023-04-06 03:08:39,936 epoch 86 - iter 2120/2650 - loss 0.05031262 - time (sec): 145.95 - samples/sec: 8031.64 - lr: 0.050000 2023-04-06 03:09:09,856 epoch 86 - iter 2385/2650 - loss 0.05035520 - time (sec): 175.87 - samples/sec: 7489.59 - lr: 0.050000 2023-04-06 03:09:28,123 epoch 86 - iter 2650/2650 - loss 0.05053911 - time (sec): 194.14 - samples/sec: 7532.67 - lr: 0.050000 2023-04-06 03:09:28,123 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:09:28,123 EPOCH 86 done: loss 0.0505 - lr 0.050000 2023-04-06 03:09:28,123 BAD EPOCHS (no improvement): 0 2023-04-06 03:09:28,127 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:09:46,727 epoch 87 - iter 265/2650 - loss 0.05001496 - time (sec): 18.60 - samples/sec: 7958.09 - lr: 0.050000 2023-04-06 03:10:04,885 epoch 87 - iter 530/2650 - loss 0.05016926 - time (sec): 36.76 - samples/sec: 8042.90 - lr: 0.050000 2023-04-06 03:10:22,921 epoch 87 - iter 795/2650 - loss 0.05079835 - time (sec): 54.79 - samples/sec: 8046.07 - lr: 0.050000 2023-04-06 03:10:41,069 epoch 87 - iter 1060/2650 - loss 0.05083387 - time (sec): 72.94 - samples/sec: 8033.92 - lr: 0.050000 2023-04-06 03:10:59,079 epoch 87 - iter 1325/2650 - loss 0.05088459 - time (sec): 90.95 - samples/sec: 8057.59 - lr: 0.050000 2023-04-06 03:11:17,016 epoch 87 - iter 1590/2650 - loss 0.05077202 - time (sec): 108.89 - samples/sec: 8076.04 - lr: 0.050000 2023-04-06 03:11:34,833 epoch 87 - iter 1855/2650 - loss 0.05070862 - time (sec): 126.71 - samples/sec: 8083.52 - lr: 0.050000 2023-04-06 03:11:53,380 epoch 87 - iter 2120/2650 - loss 0.05061472 - time (sec): 145.25 - samples/sec: 8054.80 - lr: 0.050000 2023-04-06 03:12:11,559 epoch 87 - iter 2385/2650 - loss 0.05069573 - time (sec): 163.43 - samples/sec: 8056.34 - lr: 0.050000 2023-04-06 03:12:29,750 epoch 87 - iter 2650/2650 - loss 0.05074251 - time (sec): 181.62 - samples/sec: 8051.63 - lr: 0.050000 2023-04-06 03:12:29,751 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:12:29,751 EPOCH 87 done: loss 0.0507 - lr 0.050000 2023-04-06 03:12:29,751 BAD EPOCHS (no improvement): 1 2023-04-06 03:12:29,755 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:12:48,369 epoch 88 - iter 265/2650 - loss 0.04930742 - time (sec): 18.61 - samples/sec: 7936.37 - lr: 0.050000 2023-04-06 03:13:06,497 epoch 88 - iter 530/2650 - loss 0.05029534 - time (sec): 36.74 - samples/sec: 7983.56 - lr: 0.050000 2023-04-06 03:13:24,136 epoch 88 - iter 795/2650 - loss 0.05023908 - time (sec): 54.38 - samples/sec: 8066.60 - lr: 0.050000 2023-04-06 03:13:42,250 epoch 88 - iter 1060/2650 - loss 0.05039592 - time (sec): 72.50 - samples/sec: 8058.80 - lr: 0.050000 2023-04-06 03:14:00,308 epoch 88 - iter 1325/2650 - loss 0.05017295 - time (sec): 90.55 - samples/sec: 8067.27 - lr: 0.050000 2023-04-06 03:14:18,515 epoch 88 - iter 1590/2650 - loss 0.05022107 - time (sec): 108.76 - samples/sec: 8066.79 - lr: 0.050000 2023-04-06 03:14:36,713 epoch 88 - iter 1855/2650 - loss 0.05024844 - time (sec): 126.96 - samples/sec: 8065.06 - lr: 0.050000 2023-04-06 03:14:54,241 epoch 88 - iter 2120/2650 - loss 0.05027794 - time (sec): 144.49 - samples/sec: 8084.92 - lr: 0.050000 2023-04-06 03:15:12,350 epoch 88 - iter 2385/2650 - loss 0.05028935 - time (sec): 162.60 - samples/sec: 8091.13 - lr: 0.050000 2023-04-06 03:15:30,759 epoch 88 - iter 2650/2650 - loss 0.05030309 - time (sec): 181.00 - samples/sec: 8079.18 - lr: 0.050000 2023-04-06 03:15:30,759 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:15:30,759 EPOCH 88 done: loss 0.0503 - lr 0.050000 2023-04-06 03:15:30,759 BAD EPOCHS (no improvement): 0 2023-04-06 03:15:30,762 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:15:48,672 epoch 89 - iter 265/2650 - loss 0.05041192 - time (sec): 17.91 - samples/sec: 8211.60 - lr: 0.050000 2023-04-06 03:16:06,716 epoch 89 - iter 530/2650 - loss 0.05090720 - time (sec): 35.95 - samples/sec: 8138.20 - lr: 0.050000 2023-04-06 03:16:24,419 epoch 89 - iter 795/2650 - loss 0.05020476 - time (sec): 53.66 - samples/sec: 8163.36 - lr: 0.050000 2023-04-06 03:16:42,407 epoch 89 - iter 1060/2650 - loss 0.05011764 - time (sec): 71.64 - samples/sec: 8146.85 - lr: 0.050000 2023-04-06 03:17:00,460 epoch 89 - iter 1325/2650 - loss 0.05034856 - time (sec): 89.70 - samples/sec: 8137.63 - lr: 0.050000 2023-04-06 03:17:18,095 epoch 89 - iter 1590/2650 - loss 0.05022304 - time (sec): 107.33 - samples/sec: 8162.03 - lr: 0.050000 2023-04-06 03:17:36,356 epoch 89 - iter 1855/2650 - loss 0.05036108 - time (sec): 125.59 - samples/sec: 8144.01 - lr: 0.050000 2023-04-06 03:17:54,472 epoch 89 - iter 2120/2650 - loss 0.05043055 - time (sec): 143.71 - samples/sec: 8139.79 - lr: 0.050000 2023-04-06 03:18:12,635 epoch 89 - iter 2385/2650 - loss 0.05046587 - time (sec): 161.87 - samples/sec: 8130.67 - lr: 0.050000 2023-04-06 03:18:30,955 epoch 89 - iter 2650/2650 - loss 0.05039452 - time (sec): 180.19 - samples/sec: 8115.53 - lr: 0.050000 2023-04-06 03:18:30,956 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:18:30,956 EPOCH 89 done: loss 0.0504 - lr 0.050000 2023-04-06 03:18:30,956 BAD EPOCHS (no improvement): 1 2023-04-06 03:18:30,958 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:18:49,188 epoch 90 - iter 265/2650 - loss 0.04817103 - time (sec): 18.23 - samples/sec: 8058.99 - lr: 0.050000 2023-04-06 03:19:07,644 epoch 90 - iter 530/2650 - loss 0.04846648 - time (sec): 36.69 - samples/sec: 7972.81 - lr: 0.050000 2023-04-06 03:19:25,527 epoch 90 - iter 795/2650 - loss 0.04833743 - time (sec): 54.57 - samples/sec: 8037.52 - lr: 0.050000 2023-04-06 03:19:43,672 epoch 90 - iter 1060/2650 - loss 0.04859588 - time (sec): 72.71 - samples/sec: 8051.90 - lr: 0.050000 2023-04-06 03:20:01,183 epoch 90 - iter 1325/2650 - loss 0.04878318 - time (sec): 90.22 - samples/sec: 8094.71 - lr: 0.050000 2023-04-06 03:20:18,884 epoch 90 - iter 1590/2650 - loss 0.04886754 - time (sec): 107.93 - samples/sec: 8104.67 - lr: 0.050000 2023-04-06 03:20:37,436 epoch 90 - iter 1855/2650 - loss 0.04915421 - time (sec): 126.48 - samples/sec: 8081.77 - lr: 0.050000 2023-04-06 03:20:55,705 epoch 90 - iter 2120/2650 - loss 0.04925637 - time (sec): 144.75 - samples/sec: 8085.13 - lr: 0.050000 2023-04-06 03:21:13,581 epoch 90 - iter 2385/2650 - loss 0.04930804 - time (sec): 162.62 - samples/sec: 8095.61 - lr: 0.050000 2023-04-06 03:21:31,829 epoch 90 - iter 2650/2650 - loss 0.04923232 - time (sec): 180.87 - samples/sec: 8085.12 - lr: 0.050000 2023-04-06 03:21:31,830 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:21:31,830 EPOCH 90 done: loss 0.0492 - lr 0.050000 2023-04-06 03:21:31,830 BAD EPOCHS (no improvement): 0 2023-04-06 03:21:31,834 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:21:50,471 epoch 91 - iter 265/2650 - loss 0.04910402 - time (sec): 18.64 - samples/sec: 7867.32 - lr: 0.050000 2023-04-06 03:22:08,658 epoch 91 - iter 530/2650 - loss 0.05027482 - time (sec): 36.82 - samples/sec: 7926.81 - lr: 0.050000 2023-04-06 03:22:27,026 epoch 91 - iter 795/2650 - loss 0.05007604 - time (sec): 55.19 - samples/sec: 7947.58 - lr: 0.050000 2023-04-06 03:22:44,920 epoch 91 - iter 1060/2650 - loss 0.04975508 - time (sec): 73.09 - samples/sec: 7998.56 - lr: 0.050000 2023-04-06 03:23:02,918 epoch 91 - iter 1325/2650 - loss 0.04956082 - time (sec): 91.08 - samples/sec: 8019.04 - lr: 0.050000 2023-04-06 03:23:21,001 epoch 91 - iter 1590/2650 - loss 0.04948051 - time (sec): 109.17 - samples/sec: 8018.11 - lr: 0.050000 2023-04-06 03:23:39,075 epoch 91 - iter 1855/2650 - loss 0.04967303 - time (sec): 127.24 - samples/sec: 8033.54 - lr: 0.050000 2023-04-06 03:23:57,188 epoch 91 - iter 2120/2650 - loss 0.04944886 - time (sec): 145.35 - samples/sec: 8041.21 - lr: 0.050000 2023-04-06 03:24:15,109 epoch 91 - iter 2385/2650 - loss 0.04970804 - time (sec): 163.28 - samples/sec: 8057.22 - lr: 0.050000 2023-04-06 03:24:33,238 epoch 91 - iter 2650/2650 - loss 0.04972600 - time (sec): 181.40 - samples/sec: 8061.34 - lr: 0.050000 2023-04-06 03:24:33,238 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:24:33,238 EPOCH 91 done: loss 0.0497 - lr 0.050000 2023-04-06 03:24:33,238 BAD EPOCHS (no improvement): 1 2023-04-06 03:24:33,241 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:24:51,100 epoch 92 - iter 265/2650 - loss 0.04988134 - time (sec): 17.86 - samples/sec: 8227.01 - lr: 0.050000 2023-04-06 03:25:09,401 epoch 92 - iter 530/2650 - loss 0.04882657 - time (sec): 36.16 - samples/sec: 8085.81 - lr: 0.050000 2023-04-06 03:25:28,014 epoch 92 - iter 795/2650 - loss 0.04878308 - time (sec): 54.77 - samples/sec: 8017.69 - lr: 0.050000 2023-04-06 03:25:46,385 epoch 92 - iter 1060/2650 - loss 0.04844555 - time (sec): 73.14 - samples/sec: 7989.67 - lr: 0.050000 2023-04-06 03:26:04,209 epoch 92 - iter 1325/2650 - loss 0.04866939 - time (sec): 90.97 - samples/sec: 8020.66 - lr: 0.050000 2023-04-06 03:26:22,386 epoch 92 - iter 1590/2650 - loss 0.04867874 - time (sec): 109.14 - samples/sec: 8014.99 - lr: 0.050000 2023-04-06 03:26:41,012 epoch 92 - iter 1855/2650 - loss 0.04887881 - time (sec): 127.77 - samples/sec: 8000.40 - lr: 0.050000 2023-04-06 03:26:59,532 epoch 92 - iter 2120/2650 - loss 0.04910626 - time (sec): 146.29 - samples/sec: 7994.70 - lr: 0.050000 2023-04-06 03:27:17,876 epoch 92 - iter 2385/2650 - loss 0.04898474 - time (sec): 164.64 - samples/sec: 7992.96 - lr: 0.050000 2023-04-06 03:27:35,697 epoch 92 - iter 2650/2650 - loss 0.04898788 - time (sec): 182.46 - samples/sec: 8014.89 - lr: 0.050000 2023-04-06 03:27:35,697 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:27:35,697 EPOCH 92 done: loss 0.0490 - lr 0.050000 2023-04-06 03:27:35,697 BAD EPOCHS (no improvement): 0 2023-04-06 03:27:35,700 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:27:53,773 epoch 93 - iter 265/2650 - loss 0.04828383 - time (sec): 18.07 - samples/sec: 8104.40 - lr: 0.050000 2023-04-06 03:28:12,456 epoch 93 - iter 530/2650 - loss 0.04858224 - time (sec): 36.76 - samples/sec: 8011.48 - lr: 0.050000 2023-04-06 03:28:30,959 epoch 93 - iter 795/2650 - loss 0.04790627 - time (sec): 55.26 - samples/sec: 7993.59 - lr: 0.050000 2023-04-06 03:28:48,776 epoch 93 - iter 1060/2650 - loss 0.04812048 - time (sec): 73.08 - samples/sec: 8047.73 - lr: 0.050000 2023-04-06 03:29:06,918 epoch 93 - iter 1325/2650 - loss 0.04846032 - time (sec): 91.22 - samples/sec: 8059.69 - lr: 0.050000 2023-04-06 03:29:25,310 epoch 93 - iter 1590/2650 - loss 0.04873251 - time (sec): 109.61 - samples/sec: 8046.52 - lr: 0.050000 2023-04-06 03:29:43,091 epoch 93 - iter 1855/2650 - loss 0.04874573 - time (sec): 127.39 - samples/sec: 8051.32 - lr: 0.050000 2023-04-06 03:30:01,216 epoch 93 - iter 2120/2650 - loss 0.04872313 - time (sec): 145.52 - samples/sec: 8041.90 - lr: 0.050000 2023-04-06 03:30:19,811 epoch 93 - iter 2385/2650 - loss 0.04871187 - time (sec): 164.11 - samples/sec: 8030.68 - lr: 0.050000 2023-04-06 03:30:37,663 epoch 93 - iter 2650/2650 - loss 0.04895244 - time (sec): 181.96 - samples/sec: 8036.59 - lr: 0.050000 2023-04-06 03:30:37,663 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:30:37,663 EPOCH 93 done: loss 0.0490 - lr 0.050000 2023-04-06 03:30:37,663 BAD EPOCHS (no improvement): 0 2023-04-06 03:30:37,668 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:30:55,540 epoch 94 - iter 265/2650 - loss 0.04934028 - time (sec): 17.87 - samples/sec: 8068.18 - lr: 0.050000 2023-04-06 03:31:13,328 epoch 94 - iter 530/2650 - loss 0.04921845 - time (sec): 35.66 - samples/sec: 8115.75 - lr: 0.050000 2023-04-06 03:31:31,671 epoch 94 - iter 795/2650 - loss 0.04833466 - time (sec): 54.00 - samples/sec: 8092.27 - lr: 0.050000 2023-04-06 03:31:49,435 epoch 94 - iter 1060/2650 - loss 0.04835024 - time (sec): 71.77 - samples/sec: 8122.03 - lr: 0.050000 2023-04-06 03:32:07,705 epoch 94 - iter 1325/2650 - loss 0.04801836 - time (sec): 90.04 - samples/sec: 8095.58 - lr: 0.050000 2023-04-06 03:32:25,858 epoch 94 - iter 1590/2650 - loss 0.04836578 - time (sec): 108.19 - samples/sec: 8097.32 - lr: 0.050000 2023-04-06 03:32:44,455 epoch 94 - iter 1855/2650 - loss 0.04851831 - time (sec): 126.79 - samples/sec: 8066.57 - lr: 0.050000 2023-04-06 03:33:02,963 epoch 94 - iter 2120/2650 - loss 0.04883682 - time (sec): 145.30 - samples/sec: 8051.14 - lr: 0.050000 2023-04-06 03:33:21,626 epoch 94 - iter 2385/2650 - loss 0.04903861 - time (sec): 163.96 - samples/sec: 8036.26 - lr: 0.050000 2023-04-06 03:33:39,863 epoch 94 - iter 2650/2650 - loss 0.04904799 - time (sec): 182.19 - samples/sec: 8026.38 - lr: 0.050000 2023-04-06 03:33:39,863 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:33:39,863 EPOCH 94 done: loss 0.0490 - lr 0.050000 2023-04-06 03:33:39,863 BAD EPOCHS (no improvement): 1 2023-04-06 03:33:39,866 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:33:58,125 epoch 95 - iter 265/2650 - loss 0.04772462 - time (sec): 18.26 - samples/sec: 8022.48 - lr: 0.050000 2023-04-06 03:34:15,888 epoch 95 - iter 530/2650 - loss 0.04802028 - time (sec): 36.02 - samples/sec: 8139.04 - lr: 0.050000 2023-04-06 03:34:33,924 epoch 95 - iter 795/2650 - loss 0.04736394 - time (sec): 54.06 - samples/sec: 8137.39 - lr: 0.050000 2023-04-06 03:34:51,723 epoch 95 - iter 1060/2650 - loss 0.04775730 - time (sec): 71.86 - samples/sec: 8164.22 - lr: 0.050000 2023-04-06 03:35:09,564 epoch 95 - iter 1325/2650 - loss 0.04810744 - time (sec): 89.70 - samples/sec: 8172.60 - lr: 0.050000 2023-04-06 03:35:27,219 epoch 95 - iter 1590/2650 - loss 0.04823947 - time (sec): 107.35 - samples/sec: 8189.09 - lr: 0.050000 2023-04-06 03:35:45,468 epoch 95 - iter 1855/2650 - loss 0.04845059 - time (sec): 125.60 - samples/sec: 8168.35 - lr: 0.050000 2023-04-06 03:36:03,660 epoch 95 - iter 2120/2650 - loss 0.04851872 - time (sec): 143.79 - samples/sec: 8146.48 - lr: 0.050000 2023-04-06 03:36:21,577 epoch 95 - iter 2385/2650 - loss 0.04857212 - time (sec): 161.71 - samples/sec: 8144.41 - lr: 0.050000 2023-04-06 03:36:39,393 epoch 95 - iter 2650/2650 - loss 0.04867947 - time (sec): 179.53 - samples/sec: 8145.65 - lr: 0.050000 2023-04-06 03:36:39,393 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:36:39,393 EPOCH 95 done: loss 0.0487 - lr 0.050000 2023-04-06 03:36:39,393 BAD EPOCHS (no improvement): 0 2023-04-06 03:36:39,398 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:36:57,202 epoch 96 - iter 265/2650 - loss 0.04816754 - time (sec): 17.80 - samples/sec: 8230.98 - lr: 0.050000 2023-04-06 03:37:15,067 epoch 96 - iter 530/2650 - loss 0.04780750 - time (sec): 35.67 - samples/sec: 8228.55 - lr: 0.050000 2023-04-06 03:37:32,566 epoch 96 - iter 795/2650 - loss 0.04794808 - time (sec): 53.17 - samples/sec: 8257.34 - lr: 0.050000 2023-04-06 03:37:50,637 epoch 96 - iter 1060/2650 - loss 0.04847168 - time (sec): 71.24 - samples/sec: 8219.97 - lr: 0.050000 2023-04-06 03:38:09,210 epoch 96 - iter 1325/2650 - loss 0.04817752 - time (sec): 89.81 - samples/sec: 8152.80 - lr: 0.050000 2023-04-06 03:38:27,972 epoch 96 - iter 1590/2650 - loss 0.04829999 - time (sec): 108.57 - samples/sec: 8097.45 - lr: 0.050000 2023-04-06 03:38:45,505 epoch 96 - iter 1855/2650 - loss 0.04869469 - time (sec): 126.11 - samples/sec: 8123.48 - lr: 0.050000 2023-04-06 03:39:04,064 epoch 96 - iter 2120/2650 - loss 0.04863304 - time (sec): 144.67 - samples/sec: 8099.84 - lr: 0.050000 2023-04-06 03:39:21,872 epoch 96 - iter 2385/2650 - loss 0.04886921 - time (sec): 162.47 - samples/sec: 8107.36 - lr: 0.050000 2023-04-06 03:39:40,010 epoch 96 - iter 2650/2650 - loss 0.04882905 - time (sec): 180.61 - samples/sec: 8096.69 - lr: 0.050000 2023-04-06 03:39:40,010 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:39:40,010 EPOCH 96 done: loss 0.0488 - lr 0.050000 2023-04-06 03:39:40,010 BAD EPOCHS (no improvement): 1 2023-04-06 03:39:40,084 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:39:58,124 epoch 97 - iter 265/2650 - loss 0.04773036 - time (sec): 18.04 - samples/sec: 8129.70 - lr: 0.050000 2023-04-06 03:40:16,338 epoch 97 - iter 530/2650 - loss 0.04798290 - time (sec): 36.25 - samples/sec: 8104.87 - lr: 0.050000 2023-04-06 03:40:34,162 epoch 97 - iter 795/2650 - loss 0.04820439 - time (sec): 54.08 - samples/sec: 8122.73 - lr: 0.050000 2023-04-06 03:40:52,402 epoch 97 - iter 1060/2650 - loss 0.04847809 - time (sec): 72.32 - samples/sec: 8100.67 - lr: 0.050000 2023-04-06 03:41:10,066 epoch 97 - iter 1325/2650 - loss 0.04838556 - time (sec): 89.98 - samples/sec: 8133.49 - lr: 0.050000 2023-04-06 03:41:28,364 epoch 97 - iter 1590/2650 - loss 0.04812776 - time (sec): 108.28 - samples/sec: 8116.46 - lr: 0.050000 2023-04-06 03:41:46,235 epoch 97 - iter 1855/2650 - loss 0.04812255 - time (sec): 126.15 - samples/sec: 8114.30 - lr: 0.050000 2023-04-06 03:42:04,322 epoch 97 - iter 2120/2650 - loss 0.04829748 - time (sec): 144.24 - samples/sec: 8105.49 - lr: 0.050000 2023-04-06 03:42:23,337 epoch 97 - iter 2385/2650 - loss 0.04840200 - time (sec): 163.25 - samples/sec: 8064.47 - lr: 0.050000 2023-04-06 03:42:41,182 epoch 97 - iter 2650/2650 - loss 0.04824635 - time (sec): 181.10 - samples/sec: 8074.97 - lr: 0.050000 2023-04-06 03:42:41,182 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:42:41,182 EPOCH 97 done: loss 0.0482 - lr 0.050000 2023-04-06 03:42:41,182 BAD EPOCHS (no improvement): 0 2023-04-06 03:42:41,186 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:42:58,696 epoch 98 - iter 265/2650 - loss 0.04704311 - time (sec): 17.51 - samples/sec: 8261.14 - lr: 0.050000 2023-04-06 03:43:17,022 epoch 98 - iter 530/2650 - loss 0.04692805 - time (sec): 35.84 - samples/sec: 8092.57 - lr: 0.050000 2023-04-06 03:43:34,957 epoch 98 - iter 795/2650 - loss 0.04792410 - time (sec): 53.77 - samples/sec: 8096.74 - lr: 0.050000 2023-04-06 03:43:52,979 epoch 98 - iter 1060/2650 - loss 0.04777728 - time (sec): 71.79 - samples/sec: 8127.63 - lr: 0.050000 2023-04-06 03:44:11,127 epoch 98 - iter 1325/2650 - loss 0.04787343 - time (sec): 89.94 - samples/sec: 8120.41 - lr: 0.050000 2023-04-06 03:44:29,921 epoch 98 - iter 1590/2650 - loss 0.04799987 - time (sec): 108.73 - samples/sec: 8071.95 - lr: 0.050000 2023-04-06 03:44:48,060 epoch 98 - iter 1855/2650 - loss 0.04807687 - time (sec): 126.87 - samples/sec: 8062.80 - lr: 0.050000 2023-04-06 03:45:06,442 epoch 98 - iter 2120/2650 - loss 0.04803624 - time (sec): 145.26 - samples/sec: 8058.65 - lr: 0.050000 2023-04-06 03:45:24,474 epoch 98 - iter 2385/2650 - loss 0.04816762 - time (sec): 163.29 - samples/sec: 8056.91 - lr: 0.050000 2023-04-06 03:45:42,555 epoch 98 - iter 2650/2650 - loss 0.04816596 - time (sec): 181.37 - samples/sec: 8062.90 - lr: 0.050000 2023-04-06 03:45:42,555 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:45:42,555 EPOCH 98 done: loss 0.0482 - lr 0.050000 2023-04-06 03:45:42,556 BAD EPOCHS (no improvement): 0 2023-04-06 03:45:42,558 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:46:00,345 epoch 99 - iter 265/2650 - loss 0.04761839 - time (sec): 17.79 - samples/sec: 8226.32 - lr: 0.050000 2023-04-06 03:46:18,259 epoch 99 - iter 530/2650 - loss 0.04828580 - time (sec): 35.70 - samples/sec: 8184.48 - lr: 0.050000 2023-04-06 03:46:36,676 epoch 99 - iter 795/2650 - loss 0.04768004 - time (sec): 54.12 - samples/sec: 8127.67 - lr: 0.050000 2023-04-06 03:46:55,012 epoch 99 - iter 1060/2650 - loss 0.04777874 - time (sec): 72.45 - samples/sec: 8106.90 - lr: 0.050000 2023-04-06 03:47:13,040 epoch 99 - iter 1325/2650 - loss 0.04806579 - time (sec): 90.48 - samples/sec: 8104.15 - lr: 0.050000 2023-04-06 03:47:30,855 epoch 99 - iter 1590/2650 - loss 0.04789202 - time (sec): 108.30 - samples/sec: 8117.34 - lr: 0.050000 2023-04-06 03:47:49,300 epoch 99 - iter 1855/2650 - loss 0.04782417 - time (sec): 126.74 - samples/sec: 8086.40 - lr: 0.050000 2023-04-06 03:48:08,189 epoch 99 - iter 2120/2650 - loss 0.04779957 - time (sec): 145.63 - samples/sec: 8042.21 - lr: 0.050000 2023-04-06 03:48:26,493 epoch 99 - iter 2385/2650 - loss 0.04772709 - time (sec): 163.93 - samples/sec: 8028.17 - lr: 0.050000 2023-04-06 03:48:45,162 epoch 99 - iter 2650/2650 - loss 0.04777629 - time (sec): 182.60 - samples/sec: 8008.38 - lr: 0.050000 2023-04-06 03:48:45,163 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:48:45,163 EPOCH 99 done: loss 0.0478 - lr 0.050000 2023-04-06 03:48:45,163 BAD EPOCHS (no improvement): 0 2023-04-06 03:48:45,165 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:49:03,898 epoch 100 - iter 265/2650 - loss 0.04746376 - time (sec): 18.73 - samples/sec: 7786.35 - lr: 0.050000 2023-04-06 03:49:22,606 epoch 100 - iter 530/2650 - loss 0.04787736 - time (sec): 37.44 - samples/sec: 7808.11 - lr: 0.050000 2023-04-06 03:49:41,437 epoch 100 - iter 795/2650 - loss 0.04751450 - time (sec): 56.27 - samples/sec: 7803.01 - lr: 0.050000 2023-04-06 03:49:59,654 epoch 100 - iter 1060/2650 - loss 0.04704861 - time (sec): 74.49 - samples/sec: 7884.23 - lr: 0.050000 2023-04-06 03:50:17,441 epoch 100 - iter 1325/2650 - loss 0.04727113 - time (sec): 92.28 - samples/sec: 7930.66 - lr: 0.050000 2023-04-06 03:50:35,535 epoch 100 - iter 1590/2650 - loss 0.04741592 - time (sec): 110.37 - samples/sec: 7965.63 - lr: 0.050000 2023-04-06 03:50:53,123 epoch 100 - iter 1855/2650 - loss 0.04754868 - time (sec): 127.96 - samples/sec: 7999.85 - lr: 0.050000 2023-04-06 03:51:11,118 epoch 100 - iter 2120/2650 - loss 0.04761682 - time (sec): 145.95 - samples/sec: 8018.27 - lr: 0.050000 2023-04-06 03:51:29,591 epoch 100 - iter 2385/2650 - loss 0.04752887 - time (sec): 164.43 - samples/sec: 8011.20 - lr: 0.050000 2023-04-06 03:51:47,771 epoch 100 - iter 2650/2650 - loss 0.04752009 - time (sec): 182.61 - samples/sec: 8008.31 - lr: 0.050000 2023-04-06 03:51:47,772 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:51:47,772 EPOCH 100 done: loss 0.0475 - lr 0.050000 2023-04-06 03:51:47,772 BAD EPOCHS (no improvement): 0 2023-04-06 03:51:47,775 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:52:06,574 epoch 101 - iter 265/2650 - loss 0.04599902 - time (sec): 18.80 - samples/sec: 7732.14 - lr: 0.050000 2023-04-06 03:52:25,224 epoch 101 - iter 530/2650 - loss 0.04565151 - time (sec): 37.45 - samples/sec: 7812.40 - lr: 0.050000 2023-04-06 03:52:43,960 epoch 101 - iter 795/2650 - loss 0.04563269 - time (sec): 56.18 - samples/sec: 7810.69 - lr: 0.050000 2023-04-06 03:53:02,590 epoch 101 - iter 1060/2650 - loss 0.04657751 - time (sec): 74.82 - samples/sec: 7841.65 - lr: 0.050000 2023-04-06 03:53:20,769 epoch 101 - iter 1325/2650 - loss 0.04662165 - time (sec): 92.99 - samples/sec: 7866.38 - lr: 0.050000 2023-04-06 03:53:38,731 epoch 101 - iter 1590/2650 - loss 0.04656010 - time (sec): 110.96 - samples/sec: 7896.82 - lr: 0.050000 2023-04-06 03:53:56,278 epoch 101 - iter 1855/2650 - loss 0.04651305 - time (sec): 128.50 - samples/sec: 7936.60 - lr: 0.050000 2023-04-06 03:54:14,430 epoch 101 - iter 2120/2650 - loss 0.04658736 - time (sec): 146.66 - samples/sec: 7950.59 - lr: 0.050000 2023-04-06 03:54:32,938 epoch 101 - iter 2385/2650 - loss 0.04690162 - time (sec): 165.16 - samples/sec: 7957.19 - lr: 0.050000 2023-04-06 03:54:52,229 epoch 101 - iter 2650/2650 - loss 0.04701829 - time (sec): 184.45 - samples/sec: 7928.07 - lr: 0.050000 2023-04-06 03:54:52,229 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:54:52,229 EPOCH 101 done: loss 0.0470 - lr 0.050000 2023-04-06 03:54:52,229 BAD EPOCHS (no improvement): 0 2023-04-06 03:54:52,233 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:55:10,599 epoch 102 - iter 265/2650 - loss 0.04690056 - time (sec): 18.37 - samples/sec: 8016.52 - lr: 0.050000 2023-04-06 03:55:28,639 epoch 102 - iter 530/2650 - loss 0.04770209 - time (sec): 36.41 - samples/sec: 7993.61 - lr: 0.050000 2023-04-06 03:55:46,481 epoch 102 - iter 795/2650 - loss 0.04757068 - time (sec): 54.25 - samples/sec: 8054.42 - lr: 0.050000 2023-04-06 03:56:04,540 epoch 102 - iter 1060/2650 - loss 0.04744586 - time (sec): 72.31 - samples/sec: 8075.93 - lr: 0.050000 2023-04-06 03:56:23,056 epoch 102 - iter 1325/2650 - loss 0.04719159 - time (sec): 90.82 - samples/sec: 8044.79 - lr: 0.050000 2023-04-06 03:56:41,427 epoch 102 - iter 1590/2650 - loss 0.04718185 - time (sec): 109.19 - samples/sec: 8037.88 - lr: 0.050000 2023-04-06 03:56:59,785 epoch 102 - iter 1855/2650 - loss 0.04709405 - time (sec): 127.55 - samples/sec: 8038.84 - lr: 0.050000 2023-04-06 03:57:17,611 epoch 102 - iter 2120/2650 - loss 0.04738980 - time (sec): 145.38 - samples/sec: 8054.16 - lr: 0.050000 2023-04-06 03:57:35,565 epoch 102 - iter 2385/2650 - loss 0.04754961 - time (sec): 163.33 - samples/sec: 8065.11 - lr: 0.050000 2023-04-06 03:57:53,648 epoch 102 - iter 2650/2650 - loss 0.04758383 - time (sec): 181.41 - samples/sec: 8060.87 - lr: 0.050000 2023-04-06 03:57:53,648 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:57:53,648 EPOCH 102 done: loss 0.0476 - lr 0.050000 2023-04-06 03:57:53,648 BAD EPOCHS (no improvement): 1 2023-04-06 03:57:53,651 ---------------------------------------------------------------------------------------------------- 2023-04-06 03:58:11,853 epoch 103 - iter 265/2650 - loss 0.04618381 - time (sec): 18.20 - samples/sec: 7999.13 - lr: 0.050000 2023-04-06 03:58:30,083 epoch 103 - iter 530/2650 - loss 0.04677250 - time (sec): 36.43 - samples/sec: 7996.29 - lr: 0.050000 2023-04-06 03:58:48,698 epoch 103 - iter 795/2650 - loss 0.04659516 - time (sec): 55.05 - samples/sec: 7958.40 - lr: 0.050000 2023-04-06 03:59:07,103 epoch 103 - iter 1060/2650 - loss 0.04678630 - time (sec): 73.45 - samples/sec: 7966.68 - lr: 0.050000 2023-04-06 03:59:25,140 epoch 103 - iter 1325/2650 - loss 0.04670725 - time (sec): 91.49 - samples/sec: 7978.54 - lr: 0.050000 2023-04-06 03:59:43,312 epoch 103 - iter 1590/2650 - loss 0.04676629 - time (sec): 109.66 - samples/sec: 8000.33 - lr: 0.050000 2023-04-06 04:00:01,463 epoch 103 - iter 1855/2650 - loss 0.04687620 - time (sec): 127.81 - samples/sec: 8012.95 - lr: 0.050000 2023-04-06 04:00:19,376 epoch 103 - iter 2120/2650 - loss 0.04678359 - time (sec): 145.72 - samples/sec: 8023.51 - lr: 0.050000 2023-04-06 04:00:37,379 epoch 103 - iter 2385/2650 - loss 0.04696604 - time (sec): 163.73 - samples/sec: 8033.98 - lr: 0.050000 2023-04-06 04:00:55,740 epoch 103 - iter 2650/2650 - loss 0.04720749 - time (sec): 182.09 - samples/sec: 8031.05 - lr: 0.050000 2023-04-06 04:00:55,740 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:00:55,741 EPOCH 103 done: loss 0.0472 - lr 0.050000 2023-04-06 04:00:55,741 BAD EPOCHS (no improvement): 2 2023-04-06 04:00:55,744 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:01:14,113 epoch 104 - iter 265/2650 - loss 0.04653857 - time (sec): 18.37 - samples/sec: 8003.14 - lr: 0.050000 2023-04-06 04:01:32,656 epoch 104 - iter 530/2650 - loss 0.04754406 - time (sec): 36.91 - samples/sec: 8014.88 - lr: 0.050000 2023-04-06 04:01:50,324 epoch 104 - iter 795/2650 - loss 0.04766992 - time (sec): 54.58 - samples/sec: 8065.94 - lr: 0.050000 2023-04-06 04:02:08,221 epoch 104 - iter 1060/2650 - loss 0.04767003 - time (sec): 72.48 - samples/sec: 8100.43 - lr: 0.050000 2023-04-06 04:02:26,551 epoch 104 - iter 1325/2650 - loss 0.04759578 - time (sec): 90.81 - samples/sec: 8074.96 - lr: 0.050000 2023-04-06 04:02:45,114 epoch 104 - iter 1590/2650 - loss 0.04744377 - time (sec): 109.37 - samples/sec: 8043.06 - lr: 0.050000 2023-04-06 04:03:03,281 epoch 104 - iter 1855/2650 - loss 0.04744310 - time (sec): 127.54 - samples/sec: 8044.74 - lr: 0.050000 2023-04-06 04:03:20,899 epoch 104 - iter 2120/2650 - loss 0.04735300 - time (sec): 145.15 - samples/sec: 8071.24 - lr: 0.050000 2023-04-06 04:03:39,103 epoch 104 - iter 2385/2650 - loss 0.04737298 - time (sec): 163.36 - samples/sec: 8070.75 - lr: 0.050000 2023-04-06 04:03:56,740 epoch 104 - iter 2650/2650 - loss 0.04735578 - time (sec): 181.00 - samples/sec: 8079.55 - lr: 0.050000 2023-04-06 04:03:56,740 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:03:56,740 EPOCH 104 done: loss 0.0474 - lr 0.050000 2023-04-06 04:03:56,740 BAD EPOCHS (no improvement): 3 2023-04-06 04:03:56,744 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:04:14,860 epoch 105 - iter 265/2650 - loss 0.04686332 - time (sec): 18.12 - samples/sec: 8043.70 - lr: 0.050000 2023-04-06 04:04:33,171 epoch 105 - iter 530/2650 - loss 0.04733266 - time (sec): 36.43 - samples/sec: 8092.68 - lr: 0.050000 2023-04-06 04:04:50,941 epoch 105 - iter 795/2650 - loss 0.04714578 - time (sec): 54.20 - samples/sec: 8134.51 - lr: 0.050000 2023-04-06 04:05:09,161 epoch 105 - iter 1060/2650 - loss 0.04716258 - time (sec): 72.42 - samples/sec: 8114.72 - lr: 0.050000 2023-04-06 04:05:27,298 epoch 105 - iter 1325/2650 - loss 0.04733306 - time (sec): 90.55 - samples/sec: 8100.20 - lr: 0.050000 2023-04-06 04:05:45,678 epoch 105 - iter 1590/2650 - loss 0.04773450 - time (sec): 108.93 - samples/sec: 8062.52 - lr: 0.050000 2023-04-06 04:06:04,198 epoch 105 - iter 1855/2650 - loss 0.04750957 - time (sec): 127.45 - samples/sec: 8035.09 - lr: 0.050000 2023-04-06 04:06:22,593 epoch 105 - iter 2120/2650 - loss 0.04749908 - time (sec): 145.85 - samples/sec: 8014.15 - lr: 0.050000 2023-04-06 04:06:41,101 epoch 105 - iter 2385/2650 - loss 0.04757905 - time (sec): 164.36 - samples/sec: 7994.62 - lr: 0.050000 2023-04-06 04:06:59,914 epoch 105 - iter 2650/2650 - loss 0.04762666 - time (sec): 183.17 - samples/sec: 7983.63 - lr: 0.050000 2023-04-06 04:06:59,915 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:06:59,915 EPOCH 105 done: loss 0.0476 - lr 0.050000 2023-04-06 04:06:59,915 Epoch 105: reducing learning rate of group 0 to 2.5000e-02. 2023-04-06 04:06:59,915 BAD EPOCHS (no improvement): 4 2023-04-06 04:06:59,918 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:07:18,327 epoch 106 - iter 265/2650 - loss 0.04551663 - time (sec): 18.41 - samples/sec: 7987.25 - lr: 0.025000 2023-04-06 04:07:36,684 epoch 106 - iter 530/2650 - loss 0.04649606 - time (sec): 36.77 - samples/sec: 8005.32 - lr: 0.025000 2023-04-06 04:07:54,953 epoch 106 - iter 795/2650 - loss 0.04603729 - time (sec): 55.04 - samples/sec: 8007.25 - lr: 0.025000 2023-04-06 04:08:12,442 epoch 106 - iter 1060/2650 - loss 0.04590254 - time (sec): 72.52 - samples/sec: 8085.17 - lr: 0.025000 2023-04-06 04:08:30,401 epoch 106 - iter 1325/2650 - loss 0.04597329 - time (sec): 90.48 - samples/sec: 8086.29 - lr: 0.025000 2023-04-06 04:08:48,536 epoch 106 - iter 1590/2650 - loss 0.04605641 - time (sec): 108.62 - samples/sec: 8077.08 - lr: 0.025000 2023-04-06 04:09:06,460 epoch 106 - iter 1855/2650 - loss 0.04610915 - time (sec): 126.54 - samples/sec: 8075.26 - lr: 0.025000 2023-04-06 04:09:25,163 epoch 106 - iter 2120/2650 - loss 0.04616748 - time (sec): 145.25 - samples/sec: 8053.85 - lr: 0.025000 2023-04-06 04:09:44,031 epoch 106 - iter 2385/2650 - loss 0.04600844 - time (sec): 164.11 - samples/sec: 8021.49 - lr: 0.025000 2023-04-06 04:10:02,720 epoch 106 - iter 2650/2650 - loss 0.04608004 - time (sec): 182.80 - samples/sec: 7999.72 - lr: 0.025000 2023-04-06 04:10:02,720 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:10:02,720 EPOCH 106 done: loss 0.0461 - lr 0.025000 2023-04-06 04:10:02,720 BAD EPOCHS (no improvement): 0 2023-04-06 04:10:02,723 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:10:21,212 epoch 107 - iter 265/2650 - loss 0.04482224 - time (sec): 18.49 - samples/sec: 7887.43 - lr: 0.025000 2023-04-06 04:10:39,386 epoch 107 - iter 530/2650 - loss 0.04500998 - time (sec): 36.66 - samples/sec: 7960.99 - lr: 0.025000 2023-04-06 04:10:57,595 epoch 107 - iter 795/2650 - loss 0.04478491 - time (sec): 54.87 - samples/sec: 8002.77 - lr: 0.025000 2023-04-06 04:11:15,514 epoch 107 - iter 1060/2650 - loss 0.04479046 - time (sec): 72.79 - samples/sec: 8036.64 - lr: 0.025000 2023-04-06 04:11:33,641 epoch 107 - iter 1325/2650 - loss 0.04459848 - time (sec): 90.92 - samples/sec: 8042.31 - lr: 0.025000 2023-04-06 04:11:51,633 epoch 107 - iter 1590/2650 - loss 0.04468272 - time (sec): 108.91 - samples/sec: 8052.06 - lr: 0.025000 2023-04-06 04:12:09,980 epoch 107 - iter 1855/2650 - loss 0.04478481 - time (sec): 127.26 - samples/sec: 8034.20 - lr: 0.025000 2023-04-06 04:12:28,521 epoch 107 - iter 2120/2650 - loss 0.04482768 - time (sec): 145.80 - samples/sec: 8019.42 - lr: 0.025000 2023-04-06 04:12:47,046 epoch 107 - iter 2385/2650 - loss 0.04498697 - time (sec): 164.32 - samples/sec: 8009.95 - lr: 0.025000 2023-04-06 04:13:05,505 epoch 107 - iter 2650/2650 - loss 0.04510519 - time (sec): 182.78 - samples/sec: 8000.61 - lr: 0.025000 2023-04-06 04:13:05,505 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:13:05,505 EPOCH 107 done: loss 0.0451 - lr 0.025000 2023-04-06 04:13:05,505 BAD EPOCHS (no improvement): 0 2023-04-06 04:13:05,508 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:13:23,687 epoch 108 - iter 265/2650 - loss 0.04395895 - time (sec): 18.18 - samples/sec: 7896.40 - lr: 0.025000 2023-04-06 04:13:41,788 epoch 108 - iter 530/2650 - loss 0.04362439 - time (sec): 36.28 - samples/sec: 7996.24 - lr: 0.025000 2023-04-06 04:14:00,554 epoch 108 - iter 795/2650 - loss 0.04336852 - time (sec): 55.05 - samples/sec: 7954.88 - lr: 0.025000 2023-04-06 04:14:18,956 epoch 108 - iter 1060/2650 - loss 0.04345794 - time (sec): 73.45 - samples/sec: 7958.72 - lr: 0.025000 2023-04-06 04:14:37,383 epoch 108 - iter 1325/2650 - loss 0.04382442 - time (sec): 91.88 - samples/sec: 7951.78 - lr: 0.025000 2023-04-06 04:14:55,677 epoch 108 - iter 1590/2650 - loss 0.04415271 - time (sec): 110.17 - samples/sec: 7960.26 - lr: 0.025000 2023-04-06 04:15:14,325 epoch 108 - iter 1855/2650 - loss 0.04444747 - time (sec): 128.82 - samples/sec: 7949.04 - lr: 0.025000 2023-04-06 04:15:33,076 epoch 108 - iter 2120/2650 - loss 0.04446795 - time (sec): 147.57 - samples/sec: 7946.56 - lr: 0.025000 2023-04-06 04:15:50,923 epoch 108 - iter 2385/2650 - loss 0.04454823 - time (sec): 165.42 - samples/sec: 7958.50 - lr: 0.025000 2023-04-06 04:16:08,702 epoch 108 - iter 2650/2650 - loss 0.04457170 - time (sec): 183.19 - samples/sec: 7982.60 - lr: 0.025000 2023-04-06 04:16:08,702 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:16:08,702 EPOCH 108 done: loss 0.0446 - lr 0.025000 2023-04-06 04:16:08,702 BAD EPOCHS (no improvement): 0 2023-04-06 04:16:08,705 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:16:26,672 epoch 109 - iter 265/2650 - loss 0.04412026 - time (sec): 17.97 - samples/sec: 8168.17 - lr: 0.025000 2023-04-06 04:16:44,944 epoch 109 - iter 530/2650 - loss 0.04398831 - time (sec): 36.24 - samples/sec: 8089.19 - lr: 0.025000 2023-04-06 04:17:02,607 epoch 109 - iter 795/2650 - loss 0.04415269 - time (sec): 53.90 - samples/sec: 8148.72 - lr: 0.025000 2023-04-06 04:17:20,411 epoch 109 - iter 1060/2650 - loss 0.04444566 - time (sec): 71.71 - samples/sec: 8145.18 - lr: 0.025000 2023-04-06 04:17:38,385 epoch 109 - iter 1325/2650 - loss 0.04432307 - time (sec): 89.68 - samples/sec: 8127.81 - lr: 0.025000 2023-04-06 04:17:56,462 epoch 109 - iter 1590/2650 - loss 0.04444232 - time (sec): 107.76 - samples/sec: 8125.36 - lr: 0.025000 2023-04-06 04:18:14,794 epoch 109 - iter 1855/2650 - loss 0.04459992 - time (sec): 126.09 - samples/sec: 8110.82 - lr: 0.025000 2023-04-06 04:18:33,059 epoch 109 - iter 2120/2650 - loss 0.04449346 - time (sec): 144.35 - samples/sec: 8105.43 - lr: 0.025000 2023-04-06 04:18:50,775 epoch 109 - iter 2385/2650 - loss 0.04456122 - time (sec): 162.07 - samples/sec: 8124.48 - lr: 0.025000 2023-04-06 04:19:08,516 epoch 109 - iter 2650/2650 - loss 0.04459815 - time (sec): 179.81 - samples/sec: 8132.80 - lr: 0.025000 2023-04-06 04:19:08,516 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:19:08,516 EPOCH 109 done: loss 0.0446 - lr 0.025000 2023-04-06 04:19:08,516 BAD EPOCHS (no improvement): 1 2023-04-06 04:19:08,519 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:19:26,620 epoch 110 - iter 265/2650 - loss 0.04345952 - time (sec): 18.10 - samples/sec: 8126.04 - lr: 0.025000 2023-04-06 04:19:44,895 epoch 110 - iter 530/2650 - loss 0.04379406 - time (sec): 36.38 - samples/sec: 8072.29 - lr: 0.025000 2023-04-06 04:20:02,806 epoch 110 - iter 795/2650 - loss 0.04349661 - time (sec): 54.29 - samples/sec: 8082.02 - lr: 0.025000 2023-04-06 04:20:21,005 epoch 110 - iter 1060/2650 - loss 0.04380797 - time (sec): 72.49 - samples/sec: 8068.17 - lr: 0.025000 2023-04-06 04:20:38,676 epoch 110 - iter 1325/2650 - loss 0.04388880 - time (sec): 90.16 - samples/sec: 8098.58 - lr: 0.025000 2023-04-06 04:20:56,829 epoch 110 - iter 1590/2650 - loss 0.04418626 - time (sec): 108.31 - samples/sec: 8090.65 - lr: 0.025000 2023-04-06 04:21:14,975 epoch 110 - iter 1855/2650 - loss 0.04414037 - time (sec): 126.46 - samples/sec: 8094.63 - lr: 0.025000 2023-04-06 04:21:32,695 epoch 110 - iter 2120/2650 - loss 0.04426175 - time (sec): 144.18 - samples/sec: 8113.90 - lr: 0.025000 2023-04-06 04:21:50,614 epoch 110 - iter 2385/2650 - loss 0.04431319 - time (sec): 162.09 - samples/sec: 8114.18 - lr: 0.025000 2023-04-06 04:22:08,623 epoch 110 - iter 2650/2650 - loss 0.04423836 - time (sec): 180.10 - samples/sec: 8119.53 - lr: 0.025000 2023-04-06 04:22:08,623 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:22:08,623 EPOCH 110 done: loss 0.0442 - lr 0.025000 2023-04-06 04:22:08,623 BAD EPOCHS (no improvement): 0 2023-04-06 04:22:08,626 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:22:27,014 epoch 111 - iter 265/2650 - loss 0.04268702 - time (sec): 18.39 - samples/sec: 8034.24 - lr: 0.025000 2023-04-06 04:22:44,983 epoch 111 - iter 530/2650 - loss 0.04330456 - time (sec): 36.36 - samples/sec: 8075.88 - lr: 0.025000 2023-04-06 04:23:02,706 epoch 111 - iter 795/2650 - loss 0.04394255 - time (sec): 54.08 - samples/sec: 8101.24 - lr: 0.025000 2023-04-06 04:23:20,994 epoch 111 - iter 1060/2650 - loss 0.04375844 - time (sec): 72.37 - samples/sec: 8106.55 - lr: 0.025000 2023-04-06 04:23:39,288 epoch 111 - iter 1325/2650 - loss 0.04384316 - time (sec): 90.66 - samples/sec: 8089.63 - lr: 0.025000 2023-04-06 04:23:57,185 epoch 111 - iter 1590/2650 - loss 0.04375278 - time (sec): 108.56 - samples/sec: 8094.69 - lr: 0.025000 2023-04-06 04:24:15,399 epoch 111 - iter 1855/2650 - loss 0.04370542 - time (sec): 126.77 - samples/sec: 8088.35 - lr: 0.025000 2023-04-06 04:24:33,600 epoch 111 - iter 2120/2650 - loss 0.04369177 - time (sec): 144.97 - samples/sec: 8086.52 - lr: 0.025000 2023-04-06 04:24:51,544 epoch 111 - iter 2385/2650 - loss 0.04366418 - time (sec): 162.92 - samples/sec: 8087.92 - lr: 0.025000 2023-04-06 04:25:09,352 epoch 111 - iter 2650/2650 - loss 0.04382308 - time (sec): 180.73 - samples/sec: 8091.61 - lr: 0.025000 2023-04-06 04:25:09,352 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:25:09,352 EPOCH 111 done: loss 0.0438 - lr 0.025000 2023-04-06 04:25:09,353 BAD EPOCHS (no improvement): 0 2023-04-06 04:25:09,357 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:25:27,368 epoch 112 - iter 265/2650 - loss 0.04270160 - time (sec): 18.01 - samples/sec: 8083.31 - lr: 0.025000 2023-04-06 04:25:45,488 epoch 112 - iter 530/2650 - loss 0.04319709 - time (sec): 36.13 - samples/sec: 8103.47 - lr: 0.025000 2023-04-06 04:26:03,648 epoch 112 - iter 795/2650 - loss 0.04335198 - time (sec): 54.29 - samples/sec: 8067.16 - lr: 0.025000 2023-04-06 04:26:21,877 epoch 112 - iter 1060/2650 - loss 0.04308320 - time (sec): 72.52 - samples/sec: 8085.19 - lr: 0.025000 2023-04-06 04:26:40,011 epoch 112 - iter 1325/2650 - loss 0.04313533 - time (sec): 90.65 - samples/sec: 8081.48 - lr: 0.025000 2023-04-06 04:26:58,636 epoch 112 - iter 1590/2650 - loss 0.04292820 - time (sec): 109.28 - samples/sec: 8038.50 - lr: 0.025000 2023-04-06 04:27:17,580 epoch 112 - iter 1855/2650 - loss 0.04309055 - time (sec): 128.22 - samples/sec: 7994.00 - lr: 0.025000 2023-04-06 04:27:35,623 epoch 112 - iter 2120/2650 - loss 0.04315619 - time (sec): 146.27 - samples/sec: 8004.44 - lr: 0.025000 2023-04-06 04:27:54,294 epoch 112 - iter 2385/2650 - loss 0.04322519 - time (sec): 164.94 - samples/sec: 7988.14 - lr: 0.025000 2023-04-06 04:28:12,020 epoch 112 - iter 2650/2650 - loss 0.04341380 - time (sec): 182.66 - samples/sec: 8005.81 - lr: 0.025000 2023-04-06 04:28:12,020 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:28:12,020 EPOCH 112 done: loss 0.0434 - lr 0.025000 2023-04-06 04:28:12,020 BAD EPOCHS (no improvement): 0 2023-04-06 04:28:12,024 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:28:30,426 epoch 113 - iter 265/2650 - loss 0.04295439 - time (sec): 18.40 - samples/sec: 7876.32 - lr: 0.025000 2023-04-06 04:28:48,722 epoch 113 - iter 530/2650 - loss 0.04323410 - time (sec): 36.70 - samples/sec: 7932.94 - lr: 0.025000 2023-04-06 04:29:06,756 epoch 113 - iter 795/2650 - loss 0.04268377 - time (sec): 54.73 - samples/sec: 7995.98 - lr: 0.025000 2023-04-06 04:29:25,288 epoch 113 - iter 1060/2650 - loss 0.04297082 - time (sec): 73.26 - samples/sec: 7977.95 - lr: 0.025000 2023-04-06 04:29:43,783 epoch 113 - iter 1325/2650 - loss 0.04312284 - time (sec): 91.76 - samples/sec: 7973.99 - lr: 0.025000 2023-04-06 04:30:02,275 epoch 113 - iter 1590/2650 - loss 0.04317102 - time (sec): 110.25 - samples/sec: 7972.25 - lr: 0.025000 2023-04-06 04:30:21,030 epoch 113 - iter 1855/2650 - loss 0.04309431 - time (sec): 129.01 - samples/sec: 7949.18 - lr: 0.025000 2023-04-06 04:30:39,566 epoch 113 - iter 2120/2650 - loss 0.04331969 - time (sec): 147.54 - samples/sec: 7941.43 - lr: 0.025000 2023-04-06 04:30:57,429 epoch 113 - iter 2385/2650 - loss 0.04336798 - time (sec): 165.40 - samples/sec: 7958.93 - lr: 0.025000 2023-04-06 04:31:15,439 epoch 113 - iter 2650/2650 - loss 0.04341491 - time (sec): 183.42 - samples/sec: 7972.97 - lr: 0.025000 2023-04-06 04:31:15,439 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:31:15,439 EPOCH 113 done: loss 0.0434 - lr 0.025000 2023-04-06 04:31:15,439 BAD EPOCHS (no improvement): 1 2023-04-06 04:31:15,443 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:31:33,703 epoch 114 - iter 265/2650 - loss 0.04248511 - time (sec): 18.26 - samples/sec: 8111.23 - lr: 0.025000 2023-04-06 04:31:52,184 epoch 114 - iter 530/2650 - loss 0.04315675 - time (sec): 36.74 - samples/sec: 7993.40 - lr: 0.025000 2023-04-06 04:32:10,184 epoch 114 - iter 795/2650 - loss 0.04335585 - time (sec): 54.74 - samples/sec: 8027.94 - lr: 0.025000 2023-04-06 04:32:28,689 epoch 114 - iter 1060/2650 - loss 0.04272036 - time (sec): 73.25 - samples/sec: 8013.39 - lr: 0.025000 2023-04-06 04:32:47,185 epoch 114 - iter 1325/2650 - loss 0.04270860 - time (sec): 91.74 - samples/sec: 7987.91 - lr: 0.025000 2023-04-06 04:33:05,233 epoch 114 - iter 1590/2650 - loss 0.04269070 - time (sec): 109.79 - samples/sec: 8010.35 - lr: 0.025000 2023-04-06 04:33:22,854 epoch 114 - iter 1855/2650 - loss 0.04274124 - time (sec): 127.41 - samples/sec: 8037.12 - lr: 0.025000 2023-04-06 04:33:40,522 epoch 114 - iter 2120/2650 - loss 0.04253070 - time (sec): 145.08 - samples/sec: 8063.88 - lr: 0.025000 2023-04-06 04:33:58,684 epoch 114 - iter 2385/2650 - loss 0.04244050 - time (sec): 163.24 - samples/sec: 8066.11 - lr: 0.025000 2023-04-06 04:34:16,701 epoch 114 - iter 2650/2650 - loss 0.04262765 - time (sec): 181.26 - samples/sec: 8067.86 - lr: 0.025000 2023-04-06 04:34:16,701 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:34:16,701 EPOCH 114 done: loss 0.0426 - lr 0.025000 2023-04-06 04:34:16,701 BAD EPOCHS (no improvement): 0 2023-04-06 04:34:16,704 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:34:35,221 epoch 115 - iter 265/2650 - loss 0.04262866 - time (sec): 18.52 - samples/sec: 8000.17 - lr: 0.025000 2023-04-06 04:34:53,341 epoch 115 - iter 530/2650 - loss 0.04254904 - time (sec): 36.64 - samples/sec: 8064.62 - lr: 0.025000 2023-04-06 04:35:11,413 epoch 115 - iter 795/2650 - loss 0.04239436 - time (sec): 54.71 - samples/sec: 8087.87 - lr: 0.025000 2023-04-06 04:35:29,357 epoch 115 - iter 1060/2650 - loss 0.04275485 - time (sec): 72.65 - samples/sec: 8084.30 - lr: 0.025000 2023-04-06 04:35:47,340 epoch 115 - iter 1325/2650 - loss 0.04317636 - time (sec): 90.64 - samples/sec: 8101.58 - lr: 0.025000 2023-04-06 04:36:05,212 epoch 115 - iter 1590/2650 - loss 0.04307193 - time (sec): 108.51 - samples/sec: 8106.40 - lr: 0.025000 2023-04-06 04:36:23,134 epoch 115 - iter 1855/2650 - loss 0.04327825 - time (sec): 126.43 - samples/sec: 8104.00 - lr: 0.025000 2023-04-06 04:36:41,093 epoch 115 - iter 2120/2650 - loss 0.04315688 - time (sec): 144.39 - samples/sec: 8104.62 - lr: 0.025000 2023-04-06 04:36:59,187 epoch 115 - iter 2385/2650 - loss 0.04326803 - time (sec): 162.48 - samples/sec: 8097.36 - lr: 0.025000 2023-04-06 04:37:17,365 epoch 115 - iter 2650/2650 - loss 0.04348757 - time (sec): 180.66 - samples/sec: 8094.51 - lr: 0.025000 2023-04-06 04:37:17,366 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:37:17,366 EPOCH 115 done: loss 0.0435 - lr 0.025000 2023-04-06 04:37:17,366 BAD EPOCHS (no improvement): 1 2023-04-06 04:37:17,369 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:37:35,766 epoch 116 - iter 265/2650 - loss 0.04427533 - time (sec): 18.40 - samples/sec: 7959.76 - lr: 0.025000 2023-04-06 04:37:53,985 epoch 116 - iter 530/2650 - loss 0.04342067 - time (sec): 36.62 - samples/sec: 7961.77 - lr: 0.025000 2023-04-06 04:38:12,182 epoch 116 - iter 795/2650 - loss 0.04322347 - time (sec): 54.81 - samples/sec: 7999.07 - lr: 0.025000 2023-04-06 04:38:29,910 epoch 116 - iter 1060/2650 - loss 0.04329120 - time (sec): 72.54 - samples/sec: 8057.21 - lr: 0.025000 2023-04-06 04:38:48,173 epoch 116 - iter 1325/2650 - loss 0.04310871 - time (sec): 90.80 - samples/sec: 8070.51 - lr: 0.025000 2023-04-06 04:39:06,250 epoch 116 - iter 1590/2650 - loss 0.04322220 - time (sec): 108.88 - samples/sec: 8073.65 - lr: 0.025000 2023-04-06 04:39:24,463 epoch 116 - iter 1855/2650 - loss 0.04343240 - time (sec): 127.09 - samples/sec: 8064.77 - lr: 0.025000 2023-04-06 04:39:42,596 epoch 116 - iter 2120/2650 - loss 0.04326037 - time (sec): 145.23 - samples/sec: 8048.21 - lr: 0.025000 2023-04-06 04:40:01,122 epoch 116 - iter 2385/2650 - loss 0.04330301 - time (sec): 163.75 - samples/sec: 8022.33 - lr: 0.025000 2023-04-06 04:40:19,965 epoch 116 - iter 2650/2650 - loss 0.04323531 - time (sec): 182.60 - samples/sec: 8008.76 - lr: 0.025000 2023-04-06 04:40:19,965 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:40:19,965 EPOCH 116 done: loss 0.0432 - lr 0.025000 2023-04-06 04:40:19,965 BAD EPOCHS (no improvement): 2 2023-04-06 04:40:19,968 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:40:37,723 epoch 117 - iter 265/2650 - loss 0.04405245 - time (sec): 17.75 - samples/sec: 8094.06 - lr: 0.025000 2023-04-06 04:40:56,036 epoch 117 - iter 530/2650 - loss 0.04232235 - time (sec): 36.07 - samples/sec: 8117.44 - lr: 0.025000 2023-04-06 04:41:13,805 epoch 117 - iter 795/2650 - loss 0.04285583 - time (sec): 53.84 - samples/sec: 8133.11 - lr: 0.025000 2023-04-06 04:41:32,248 epoch 117 - iter 1060/2650 - loss 0.04260361 - time (sec): 72.28 - samples/sec: 8096.96 - lr: 0.025000 2023-04-06 04:41:50,327 epoch 117 - iter 1325/2650 - loss 0.04283874 - time (sec): 90.36 - samples/sec: 8106.32 - lr: 0.025000 2023-04-06 04:42:08,128 epoch 117 - iter 1590/2650 - loss 0.04281910 - time (sec): 108.16 - samples/sec: 8130.58 - lr: 0.025000 2023-04-06 04:42:26,706 epoch 117 - iter 1855/2650 - loss 0.04288861 - time (sec): 126.74 - samples/sec: 8093.69 - lr: 0.025000 2023-04-06 04:42:44,812 epoch 117 - iter 2120/2650 - loss 0.04292590 - time (sec): 144.84 - samples/sec: 8092.39 - lr: 0.025000 2023-04-06 04:43:02,802 epoch 117 - iter 2385/2650 - loss 0.04278018 - time (sec): 162.83 - samples/sec: 8099.16 - lr: 0.025000 2023-04-06 04:43:20,371 epoch 117 - iter 2650/2650 - loss 0.04271903 - time (sec): 180.40 - samples/sec: 8106.09 - lr: 0.025000 2023-04-06 04:43:20,371 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:43:20,371 EPOCH 117 done: loss 0.0427 - lr 0.025000 2023-04-06 04:43:20,371 BAD EPOCHS (no improvement): 3 2023-04-06 04:43:20,374 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:43:38,300 epoch 118 - iter 265/2650 - loss 0.04279618 - time (sec): 17.93 - samples/sec: 8119.49 - lr: 0.025000 2023-04-06 04:43:56,642 epoch 118 - iter 530/2650 - loss 0.04255079 - time (sec): 36.27 - samples/sec: 8079.50 - lr: 0.025000 2023-04-06 04:44:14,932 epoch 118 - iter 795/2650 - loss 0.04250824 - time (sec): 54.56 - samples/sec: 8080.33 - lr: 0.025000 2023-04-06 04:44:32,910 epoch 118 - iter 1060/2650 - loss 0.04241321 - time (sec): 72.54 - samples/sec: 8088.92 - lr: 0.025000 2023-04-06 04:44:50,995 epoch 118 - iter 1325/2650 - loss 0.04225431 - time (sec): 90.62 - samples/sec: 8077.59 - lr: 0.025000 2023-04-06 04:45:09,453 epoch 118 - iter 1590/2650 - loss 0.04200403 - time (sec): 109.08 - samples/sec: 8045.18 - lr: 0.025000 2023-04-06 04:45:27,760 epoch 118 - iter 1855/2650 - loss 0.04216767 - time (sec): 127.39 - samples/sec: 8027.22 - lr: 0.025000 2023-04-06 04:45:46,434 epoch 118 - iter 2120/2650 - loss 0.04231970 - time (sec): 146.06 - samples/sec: 8004.99 - lr: 0.025000 2023-04-06 04:46:05,459 epoch 118 - iter 2385/2650 - loss 0.04241115 - time (sec): 165.09 - samples/sec: 7975.31 - lr: 0.025000 2023-04-06 04:46:23,925 epoch 118 - iter 2650/2650 - loss 0.04249940 - time (sec): 183.55 - samples/sec: 7967.08 - lr: 0.025000 2023-04-06 04:46:23,925 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:46:23,925 EPOCH 118 done: loss 0.0425 - lr 0.025000 2023-04-06 04:46:23,925 BAD EPOCHS (no improvement): 0 2023-04-06 04:46:23,928 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:46:42,244 epoch 119 - iter 265/2650 - loss 0.04208365 - time (sec): 18.32 - samples/sec: 7997.04 - lr: 0.025000 2023-04-06 04:47:01,026 epoch 119 - iter 530/2650 - loss 0.04258000 - time (sec): 37.10 - samples/sec: 7926.73 - lr: 0.025000 2023-04-06 04:47:18,905 epoch 119 - iter 795/2650 - loss 0.04242651 - time (sec): 54.98 - samples/sec: 8015.25 - lr: 0.025000 2023-04-06 04:47:36,743 epoch 119 - iter 1060/2650 - loss 0.04250976 - time (sec): 72.82 - samples/sec: 8065.61 - lr: 0.025000 2023-04-06 04:47:54,668 epoch 119 - iter 1325/2650 - loss 0.04252304 - time (sec): 90.74 - samples/sec: 8062.09 - lr: 0.025000 2023-04-06 04:48:13,054 epoch 119 - iter 1590/2650 - loss 0.04255887 - time (sec): 109.13 - samples/sec: 8051.73 - lr: 0.025000 2023-04-06 04:48:30,935 epoch 119 - iter 1855/2650 - loss 0.04277932 - time (sec): 127.01 - samples/sec: 8060.79 - lr: 0.025000 2023-04-06 04:48:48,823 epoch 119 - iter 2120/2650 - loss 0.04260319 - time (sec): 144.90 - samples/sec: 8065.57 - lr: 0.025000 2023-04-06 04:49:06,970 epoch 119 - iter 2385/2650 - loss 0.04266457 - time (sec): 163.04 - samples/sec: 8069.05 - lr: 0.025000 2023-04-06 04:49:25,093 epoch 119 - iter 2650/2650 - loss 0.04270457 - time (sec): 181.17 - samples/sec: 8071.99 - lr: 0.025000 2023-04-06 04:49:25,093 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:49:25,093 EPOCH 119 done: loss 0.0427 - lr 0.025000 2023-04-06 04:49:25,093 BAD EPOCHS (no improvement): 1 2023-04-06 04:49:25,097 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:49:43,241 epoch 120 - iter 265/2650 - loss 0.04267155 - time (sec): 18.14 - samples/sec: 8164.93 - lr: 0.025000 2023-04-06 04:50:01,079 epoch 120 - iter 530/2650 - loss 0.04232981 - time (sec): 35.98 - samples/sec: 8134.96 - lr: 0.025000 2023-04-06 04:50:18,949 epoch 120 - iter 795/2650 - loss 0.04161974 - time (sec): 53.85 - samples/sec: 8142.42 - lr: 0.025000 2023-04-06 04:50:37,302 epoch 120 - iter 1060/2650 - loss 0.04172537 - time (sec): 72.21 - samples/sec: 8102.24 - lr: 0.025000 2023-04-06 04:50:55,075 epoch 120 - iter 1325/2650 - loss 0.04218673 - time (sec): 89.98 - samples/sec: 8120.83 - lr: 0.025000 2023-04-06 04:51:13,227 epoch 120 - iter 1590/2650 - loss 0.04226349 - time (sec): 108.13 - samples/sec: 8128.04 - lr: 0.025000 2023-04-06 04:51:31,247 epoch 120 - iter 1855/2650 - loss 0.04222553 - time (sec): 126.15 - samples/sec: 8127.88 - lr: 0.025000 2023-04-06 04:51:49,278 epoch 120 - iter 2120/2650 - loss 0.04223122 - time (sec): 144.18 - samples/sec: 8118.90 - lr: 0.025000 2023-04-06 04:52:07,017 epoch 120 - iter 2385/2650 - loss 0.04211219 - time (sec): 161.92 - samples/sec: 8115.52 - lr: 0.025000 2023-04-06 04:52:25,068 epoch 120 - iter 2650/2650 - loss 0.04233568 - time (sec): 179.97 - samples/sec: 8125.52 - lr: 0.025000 2023-04-06 04:52:25,069 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:52:25,069 EPOCH 120 done: loss 0.0423 - lr 0.025000 2023-04-06 04:52:25,069 BAD EPOCHS (no improvement): 0 2023-04-06 04:52:25,072 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:52:42,876 epoch 121 - iter 265/2650 - loss 0.04108449 - time (sec): 17.80 - samples/sec: 8257.88 - lr: 0.025000 2023-04-06 04:53:01,391 epoch 121 - iter 530/2650 - loss 0.04130651 - time (sec): 36.32 - samples/sec: 8111.16 - lr: 0.025000 2023-04-06 04:53:19,488 epoch 121 - iter 795/2650 - loss 0.04156748 - time (sec): 54.42 - samples/sec: 8083.92 - lr: 0.025000 2023-04-06 04:53:38,118 epoch 121 - iter 1060/2650 - loss 0.04169693 - time (sec): 73.05 - samples/sec: 8004.23 - lr: 0.025000 2023-04-06 04:53:55,792 epoch 121 - iter 1325/2650 - loss 0.04201300 - time (sec): 90.72 - samples/sec: 8046.29 - lr: 0.025000 2023-04-06 04:54:13,818 epoch 121 - iter 1590/2650 - loss 0.04200712 - time (sec): 108.75 - samples/sec: 8064.12 - lr: 0.025000 2023-04-06 04:54:31,769 epoch 121 - iter 1855/2650 - loss 0.04194813 - time (sec): 126.70 - samples/sec: 8078.62 - lr: 0.025000 2023-04-06 04:54:50,037 epoch 121 - iter 2120/2650 - loss 0.04193202 - time (sec): 144.96 - samples/sec: 8080.00 - lr: 0.025000 2023-04-06 04:55:08,489 epoch 121 - iter 2385/2650 - loss 0.04198928 - time (sec): 163.42 - samples/sec: 8066.52 - lr: 0.025000 2023-04-06 04:55:26,023 epoch 121 - iter 2650/2650 - loss 0.04204605 - time (sec): 180.95 - samples/sec: 8081.53 - lr: 0.025000 2023-04-06 04:55:26,024 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:55:26,024 EPOCH 121 done: loss 0.0420 - lr 0.025000 2023-04-06 04:55:26,024 BAD EPOCHS (no improvement): 0 2023-04-06 04:55:26,027 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:55:44,577 epoch 122 - iter 265/2650 - loss 0.04132788 - time (sec): 18.55 - samples/sec: 7932.58 - lr: 0.025000 2023-04-06 04:56:02,393 epoch 122 - iter 530/2650 - loss 0.04180976 - time (sec): 36.37 - samples/sec: 8025.72 - lr: 0.025000 2023-04-06 04:56:20,622 epoch 122 - iter 795/2650 - loss 0.04157192 - time (sec): 54.60 - samples/sec: 8023.84 - lr: 0.025000 2023-04-06 04:56:38,719 epoch 122 - iter 1060/2650 - loss 0.04140646 - time (sec): 72.69 - samples/sec: 8037.32 - lr: 0.025000 2023-04-06 04:56:56,450 epoch 122 - iter 1325/2650 - loss 0.04127369 - time (sec): 90.42 - samples/sec: 8075.30 - lr: 0.025000 2023-04-06 04:57:14,212 epoch 122 - iter 1590/2650 - loss 0.04146170 - time (sec): 108.18 - samples/sec: 8100.85 - lr: 0.025000 2023-04-06 04:57:31,962 epoch 122 - iter 1855/2650 - loss 0.04176803 - time (sec): 125.93 - samples/sec: 8117.48 - lr: 0.025000 2023-04-06 04:57:50,197 epoch 122 - iter 2120/2650 - loss 0.04177495 - time (sec): 144.17 - samples/sec: 8106.21 - lr: 0.025000 2023-04-06 04:58:08,349 epoch 122 - iter 2385/2650 - loss 0.04190375 - time (sec): 162.32 - samples/sec: 8107.39 - lr: 0.025000 2023-04-06 04:58:26,350 epoch 122 - iter 2650/2650 - loss 0.04190610 - time (sec): 180.32 - samples/sec: 8109.72 - lr: 0.025000 2023-04-06 04:58:26,350 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:58:26,350 EPOCH 122 done: loss 0.0419 - lr 0.025000 2023-04-06 04:58:26,350 BAD EPOCHS (no improvement): 0 2023-04-06 04:58:26,353 ---------------------------------------------------------------------------------------------------- 2023-04-06 04:58:44,228 epoch 123 - iter 265/2650 - loss 0.04202661 - time (sec): 17.87 - samples/sec: 8133.40 - lr: 0.025000 2023-04-06 04:59:02,361 epoch 123 - iter 530/2650 - loss 0.04124928 - time (sec): 36.01 - samples/sec: 8127.22 - lr: 0.025000 2023-04-06 04:59:20,611 epoch 123 - iter 795/2650 - loss 0.04115432 - time (sec): 54.26 - samples/sec: 8104.87 - lr: 0.025000 2023-04-06 04:59:38,592 epoch 123 - iter 1060/2650 - loss 0.04104334 - time (sec): 72.24 - samples/sec: 8110.27 - lr: 0.025000 2023-04-06 04:59:56,434 epoch 123 - iter 1325/2650 - loss 0.04128750 - time (sec): 90.08 - samples/sec: 8129.51 - lr: 0.025000 2023-04-06 05:00:14,572 epoch 123 - iter 1590/2650 - loss 0.04146664 - time (sec): 108.22 - samples/sec: 8115.24 - lr: 0.025000 2023-04-06 05:00:32,510 epoch 123 - iter 1855/2650 - loss 0.04138405 - time (sec): 126.16 - samples/sec: 8111.70 - lr: 0.025000 2023-04-06 05:00:50,503 epoch 123 - iter 2120/2650 - loss 0.04144656 - time (sec): 144.15 - samples/sec: 8116.67 - lr: 0.025000 2023-04-06 05:01:08,579 epoch 123 - iter 2385/2650 - loss 0.04149168 - time (sec): 162.23 - samples/sec: 8113.17 - lr: 0.025000 2023-04-06 05:01:26,496 epoch 123 - iter 2650/2650 - loss 0.04153736 - time (sec): 180.14 - samples/sec: 8117.81 - lr: 0.025000 2023-04-06 05:01:26,496 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:01:26,496 EPOCH 123 done: loss 0.0415 - lr 0.025000 2023-04-06 05:01:26,496 BAD EPOCHS (no improvement): 0 2023-04-06 05:01:26,500 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:01:44,501 epoch 124 - iter 265/2650 - loss 0.04047018 - time (sec): 18.00 - samples/sec: 8047.90 - lr: 0.025000 2023-04-06 05:02:01,980 epoch 124 - iter 530/2650 - loss 0.04123988 - time (sec): 35.48 - samples/sec: 8158.41 - lr: 0.025000 2023-04-06 05:02:20,046 epoch 124 - iter 795/2650 - loss 0.04126662 - time (sec): 53.55 - samples/sec: 8118.25 - lr: 0.025000 2023-04-06 05:02:38,341 epoch 124 - iter 1060/2650 - loss 0.04197466 - time (sec): 71.84 - samples/sec: 8118.43 - lr: 0.025000 2023-04-06 05:02:56,515 epoch 124 - iter 1325/2650 - loss 0.04202347 - time (sec): 90.01 - samples/sec: 8098.60 - lr: 0.025000 2023-04-06 05:03:14,443 epoch 124 - iter 1590/2650 - loss 0.04193178 - time (sec): 107.94 - samples/sec: 8111.48 - lr: 0.025000 2023-04-06 05:03:32,672 epoch 124 - iter 1855/2650 - loss 0.04189097 - time (sec): 126.17 - samples/sec: 8110.09 - lr: 0.025000 2023-04-06 05:03:50,657 epoch 124 - iter 2120/2650 - loss 0.04181159 - time (sec): 144.16 - samples/sec: 8106.73 - lr: 0.025000 2023-04-06 05:04:09,092 epoch 124 - iter 2385/2650 - loss 0.04179300 - time (sec): 162.59 - samples/sec: 8091.42 - lr: 0.025000 2023-04-06 05:04:27,246 epoch 124 - iter 2650/2650 - loss 0.04176773 - time (sec): 180.75 - samples/sec: 8090.71 - lr: 0.025000 2023-04-06 05:04:27,246 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:04:27,246 EPOCH 124 done: loss 0.0418 - lr 0.025000 2023-04-06 05:04:27,247 BAD EPOCHS (no improvement): 1 2023-04-06 05:04:27,250 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:04:45,527 epoch 125 - iter 265/2650 - loss 0.04057869 - time (sec): 18.28 - samples/sec: 8081.91 - lr: 0.025000 2023-04-06 05:05:03,476 epoch 125 - iter 530/2650 - loss 0.04103677 - time (sec): 36.23 - samples/sec: 8116.60 - lr: 0.025000 2023-04-06 05:05:21,433 epoch 125 - iter 795/2650 - loss 0.04129135 - time (sec): 54.18 - samples/sec: 8099.10 - lr: 0.025000 2023-04-06 05:05:39,685 epoch 125 - iter 1060/2650 - loss 0.04126122 - time (sec): 72.43 - samples/sec: 8081.28 - lr: 0.025000 2023-04-06 05:05:58,016 epoch 125 - iter 1325/2650 - loss 0.04157105 - time (sec): 90.77 - samples/sec: 8057.27 - lr: 0.025000 2023-04-06 05:06:16,631 epoch 125 - iter 1590/2650 - loss 0.04159328 - time (sec): 109.38 - samples/sec: 8034.33 - lr: 0.025000 2023-04-06 05:06:34,842 epoch 125 - iter 1855/2650 - loss 0.04133822 - time (sec): 127.59 - samples/sec: 8025.51 - lr: 0.025000 2023-04-06 05:06:53,459 epoch 125 - iter 2120/2650 - loss 0.04142934 - time (sec): 146.21 - samples/sec: 8002.48 - lr: 0.025000 2023-04-06 05:07:11,831 epoch 125 - iter 2385/2650 - loss 0.04145102 - time (sec): 164.58 - samples/sec: 8004.99 - lr: 0.025000 2023-04-06 05:07:30,192 epoch 125 - iter 2650/2650 - loss 0.04158372 - time (sec): 182.94 - samples/sec: 7993.60 - lr: 0.025000 2023-04-06 05:07:30,192 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:07:30,192 EPOCH 125 done: loss 0.0416 - lr 0.025000 2023-04-06 05:07:30,192 BAD EPOCHS (no improvement): 2 2023-04-06 05:07:30,195 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:07:48,632 epoch 126 - iter 265/2650 - loss 0.03971127 - time (sec): 18.44 - samples/sec: 7922.69 - lr: 0.025000 2023-04-06 05:08:07,283 epoch 126 - iter 530/2650 - loss 0.04118161 - time (sec): 37.09 - samples/sec: 7853.32 - lr: 0.025000 2023-04-06 05:08:25,813 epoch 126 - iter 795/2650 - loss 0.04101840 - time (sec): 55.62 - samples/sec: 7885.47 - lr: 0.025000 2023-04-06 05:08:44,428 epoch 126 - iter 1060/2650 - loss 0.04120208 - time (sec): 74.23 - samples/sec: 7880.61 - lr: 0.025000 2023-04-06 05:09:02,995 epoch 126 - iter 1325/2650 - loss 0.04099383 - time (sec): 92.80 - samples/sec: 7870.74 - lr: 0.025000 2023-04-06 05:09:21,303 epoch 126 - iter 1590/2650 - loss 0.04112896 - time (sec): 111.11 - samples/sec: 7882.45 - lr: 0.025000 2023-04-06 05:09:40,062 epoch 126 - iter 1855/2650 - loss 0.04111930 - time (sec): 129.87 - samples/sec: 7877.84 - lr: 0.025000 2023-04-06 05:09:58,893 epoch 126 - iter 2120/2650 - loss 0.04108923 - time (sec): 148.70 - samples/sec: 7867.79 - lr: 0.025000 2023-04-06 05:10:28,917 epoch 126 - iter 2385/2650 - loss 0.04113743 - time (sec): 178.72 - samples/sec: 7372.54 - lr: 0.025000 2023-04-06 05:10:46,833 epoch 126 - iter 2650/2650 - loss 0.04122070 - time (sec): 196.64 - samples/sec: 7436.81 - lr: 0.025000 2023-04-06 05:10:46,833 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:10:46,833 EPOCH 126 done: loss 0.0412 - lr 0.025000 2023-04-06 05:10:46,833 BAD EPOCHS (no improvement): 0 2023-04-06 05:10:46,836 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:11:05,076 epoch 127 - iter 265/2650 - loss 0.04196854 - time (sec): 18.24 - samples/sec: 8014.39 - lr: 0.025000 2023-04-06 05:11:22,981 epoch 127 - iter 530/2650 - loss 0.04168999 - time (sec): 36.15 - samples/sec: 8077.96 - lr: 0.025000 2023-04-06 05:11:40,947 epoch 127 - iter 795/2650 - loss 0.04172919 - time (sec): 54.11 - samples/sec: 8100.36 - lr: 0.025000 2023-04-06 05:11:58,673 epoch 127 - iter 1060/2650 - loss 0.04126787 - time (sec): 71.84 - samples/sec: 8120.06 - lr: 0.025000 2023-04-06 05:12:16,624 epoch 127 - iter 1325/2650 - loss 0.04123738 - time (sec): 89.79 - samples/sec: 8131.46 - lr: 0.025000 2023-04-06 05:12:34,839 epoch 127 - iter 1590/2650 - loss 0.04109312 - time (sec): 108.00 - samples/sec: 8121.44 - lr: 0.025000 2023-04-06 05:12:52,775 epoch 127 - iter 1855/2650 - loss 0.04080250 - time (sec): 125.94 - samples/sec: 8124.00 - lr: 0.025000 2023-04-06 05:13:10,599 epoch 127 - iter 2120/2650 - loss 0.04097679 - time (sec): 143.76 - samples/sec: 8124.07 - lr: 0.025000 2023-04-06 05:13:28,744 epoch 127 - iter 2385/2650 - loss 0.04099346 - time (sec): 161.91 - samples/sec: 8131.60 - lr: 0.025000 2023-04-06 05:13:46,881 epoch 127 - iter 2650/2650 - loss 0.04103475 - time (sec): 180.04 - samples/sec: 8122.22 - lr: 0.025000 2023-04-06 05:13:46,881 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:13:46,881 EPOCH 127 done: loss 0.0410 - lr 0.025000 2023-04-06 05:13:46,881 BAD EPOCHS (no improvement): 0 2023-04-06 05:13:46,884 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:14:04,884 epoch 128 - iter 265/2650 - loss 0.04143519 - time (sec): 18.00 - samples/sec: 8107.52 - lr: 0.025000 2023-04-06 05:14:23,078 epoch 128 - iter 530/2650 - loss 0.04085272 - time (sec): 36.19 - samples/sec: 8104.44 - lr: 0.025000 2023-04-06 05:14:40,985 epoch 128 - iter 795/2650 - loss 0.04093484 - time (sec): 54.10 - samples/sec: 8112.46 - lr: 0.025000 2023-04-06 05:14:58,891 epoch 128 - iter 1060/2650 - loss 0.04090613 - time (sec): 72.01 - samples/sec: 8110.24 - lr: 0.025000 2023-04-06 05:15:16,960 epoch 128 - iter 1325/2650 - loss 0.04105002 - time (sec): 90.08 - samples/sec: 8105.89 - lr: 0.025000 2023-04-06 05:15:35,388 epoch 128 - iter 1590/2650 - loss 0.04111767 - time (sec): 108.50 - samples/sec: 8093.59 - lr: 0.025000 2023-04-06 05:15:53,272 epoch 128 - iter 1855/2650 - loss 0.04112070 - time (sec): 126.39 - samples/sec: 8102.71 - lr: 0.025000 2023-04-06 05:16:11,023 epoch 128 - iter 2120/2650 - loss 0.04125964 - time (sec): 144.14 - samples/sec: 8110.71 - lr: 0.025000 2023-04-06 05:16:29,128 epoch 128 - iter 2385/2650 - loss 0.04128059 - time (sec): 162.24 - samples/sec: 8113.54 - lr: 0.025000 2023-04-06 05:16:47,578 epoch 128 - iter 2650/2650 - loss 0.04147226 - time (sec): 180.69 - samples/sec: 8093.03 - lr: 0.025000 2023-04-06 05:16:47,579 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:16:47,579 EPOCH 128 done: loss 0.0415 - lr 0.025000 2023-04-06 05:16:47,579 BAD EPOCHS (no improvement): 1 2023-04-06 05:16:47,581 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:17:05,772 epoch 129 - iter 265/2650 - loss 0.03959153 - time (sec): 18.19 - samples/sec: 8059.28 - lr: 0.025000 2023-04-06 05:17:24,215 epoch 129 - iter 530/2650 - loss 0.04063570 - time (sec): 36.63 - samples/sec: 8029.53 - lr: 0.025000 2023-04-06 05:17:42,561 epoch 129 - iter 795/2650 - loss 0.04067412 - time (sec): 54.98 - samples/sec: 8017.78 - lr: 0.025000 2023-04-06 05:18:00,463 epoch 129 - iter 1060/2650 - loss 0.04117408 - time (sec): 72.88 - samples/sec: 8047.83 - lr: 0.025000 2023-04-06 05:18:17,924 epoch 129 - iter 1325/2650 - loss 0.04096765 - time (sec): 90.34 - samples/sec: 8087.78 - lr: 0.025000 2023-04-06 05:18:35,602 epoch 129 - iter 1590/2650 - loss 0.04090761 - time (sec): 108.02 - samples/sec: 8109.64 - lr: 0.025000 2023-04-06 05:18:53,764 epoch 129 - iter 1855/2650 - loss 0.04078032 - time (sec): 126.18 - samples/sec: 8100.59 - lr: 0.025000 2023-04-06 05:19:11,957 epoch 129 - iter 2120/2650 - loss 0.04084365 - time (sec): 144.38 - samples/sec: 8105.06 - lr: 0.025000 2023-04-06 05:19:30,105 epoch 129 - iter 2385/2650 - loss 0.04110954 - time (sec): 162.52 - samples/sec: 8103.12 - lr: 0.025000 2023-04-06 05:19:48,193 epoch 129 - iter 2650/2650 - loss 0.04096842 - time (sec): 180.61 - samples/sec: 8096.72 - lr: 0.025000 2023-04-06 05:19:48,194 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:19:48,194 EPOCH 129 done: loss 0.0410 - lr 0.025000 2023-04-06 05:19:48,194 BAD EPOCHS (no improvement): 0 2023-04-06 05:19:48,197 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:20:06,206 epoch 130 - iter 265/2650 - loss 0.04248806 - time (sec): 18.01 - samples/sec: 8181.48 - lr: 0.025000 2023-04-06 05:20:23,925 epoch 130 - iter 530/2650 - loss 0.04156857 - time (sec): 35.73 - samples/sec: 8188.16 - lr: 0.025000 2023-04-06 05:20:41,897 epoch 130 - iter 795/2650 - loss 0.04157008 - time (sec): 53.70 - samples/sec: 8162.89 - lr: 0.025000 2023-04-06 05:21:00,177 epoch 130 - iter 1060/2650 - loss 0.04170736 - time (sec): 71.98 - samples/sec: 8136.30 - lr: 0.025000 2023-04-06 05:21:17,943 epoch 130 - iter 1325/2650 - loss 0.04171523 - time (sec): 89.75 - samples/sec: 8144.70 - lr: 0.025000 2023-04-06 05:21:35,646 epoch 130 - iter 1590/2650 - loss 0.04165002 - time (sec): 107.45 - samples/sec: 8165.62 - lr: 0.025000 2023-04-06 05:21:54,409 epoch 130 - iter 1855/2650 - loss 0.04142556 - time (sec): 126.21 - samples/sec: 8129.27 - lr: 0.025000 2023-04-06 05:22:12,329 epoch 130 - iter 2120/2650 - loss 0.04136148 - time (sec): 144.13 - samples/sec: 8129.03 - lr: 0.025000 2023-04-06 05:22:30,307 epoch 130 - iter 2385/2650 - loss 0.04138445 - time (sec): 162.11 - samples/sec: 8121.43 - lr: 0.025000 2023-04-06 05:22:48,413 epoch 130 - iter 2650/2650 - loss 0.04144982 - time (sec): 180.22 - samples/sec: 8114.51 - lr: 0.025000 2023-04-06 05:22:48,413 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:22:48,413 EPOCH 130 done: loss 0.0414 - lr 0.025000 2023-04-06 05:22:48,413 BAD EPOCHS (no improvement): 1 2023-04-06 05:22:48,416 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:23:06,539 epoch 131 - iter 265/2650 - loss 0.03950131 - time (sec): 18.12 - samples/sec: 8114.82 - lr: 0.025000 2023-04-06 05:23:24,658 epoch 131 - iter 530/2650 - loss 0.04036333 - time (sec): 36.24 - samples/sec: 8107.29 - lr: 0.025000 2023-04-06 05:23:43,136 epoch 131 - iter 795/2650 - loss 0.04060607 - time (sec): 54.72 - samples/sec: 8075.22 - lr: 0.025000 2023-04-06 05:24:01,227 epoch 131 - iter 1060/2650 - loss 0.04050313 - time (sec): 72.81 - samples/sec: 8080.73 - lr: 0.025000 2023-04-06 05:24:19,245 epoch 131 - iter 1325/2650 - loss 0.04051703 - time (sec): 90.83 - samples/sec: 8100.86 - lr: 0.025000 2023-04-06 05:24:37,438 epoch 131 - iter 1590/2650 - loss 0.04043607 - time (sec): 109.02 - samples/sec: 8089.26 - lr: 0.025000 2023-04-06 05:24:55,399 epoch 131 - iter 1855/2650 - loss 0.04048286 - time (sec): 126.98 - samples/sec: 8092.15 - lr: 0.025000 2023-04-06 05:25:13,742 epoch 131 - iter 2120/2650 - loss 0.04064564 - time (sec): 145.33 - samples/sec: 8079.40 - lr: 0.025000 2023-04-06 05:25:31,488 epoch 131 - iter 2385/2650 - loss 0.04064842 - time (sec): 163.07 - samples/sec: 8076.73 - lr: 0.025000 2023-04-06 05:25:49,131 epoch 131 - iter 2650/2650 - loss 0.04059275 - time (sec): 180.71 - samples/sec: 8092.11 - lr: 0.025000 2023-04-06 05:25:49,131 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:25:49,131 EPOCH 131 done: loss 0.0406 - lr 0.025000 2023-04-06 05:25:49,131 BAD EPOCHS (no improvement): 0 2023-04-06 05:25:49,134 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:26:07,135 epoch 132 - iter 265/2650 - loss 0.03929463 - time (sec): 18.00 - samples/sec: 8041.20 - lr: 0.025000 2023-04-06 05:26:25,470 epoch 132 - iter 530/2650 - loss 0.04014026 - time (sec): 36.34 - samples/sec: 8008.74 - lr: 0.025000 2023-04-06 05:26:43,353 epoch 132 - iter 795/2650 - loss 0.04021379 - time (sec): 54.22 - samples/sec: 8058.68 - lr: 0.025000 2023-04-06 05:27:01,251 epoch 132 - iter 1060/2650 - loss 0.04041387 - time (sec): 72.12 - samples/sec: 8086.40 - lr: 0.025000 2023-04-06 05:27:18,899 epoch 132 - iter 1325/2650 - loss 0.04053990 - time (sec): 89.76 - samples/sec: 8131.68 - lr: 0.025000 2023-04-06 05:27:37,028 epoch 132 - iter 1590/2650 - loss 0.04066154 - time (sec): 107.89 - samples/sec: 8113.45 - lr: 0.025000 2023-04-06 05:27:54,826 epoch 132 - iter 1855/2650 - loss 0.04070717 - time (sec): 125.69 - samples/sec: 8122.57 - lr: 0.025000 2023-04-06 05:28:13,482 epoch 132 - iter 2120/2650 - loss 0.04079670 - time (sec): 144.35 - samples/sec: 8095.70 - lr: 0.025000 2023-04-06 05:28:31,780 epoch 132 - iter 2385/2650 - loss 0.04087183 - time (sec): 162.65 - samples/sec: 8089.02 - lr: 0.025000 2023-04-06 05:28:49,711 epoch 132 - iter 2650/2650 - loss 0.04089656 - time (sec): 180.58 - samples/sec: 8098.27 - lr: 0.025000 2023-04-06 05:28:49,711 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:28:49,711 EPOCH 132 done: loss 0.0409 - lr 0.025000 2023-04-06 05:28:49,711 BAD EPOCHS (no improvement): 1 2023-04-06 05:28:49,714 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:29:07,809 epoch 133 - iter 265/2650 - loss 0.03974078 - time (sec): 18.10 - samples/sec: 8102.51 - lr: 0.025000 2023-04-06 05:29:25,736 epoch 133 - iter 530/2650 - loss 0.03976044 - time (sec): 36.02 - samples/sec: 8098.55 - lr: 0.025000 2023-04-06 05:29:43,894 epoch 133 - iter 795/2650 - loss 0.03994543 - time (sec): 54.18 - samples/sec: 8067.39 - lr: 0.025000 2023-04-06 05:30:02,173 epoch 133 - iter 1060/2650 - loss 0.04053263 - time (sec): 72.46 - samples/sec: 8080.80 - lr: 0.025000 2023-04-06 05:30:20,400 epoch 133 - iter 1325/2650 - loss 0.04058395 - time (sec): 90.69 - samples/sec: 8077.22 - lr: 0.025000 2023-04-06 05:30:38,364 epoch 133 - iter 1590/2650 - loss 0.04053741 - time (sec): 108.65 - samples/sec: 8073.17 - lr: 0.025000 2023-04-06 05:30:56,354 epoch 133 - iter 1855/2650 - loss 0.04072213 - time (sec): 126.64 - samples/sec: 8071.98 - lr: 0.025000 2023-04-06 05:31:14,781 epoch 133 - iter 2120/2650 - loss 0.04083962 - time (sec): 145.07 - samples/sec: 8064.04 - lr: 0.025000 2023-04-06 05:31:32,802 epoch 133 - iter 2385/2650 - loss 0.04093126 - time (sec): 163.09 - samples/sec: 8065.62 - lr: 0.025000 2023-04-06 05:31:51,070 epoch 133 - iter 2650/2650 - loss 0.04096935 - time (sec): 181.36 - samples/sec: 8063.49 - lr: 0.025000 2023-04-06 05:31:51,070 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:31:51,070 EPOCH 133 done: loss 0.0410 - lr 0.025000 2023-04-06 05:31:51,071 BAD EPOCHS (no improvement): 2 2023-04-06 05:31:51,073 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:32:09,175 epoch 134 - iter 265/2650 - loss 0.04062527 - time (sec): 18.10 - samples/sec: 8040.64 - lr: 0.025000 2023-04-06 05:32:27,352 epoch 134 - iter 530/2650 - loss 0.04083675 - time (sec): 36.28 - samples/sec: 8051.97 - lr: 0.025000 2023-04-06 05:32:45,386 epoch 134 - iter 795/2650 - loss 0.04088523 - time (sec): 54.31 - samples/sec: 8055.23 - lr: 0.025000 2023-04-06 05:33:03,827 epoch 134 - iter 1060/2650 - loss 0.04085507 - time (sec): 72.75 - samples/sec: 8016.24 - lr: 0.025000 2023-04-06 05:33:22,373 epoch 134 - iter 1325/2650 - loss 0.04067763 - time (sec): 91.30 - samples/sec: 7971.61 - lr: 0.025000 2023-04-06 05:33:41,055 epoch 134 - iter 1590/2650 - loss 0.04054091 - time (sec): 109.98 - samples/sec: 7948.42 - lr: 0.025000 2023-04-06 05:33:59,844 epoch 134 - iter 1855/2650 - loss 0.04034749 - time (sec): 128.77 - samples/sec: 7934.71 - lr: 0.025000 2023-04-06 05:34:18,130 epoch 134 - iter 2120/2650 - loss 0.04030830 - time (sec): 147.06 - samples/sec: 7945.64 - lr: 0.025000 2023-04-06 05:34:37,068 epoch 134 - iter 2385/2650 - loss 0.04044115 - time (sec): 165.99 - samples/sec: 7924.18 - lr: 0.025000 2023-04-06 05:34:55,697 epoch 134 - iter 2650/2650 - loss 0.04042230 - time (sec): 184.62 - samples/sec: 7920.80 - lr: 0.025000 2023-04-06 05:34:55,697 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:34:55,697 EPOCH 134 done: loss 0.0404 - lr 0.025000 2023-04-06 05:34:55,697 BAD EPOCHS (no improvement): 0 2023-04-06 05:34:55,700 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:35:14,036 epoch 135 - iter 265/2650 - loss 0.03931015 - time (sec): 18.34 - samples/sec: 7964.23 - lr: 0.025000 2023-04-06 05:35:32,360 epoch 135 - iter 530/2650 - loss 0.03964129 - time (sec): 36.66 - samples/sec: 7985.48 - lr: 0.025000 2023-04-06 05:35:50,096 epoch 135 - iter 795/2650 - loss 0.04004363 - time (sec): 54.40 - samples/sec: 8059.48 - lr: 0.025000 2023-04-06 05:36:08,224 epoch 135 - iter 1060/2650 - loss 0.04021903 - time (sec): 72.52 - samples/sec: 8061.61 - lr: 0.025000 2023-04-06 05:36:26,776 epoch 135 - iter 1325/2650 - loss 0.03991259 - time (sec): 91.08 - samples/sec: 8028.19 - lr: 0.025000 2023-04-06 05:36:45,317 epoch 135 - iter 1590/2650 - loss 0.04001614 - time (sec): 109.62 - samples/sec: 7996.94 - lr: 0.025000 2023-04-06 05:37:03,695 epoch 135 - iter 1855/2650 - loss 0.04012403 - time (sec): 128.00 - samples/sec: 7984.16 - lr: 0.025000 2023-04-06 05:37:22,003 epoch 135 - iter 2120/2650 - loss 0.04030422 - time (sec): 146.30 - samples/sec: 7985.93 - lr: 0.025000 2023-04-06 05:37:40,037 epoch 135 - iter 2385/2650 - loss 0.04035840 - time (sec): 164.34 - samples/sec: 7994.09 - lr: 0.025000 2023-04-06 05:37:58,519 epoch 135 - iter 2650/2650 - loss 0.04033553 - time (sec): 182.82 - samples/sec: 7998.93 - lr: 0.025000 2023-04-06 05:37:58,520 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:37:58,520 EPOCH 135 done: loss 0.0403 - lr 0.025000 2023-04-06 05:37:58,520 BAD EPOCHS (no improvement): 0 2023-04-06 05:37:58,523 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:38:16,668 epoch 136 - iter 265/2650 - loss 0.04135815 - time (sec): 18.15 - samples/sec: 8094.82 - lr: 0.025000 2023-04-06 05:38:35,243 epoch 136 - iter 530/2650 - loss 0.04011764 - time (sec): 36.72 - samples/sec: 7985.65 - lr: 0.025000 2023-04-06 05:38:53,398 epoch 136 - iter 795/2650 - loss 0.04047334 - time (sec): 54.88 - samples/sec: 7982.48 - lr: 0.025000 2023-04-06 05:39:11,492 epoch 136 - iter 1060/2650 - loss 0.04007692 - time (sec): 72.97 - samples/sec: 8016.07 - lr: 0.025000 2023-04-06 05:39:29,257 epoch 136 - iter 1325/2650 - loss 0.04021249 - time (sec): 90.73 - samples/sec: 8062.74 - lr: 0.025000 2023-04-06 05:39:47,119 epoch 136 - iter 1590/2650 - loss 0.04049466 - time (sec): 108.60 - samples/sec: 8069.11 - lr: 0.025000 2023-04-06 05:40:04,784 epoch 136 - iter 1855/2650 - loss 0.04038341 - time (sec): 126.26 - samples/sec: 8087.47 - lr: 0.025000 2023-04-06 05:40:22,717 epoch 136 - iter 2120/2650 - loss 0.04042941 - time (sec): 144.19 - samples/sec: 8104.79 - lr: 0.025000 2023-04-06 05:40:41,157 epoch 136 - iter 2385/2650 - loss 0.04035510 - time (sec): 162.63 - samples/sec: 8093.90 - lr: 0.025000 2023-04-06 05:40:59,255 epoch 136 - iter 2650/2650 - loss 0.04041591 - time (sec): 180.73 - samples/sec: 8091.33 - lr: 0.025000 2023-04-06 05:40:59,255 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:40:59,255 EPOCH 136 done: loss 0.0404 - lr 0.025000 2023-04-06 05:40:59,255 BAD EPOCHS (no improvement): 1 2023-04-06 05:40:59,258 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:41:17,250 epoch 137 - iter 265/2650 - loss 0.04005845 - time (sec): 17.99 - samples/sec: 8142.88 - lr: 0.025000 2023-04-06 05:41:35,169 epoch 137 - iter 530/2650 - loss 0.04075099 - time (sec): 35.91 - samples/sec: 8093.25 - lr: 0.025000 2023-04-06 05:41:53,025 epoch 137 - iter 795/2650 - loss 0.04050298 - time (sec): 53.77 - samples/sec: 8116.82 - lr: 0.025000 2023-04-06 05:42:11,249 epoch 137 - iter 1060/2650 - loss 0.04010002 - time (sec): 71.99 - samples/sec: 8122.06 - lr: 0.025000 2023-04-06 05:42:29,392 epoch 137 - iter 1325/2650 - loss 0.03988369 - time (sec): 90.13 - samples/sec: 8110.10 - lr: 0.025000 2023-04-06 05:42:47,734 epoch 137 - iter 1590/2650 - loss 0.04006063 - time (sec): 108.48 - samples/sec: 8086.33 - lr: 0.025000 2023-04-06 05:43:06,214 epoch 137 - iter 1855/2650 - loss 0.04024242 - time (sec): 126.96 - samples/sec: 8071.64 - lr: 0.025000 2023-04-06 05:43:24,116 epoch 137 - iter 2120/2650 - loss 0.04053894 - time (sec): 144.86 - samples/sec: 8071.69 - lr: 0.025000 2023-04-06 05:43:42,163 epoch 137 - iter 2385/2650 - loss 0.04042394 - time (sec): 162.91 - samples/sec: 8073.92 - lr: 0.025000 2023-04-06 05:44:00,177 epoch 137 - iter 2650/2650 - loss 0.04055061 - time (sec): 180.92 - samples/sec: 8082.96 - lr: 0.025000 2023-04-06 05:44:00,177 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:44:00,177 EPOCH 137 done: loss 0.0406 - lr 0.025000 2023-04-06 05:44:00,177 BAD EPOCHS (no improvement): 2 2023-04-06 05:44:00,181 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:44:18,126 epoch 138 - iter 265/2650 - loss 0.04017829 - time (sec): 17.95 - samples/sec: 8120.32 - lr: 0.025000 2023-04-06 05:44:36,118 epoch 138 - iter 530/2650 - loss 0.04011681 - time (sec): 35.94 - samples/sec: 8091.89 - lr: 0.025000 2023-04-06 05:44:54,230 epoch 138 - iter 795/2650 - loss 0.03999818 - time (sec): 54.05 - samples/sec: 8080.81 - lr: 0.025000 2023-04-06 05:45:12,021 epoch 138 - iter 1060/2650 - loss 0.03985642 - time (sec): 71.84 - samples/sec: 8127.44 - lr: 0.025000 2023-04-06 05:45:30,102 epoch 138 - iter 1325/2650 - loss 0.04004686 - time (sec): 89.92 - samples/sec: 8137.68 - lr: 0.025000 2023-04-06 05:45:48,082 epoch 138 - iter 1590/2650 - loss 0.04028090 - time (sec): 107.90 - samples/sec: 8141.36 - lr: 0.025000 2023-04-06 05:46:06,357 epoch 138 - iter 1855/2650 - loss 0.04017431 - time (sec): 126.18 - samples/sec: 8125.23 - lr: 0.025000 2023-04-06 05:46:24,588 epoch 138 - iter 2120/2650 - loss 0.04019725 - time (sec): 144.41 - samples/sec: 8112.33 - lr: 0.025000 2023-04-06 05:46:42,687 epoch 138 - iter 2385/2650 - loss 0.04028922 - time (sec): 162.51 - samples/sec: 8111.17 - lr: 0.025000 2023-04-06 05:47:00,670 epoch 138 - iter 2650/2650 - loss 0.04029205 - time (sec): 180.49 - samples/sec: 8102.23 - lr: 0.025000 2023-04-06 05:47:00,670 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:47:00,670 EPOCH 138 done: loss 0.0403 - lr 0.025000 2023-04-06 05:47:00,670 BAD EPOCHS (no improvement): 0 2023-04-06 05:47:00,673 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:47:19,232 epoch 139 - iter 265/2650 - loss 0.04101474 - time (sec): 18.56 - samples/sec: 7917.58 - lr: 0.025000 2023-04-06 05:47:38,014 epoch 139 - iter 530/2650 - loss 0.03985061 - time (sec): 37.34 - samples/sec: 7913.90 - lr: 0.025000 2023-04-06 05:47:56,279 epoch 139 - iter 795/2650 - loss 0.03913537 - time (sec): 55.61 - samples/sec: 7929.22 - lr: 0.025000 2023-04-06 05:48:15,111 epoch 139 - iter 1060/2650 - loss 0.03942611 - time (sec): 74.44 - samples/sec: 7896.50 - lr: 0.025000 2023-04-06 05:48:33,740 epoch 139 - iter 1325/2650 - loss 0.03969023 - time (sec): 93.07 - samples/sec: 7894.75 - lr: 0.025000 2023-04-06 05:48:52,050 epoch 139 - iter 1590/2650 - loss 0.03958712 - time (sec): 111.38 - samples/sec: 7914.08 - lr: 0.025000 2023-04-06 05:49:10,512 epoch 139 - iter 1855/2650 - loss 0.03970025 - time (sec): 129.84 - samples/sec: 7918.57 - lr: 0.025000 2023-04-06 05:49:29,001 epoch 139 - iter 2120/2650 - loss 0.03979057 - time (sec): 148.33 - samples/sec: 7900.96 - lr: 0.025000 2023-04-06 05:49:46,958 epoch 139 - iter 2385/2650 - loss 0.03989906 - time (sec): 166.28 - samples/sec: 7924.12 - lr: 0.025000 2023-04-06 05:50:04,661 epoch 139 - iter 2650/2650 - loss 0.04004708 - time (sec): 183.99 - samples/sec: 7948.13 - lr: 0.025000 2023-04-06 05:50:04,661 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:50:04,662 EPOCH 139 done: loss 0.0400 - lr 0.025000 2023-04-06 05:50:04,662 BAD EPOCHS (no improvement): 0 2023-04-06 05:50:04,664 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:50:22,799 epoch 140 - iter 265/2650 - loss 0.03901818 - time (sec): 18.13 - samples/sec: 8025.78 - lr: 0.025000 2023-04-06 05:50:40,839 epoch 140 - iter 530/2650 - loss 0.03948488 - time (sec): 36.18 - samples/sec: 8079.15 - lr: 0.025000 2023-04-06 05:50:59,166 epoch 140 - iter 795/2650 - loss 0.03947529 - time (sec): 54.50 - samples/sec: 8051.31 - lr: 0.025000 2023-04-06 05:51:17,257 epoch 140 - iter 1060/2650 - loss 0.03936228 - time (sec): 72.59 - samples/sec: 8066.50 - lr: 0.025000 2023-04-06 05:51:35,697 epoch 140 - iter 1325/2650 - loss 0.03967421 - time (sec): 91.03 - samples/sec: 8059.16 - lr: 0.025000 2023-04-06 05:51:54,166 epoch 140 - iter 1590/2650 - loss 0.03965230 - time (sec): 109.50 - samples/sec: 8024.86 - lr: 0.025000 2023-04-06 05:52:12,427 epoch 140 - iter 1855/2650 - loss 0.03964508 - time (sec): 127.76 - samples/sec: 8028.29 - lr: 0.025000 2023-04-06 05:52:31,204 epoch 140 - iter 2120/2650 - loss 0.03972774 - time (sec): 146.54 - samples/sec: 8002.82 - lr: 0.025000 2023-04-06 05:52:49,305 epoch 140 - iter 2385/2650 - loss 0.03972656 - time (sec): 164.64 - samples/sec: 8000.42 - lr: 0.025000 2023-04-06 05:53:07,649 epoch 140 - iter 2650/2650 - loss 0.03968864 - time (sec): 182.98 - samples/sec: 7991.73 - lr: 0.025000 2023-04-06 05:53:07,649 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:53:07,649 EPOCH 140 done: loss 0.0397 - lr 0.025000 2023-04-06 05:53:07,649 BAD EPOCHS (no improvement): 0 2023-04-06 05:53:07,652 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:53:25,971 epoch 141 - iter 265/2650 - loss 0.03929561 - time (sec): 18.32 - samples/sec: 7995.77 - lr: 0.025000 2023-04-06 05:53:44,542 epoch 141 - iter 530/2650 - loss 0.03961178 - time (sec): 36.89 - samples/sec: 7930.78 - lr: 0.025000 2023-04-06 05:54:03,235 epoch 141 - iter 795/2650 - loss 0.03943979 - time (sec): 55.58 - samples/sec: 7913.75 - lr: 0.025000 2023-04-06 05:54:21,080 epoch 141 - iter 1060/2650 - loss 0.03978276 - time (sec): 73.43 - samples/sec: 7987.20 - lr: 0.025000 2023-04-06 05:54:39,009 epoch 141 - iter 1325/2650 - loss 0.03985637 - time (sec): 91.36 - samples/sec: 8018.01 - lr: 0.025000 2023-04-06 05:54:56,907 epoch 141 - iter 1590/2650 - loss 0.03999877 - time (sec): 109.25 - samples/sec: 8048.26 - lr: 0.025000 2023-04-06 05:55:14,614 epoch 141 - iter 1855/2650 - loss 0.04022268 - time (sec): 126.96 - samples/sec: 8073.50 - lr: 0.025000 2023-04-06 05:55:32,393 epoch 141 - iter 2120/2650 - loss 0.04027447 - time (sec): 144.74 - samples/sec: 8088.75 - lr: 0.025000 2023-04-06 05:55:50,522 epoch 141 - iter 2385/2650 - loss 0.04019969 - time (sec): 162.87 - samples/sec: 8071.08 - lr: 0.025000 2023-04-06 05:56:09,541 epoch 141 - iter 2650/2650 - loss 0.04021592 - time (sec): 181.89 - samples/sec: 8039.86 - lr: 0.025000 2023-04-06 05:56:09,541 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:56:09,541 EPOCH 141 done: loss 0.0402 - lr 0.025000 2023-04-06 05:56:09,541 BAD EPOCHS (no improvement): 1 2023-04-06 05:56:09,544 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:56:27,598 epoch 142 - iter 265/2650 - loss 0.03952756 - time (sec): 18.05 - samples/sec: 8044.48 - lr: 0.025000 2023-04-06 05:56:45,751 epoch 142 - iter 530/2650 - loss 0.03932168 - time (sec): 36.21 - samples/sec: 8049.81 - lr: 0.025000 2023-04-06 05:57:04,025 epoch 142 - iter 795/2650 - loss 0.03958358 - time (sec): 54.48 - samples/sec: 8056.12 - lr: 0.025000 2023-04-06 05:57:21,914 epoch 142 - iter 1060/2650 - loss 0.03967622 - time (sec): 72.37 - samples/sec: 8080.76 - lr: 0.025000 2023-04-06 05:57:40,003 epoch 142 - iter 1325/2650 - loss 0.03965209 - time (sec): 90.46 - samples/sec: 8086.10 - lr: 0.025000 2023-04-06 05:57:57,941 epoch 142 - iter 1590/2650 - loss 0.03965636 - time (sec): 108.40 - samples/sec: 8100.18 - lr: 0.025000 2023-04-06 05:58:15,642 epoch 142 - iter 1855/2650 - loss 0.03968296 - time (sec): 126.10 - samples/sec: 8117.37 - lr: 0.025000 2023-04-06 05:58:33,425 epoch 142 - iter 2120/2650 - loss 0.03956581 - time (sec): 143.88 - samples/sec: 8120.92 - lr: 0.025000 2023-04-06 05:58:51,188 epoch 142 - iter 2385/2650 - loss 0.03956213 - time (sec): 161.64 - samples/sec: 8134.44 - lr: 0.025000 2023-04-06 05:59:09,814 epoch 142 - iter 2650/2650 - loss 0.03966770 - time (sec): 180.27 - samples/sec: 8112.07 - lr: 0.025000 2023-04-06 05:59:09,814 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:59:09,814 EPOCH 142 done: loss 0.0397 - lr 0.025000 2023-04-06 05:59:09,815 BAD EPOCHS (no improvement): 0 2023-04-06 05:59:09,817 ---------------------------------------------------------------------------------------------------- 2023-04-06 05:59:28,066 epoch 143 - iter 265/2650 - loss 0.03949938 - time (sec): 18.25 - samples/sec: 8057.96 - lr: 0.025000 2023-04-06 05:59:46,891 epoch 143 - iter 530/2650 - loss 0.04002745 - time (sec): 37.07 - samples/sec: 7905.30 - lr: 0.025000 2023-04-06 06:00:05,321 epoch 143 - iter 795/2650 - loss 0.03951013 - time (sec): 55.50 - samples/sec: 7913.93 - lr: 0.025000 2023-04-06 06:00:23,788 epoch 143 - iter 1060/2650 - loss 0.03922494 - time (sec): 73.97 - samples/sec: 7928.39 - lr: 0.025000 2023-04-06 06:00:42,024 epoch 143 - iter 1325/2650 - loss 0.03954534 - time (sec): 92.21 - samples/sec: 7928.52 - lr: 0.025000 2023-04-06 06:01:00,364 epoch 143 - iter 1590/2650 - loss 0.03976165 - time (sec): 110.55 - samples/sec: 7935.54 - lr: 0.025000 2023-04-06 06:01:18,281 epoch 143 - iter 1855/2650 - loss 0.03968646 - time (sec): 128.46 - samples/sec: 7974.31 - lr: 0.025000 2023-04-06 06:01:35,969 epoch 143 - iter 2120/2650 - loss 0.03974148 - time (sec): 146.15 - samples/sec: 7997.45 - lr: 0.025000 2023-04-06 06:01:54,080 epoch 143 - iter 2385/2650 - loss 0.03985085 - time (sec): 164.26 - samples/sec: 8007.18 - lr: 0.025000 2023-04-06 06:02:12,482 epoch 143 - iter 2650/2650 - loss 0.03983567 - time (sec): 182.66 - samples/sec: 8005.72 - lr: 0.025000 2023-04-06 06:02:12,482 ---------------------------------------------------------------------------------------------------- 2023-04-06 06:02:12,482 EPOCH 143 done: loss 0.0398 - lr 0.025000 2023-04-06 06:02:12,482 BAD EPOCHS (no improvement): 1 2023-04-06 06:02:12,485 ---------------------------------------------------------------------------------------------------- 2023-04-06 06:02:30,787 epoch 144 - iter 265/2650 - loss 0.03909620 - time (sec): 18.30 - samples/sec: 8087.64 - lr: 0.025000 2023-04-06 06:02:49,020 epoch 144 - iter 530/2650 - loss 0.03913134 - time (sec): 36.53 - samples/sec: 8066.96 - lr: 0.025000 2023-04-06 06:03:06,860 epoch 144 - iter 795/2650 - loss 0.03885468 - time (sec): 54.37 - samples/sec: 8119.67 - lr: 0.025000 2023-04-06 06:03:25,056 epoch 144 - iter 1060/2650 - loss 0.03877210 - time (sec): 72.57 - samples/sec: 8084.31 - lr: 0.025000 2023-04-06 06:03:42,862 epoch 144 - iter 1325/2650 - loss 0.03915181 - time (sec): 90.38 - samples/sec: 8082.24 - lr: 0.025000 2023-04-06 06:04:01,247 epoch 144 - iter 1590/2650 - loss 0.03923664 - time (sec): 108.76 - samples/sec: 8055.80 - lr: 0.025000 2023-04-06 06:04:19,838 epoch 144 - iter 1855/2650 - loss 0.03935577 - time (sec): 127.35 - samples/sec: 8031.54 - lr: 0.025000 2023-04-06 06:04:38,460 epoch 144 - iter 2120/2650 - loss 0.03940290 - time (sec): 145.97 - samples/sec: 8018.42 - lr: 0.025000 2023-04-06 06:04:56,941 epoch 144 - iter 2385/2650 - loss 0.03948530 - time (sec): 164.46 - samples/sec: 8006.71 - lr: 0.025000 2023-04-06 06:05:15,467 epoch 144 - iter 2650/2650 - loss 0.03960627 - time (sec): 182.98 - samples/sec: 7991.87 - lr: 0.025000 2023-04-06 06:05:15,467 ---------------------------------------------------------------------------------------------------- 2023-04-06 06:05:15,467 EPOCH 144 done: loss 0.0396 - lr 0.025000 2023-04-06 06:05:15,467 BAD EPOCHS (no improvement): 0 2023-04-06 06:05:15,470 ---------------------------------------------------------------------------------------------------- 2023-04-06 06:05:33,801 epoch 145 - iter 265/2650 - loss 0.04090516 - time (sec): 18.33 - samples/sec: 8069.12 - lr: 0.025000 2023-04-06 06:05:51,696 epoch 145 - iter 530/2650 - loss 0.03979241 - time (sec): 36.23 - samples/sec: 8097.51 - lr: 0.025000 2023-04-06 06:06:09,822 epoch 145 - iter 795/2650 - loss 0.03923993 - time (sec): 54.35 - samples/sec: 8096.99 - lr: 0.025000 2023-04-06 06:06:27,817 epoch 145 - iter 1060/2650 - loss 0.03971202 - time (sec): 72.35 - samples/sec: 8100.02 - lr: 0.025000 2023-04-06 06:06:45,503 epoch 145 - iter 1325/2650 - loss 0.03943064 - time (sec): 90.03 - samples/sec: 8111.17 - lr: 0.025000 2023-04-06 06:07:03,826 epoch 145 - iter 1590/2650 - loss 0.03958255 - time (sec): 108.36 - samples/sec: 8086.51 - lr: 0.025000 2023-04-06 06:07:21,689 epoch 145 - iter 1855/2650 - loss 0.03956705 - time (sec): 126.22 - samples/sec: 8098.85 - lr: 0.025000 2023-04-06 06:07:39,911 epoch 145 - iter 2120/2650 - loss 0.03928098 - time (sec): 144.44 - samples/sec: 8086.25 - lr: 0.025000 2023-04-06 06:07:58,174 epoch 145 - iter 2385/2650 - loss 0.03919216 - time (sec): 162.70 - samples/sec: 8076.33 - lr: 0.025000 2023-04-06 06:08:16,638 epoch 145 - iter 2650/2650 - loss 0.03917088 - time (sec): 181.17 - samples/sec: 8071.88 - lr: 0.025000 2023-04-06 06:08:16,638 ---------------------------------------------------------------------------------------------------- 2023-04-06 06:08:16,638 EPOCH 145 done: loss 0.0392 - lr 0.025000 2023-04-06 06:08:16,638 BAD EPOCHS (no improvement): 0 2023-04-06 06:08:16,641 ---------------------------------------------------------------------------------------------------- 2023-04-06 06:08:34,987 epoch 146 - iter 265/2650 - loss 0.03811858 - time (sec): 18.35 - samples/sec: 8060.39 - lr: 0.025000 2023-04-06 06:08:52,924 epoch 146 - iter 530/2650 - loss 0.03848160 - time (sec): 36.28 - samples/sec: 8094.82 - lr: 0.025000 2023-04-06 06:09:11,196 epoch 146 - iter 795/2650 - loss 0.03860433 - time (sec): 54.55 - samples/sec: 8037.90 - lr: 0.025000 2023-04-06 06:09:29,349 epoch 146 - iter 1060/2650 - loss 0.03826842 - time (sec): 72.71 - samples/sec: 8034.17 - lr: 0.025000 2023-04-06 06:09:47,821 epoch 146 - iter 1325/2650 - loss 0.03868120 - time (sec): 91.18 - samples/sec: 8023.27 - lr: 0.025000 2023-04-06 06:10:06,544 epoch 146 - iter 1590/2650 - loss 0.03872762 - time (sec): 109.90 - samples/sec: 7982.18 - lr: 0.025000 2023-04-06 06:10:24,918 epoch 146 - iter 1855/2650 - loss 0.03872121 - time (sec): 128.28 - samples/sec: 7977.43 - lr: 0.025000 2023-04-06 06:10:44,224 epoch 146 - iter 2120/2650 - loss 0.03883316 - time (sec): 147.58 - samples/sec: 7938.62 - lr: 0.025000 2023-04-06 06:11:02,279 epoch 146 - iter 2385/2650 - loss 0.03879808 - time (sec): 165.64 - samples/sec: 7949.23 - lr: 0.025000 2023-04-06 06:11:20,308 epoch 146 - iter 2650/2650 - loss 0.03892216 - time (sec): 183.67 - samples/sec: 7962.05 - lr: 0.025000 2023-04-06 06:11:20,308 ---------------------------------------------------------------------------------------------------- 2023-04-06 06:11:20,308 EPOCH 146 done: loss 0.0389 - lr 0.025000 2023-04-06 06:11:20,308 BAD EPOCHS (no improvement): 0 2023-04-06 06:11:20,311 ---------------------------------------------------------------------------------------------------- 2023-04-06 06:11:38,488 epoch 147 - iter 265/2650 - loss 0.03732016 - time (sec): 18.18 - samples/sec: 8103.69 - lr: 0.025000 2023-04-06 06:11:56,667 epoch 147 - iter 530/2650 - loss 0.03837465 - time (sec): 36.36 - samples/sec: 8070.90 - lr: 0.025000 2023-04-06 06:12:14,393 epoch 147 - iter 795/2650 - loss 0.03867787 - time (sec): 54.08 - samples/sec: 8124.69 - lr: 0.025000 2023-04-06 06:12:32,573 epoch 147 - iter 1060/2650 - loss 0.03884619 - time (sec): 72.26 - samples/sec: 8099.99 - lr: 0.025000 2023-04-06 06:12:50,543 epoch 147 - iter 1325/2650 - loss 0.03888703 - time (sec): 90.23 - samples/sec: 8106.61 - lr: 0.025000 2023-04-06 06:13:08,656 epoch 147 - iter 1590/2650 - loss 0.03899713 - time (sec): 108.34 - samples/sec: 8093.67 - lr: 0.025000 2023-04-06 06:13:26,618 epoch 147 - iter 1855/2650 - loss 0.03916951 - time (sec): 126.31 - samples/sec: 8104.05 - lr: 0.025000 2023-04-06 06:13:44,814 epoch 147 - iter 2120/2650 - loss 0.03927125 - time (sec): 144.50 - samples/sec: 8095.23 - lr: 0.025000 2023-04-06 06:14:02,769 epoch 147 - iter 2385/2650 - loss 0.03932385 - time (sec): 162.46 - samples/sec: 8098.71 - lr: 0.025000 2023-04-06 06:14:20,886 epoch 147 - iter 2650/2650 - loss 0.03938183 - time (sec): 180.58 - samples/sec: 8098.36 - lr: 0.025000 2023-04-06 06:14:20,886 ---------------------------------------------------------------------------------------------------- 2023-04-06 06:14:20,886 EPOCH 147 done: loss 0.0394 - lr 0.025000 2023-04-06 06:14:20,886 BAD EPOCHS (no improvement): 1 2023-04-06 06:14:20,889 ---------------------------------------------------------------------------------------------------- 2023-04-06 06:14:39,201 epoch 148 - iter 265/2650 - loss 0.03909977 - time (sec): 18.31 - samples/sec: 8006.89 - lr: 0.025000 2023-04-06 06:14:57,207 epoch 148 - iter 530/2650 - loss 0.03921235 - time (sec): 36.32 - samples/sec: 8013.24 - lr: 0.025000 2023-04-06 06:15:15,138 epoch 148 - iter 795/2650 - loss 0.03958978 - time (sec): 54.25 - samples/sec: 8080.08 - lr: 0.025000 2023-04-06 06:15:33,239 epoch 148 - iter 1060/2650 - loss 0.03941174 - time (sec): 72.35 - samples/sec: 8085.35 - lr: 0.025000 2023-04-06 06:15:51,433 epoch 148 - iter 1325/2650 - loss 0.03937163 - time (sec): 90.54 - samples/sec: 8089.16 - lr: 0.025000 2023-04-06 06:16:08,950 epoch 148 - iter 1590/2650 - loss 0.03957360 - time (sec): 108.06 - samples/sec: 8118.31 - lr: 0.025000 2023-04-06 06:16:27,064 epoch 148 - iter 1855/2650 - loss 0.03950488 - time (sec): 126.17 - samples/sec: 8113.70 - lr: 0.025000 2023-04-06 06:16:44,758 epoch 148 - iter 2120/2650 - loss 0.03955459 - time (sec): 143.87 - samples/sec: 8124.33 - lr: 0.025000 2023-04-06 06:17:03,209 epoch 148 - iter 2385/2650 - loss 0.03950239 - time (sec): 162.32 - samples/sec: 8109.38 - lr: 0.025000 2023-04-06 06:17:21,591 epoch 148 - iter 2650/2650 - loss 0.03948028 - time (sec): 180.70 - samples/sec: 8092.66 - lr: 0.025000 2023-04-06 06:17:21,592 ---------------------------------------------------------------------------------------------------- 2023-04-06 06:17:21,592 EPOCH 148 done: loss 0.0395 - lr 0.025000 2023-04-06 06:17:21,592 BAD EPOCHS (no improvement): 2 2023-04-06 06:17:21,595 ---------------------------------------------------------------------------------------------------- 2023-04-06 06:17:39,629 epoch 149 - iter 265/2650 - loss 0.03888435 - time (sec): 18.03 - samples/sec: 8069.95 - lr: 0.025000 2023-04-06 06:17:58,182 epoch 149 - iter 530/2650 - loss 0.03865555 - time (sec): 36.59 - samples/sec: 7970.59 - lr: 0.025000 2023-04-06 06:18:16,987 epoch 149 - iter 795/2650 - loss 0.03914896 - time (sec): 55.39 - samples/sec: 7934.05 - lr: 0.025000 2023-04-06 06:18:35,177 epoch 149 - iter 1060/2650 - loss 0.03899731 - time (sec): 73.58 - samples/sec: 7941.70 - lr: 0.025000 2023-04-06 06:18:53,785 epoch 149 - iter 1325/2650 - loss 0.03926015 - time (sec): 92.19 - samples/sec: 7930.98 - lr: 0.025000 2023-04-06 06:19:12,449 epoch 149 - iter 1590/2650 - loss 0.03906345 - time (sec): 110.85 - samples/sec: 7910.10 - lr: 0.025000 2023-04-06 06:19:30,717 epoch 149 - iter 1855/2650 - loss 0.03910454 - time (sec): 129.12 - samples/sec: 7927.27 - lr: 0.025000 2023-04-06 06:19:49,238 epoch 149 - iter 2120/2650 - loss 0.03906635 - time (sec): 147.64 - samples/sec: 7926.59 - lr: 0.025000 2023-04-06 06:20:07,536 epoch 149 - iter 2385/2650 - loss 0.03900379 - time (sec): 165.94 - samples/sec: 7931.40 - lr: 0.025000 2023-04-06 06:20:25,625 epoch 149 - iter 2650/2650 - loss 0.03912153 - time (sec): 184.03 - samples/sec: 7946.35 - lr: 0.025000 2023-04-06 06:20:25,625 ---------------------------------------------------------------------------------------------------- 2023-04-06 06:20:25,625 EPOCH 149 done: loss 0.0391 - lr 0.025000 2023-04-06 06:20:25,625 BAD EPOCHS (no improvement): 3 2023-04-06 06:20:25,628 ---------------------------------------------------------------------------------------------------- 2023-04-06 06:20:43,646 epoch 150 - iter 265/2650 - loss 0.03985062 - time (sec): 18.02 - samples/sec: 8136.17 - lr: 0.025000 2023-04-06 06:21:01,900 epoch 150 - iter 530/2650 - loss 0.03925746 - time (sec): 36.27 - samples/sec: 8075.92 - lr: 0.025000 2023-04-06 06:21:20,372 epoch 150 - iter 795/2650 - loss 0.03900841 - time (sec): 54.74 - samples/sec: 8000.92 - lr: 0.025000 2023-04-06 06:21:39,397 epoch 150 - iter 1060/2650 - loss 0.03926334 - time (sec): 73.77 - samples/sec: 7939.26 - lr: 0.025000 2023-04-06 06:21:57,486 epoch 150 - iter 1325/2650 - loss 0.03923386 - time (sec): 91.86 - samples/sec: 7940.30 - lr: 0.025000 2023-04-06 06:22:15,818 epoch 150 - iter 1590/2650 - loss 0.03896705 - time (sec): 110.19 - samples/sec: 7947.32 - lr: 0.025000 2023-04-06 06:22:33,664 epoch 150 - iter 1855/2650 - loss 0.03887485 - time (sec): 128.04 - samples/sec: 7980.03 - lr: 0.025000 2023-04-06 06:22:51,506 epoch 150 - iter 2120/2650 - loss 0.03898078 - time (sec): 145.88 - samples/sec: 8015.05 - lr: 0.025000 2023-04-06 06:23:09,812 epoch 150 - iter 2385/2650 - loss 0.03897984 - time (sec): 164.18 - samples/sec: 8013.81 - lr: 0.025000 2023-04-06 06:23:27,998 epoch 150 - iter 2650/2650 - loss 0.03885443 - time (sec): 182.37 - samples/sec: 8018.66 - lr: 0.025000 2023-04-06 06:23:27,999 ---------------------------------------------------------------------------------------------------- 2023-04-06 06:23:27,999 EPOCH 150 done: loss 0.0389 - lr 0.025000 2023-04-06 06:23:27,999 BAD EPOCHS (no improvement): 0 2023-04-06 06:23:29,320 ---------------------------------------------------------------------------------------------------- 2023-04-06 06:23:29,321 Testing using last state of model ... 2023-04-06 06:24:02,973 Evaluating as a multi-label problem: False 2023-04-06 06:24:04,057 0.9811 0.9811 0.9811 0.9811 2023-04-06 06:24:04,058 Results: - F-score (micro) 0.9811 - F-score (macro) 0.9501 - Accuracy 0.9811 By class: precision recall f1-score support NN 0.9808 0.9728 0.9767 21215 IN 0.9874 0.9914 0.9894 18085 DT 0.9948 0.9957 0.9952 14785 NNP 0.9744 0.9734 0.9739 12690 JJ 0.9592 0.9475 0.9533 9720 . 0.9964 0.9984 0.9974 8909 NNS 0.9868 0.9898 0.9883 8358 PRP 0.9970 0.9970 0.9970 8067 RB 0.9674 0.9587 0.9630 8014 , 0.9980 0.9936 0.9958 7506 VB 0.9781 0.9816 0.9799 5872 VBD 0.9848 0.9846 0.9847 5407 CC 0.9941 0.9899 0.9920 5126 VBZ 0.9942 0.9944 0.9943 4106 VBP 0.9771 0.9712 0.9741 3954 VBN 0.9264 0.9584 0.9421 3390 CD 0.9814 0.9895 0.9854 3045 VBG 0.9613 0.9834 0.9722 2827 TO 0.9905 0.9956 0.9931 2520 MD 0.9980 0.9975 0.9978 2001 PRP$ 0.9948 0.9974 0.9961 1935 UH 0.9790 0.9832 0.9811 1609 HYPH 0.9907 0.9954 0.9930 1076 POS 0.9971 0.9943 0.9957 1044 '' 0.9929 0.9939 0.9934 980 `` 0.9936 0.9936 0.9936 934 WDT 0.9554 0.9414 0.9483 819 WP 0.9876 0.9925 0.9900 802 WRB 0.9944 0.9888 0.9916 716 RP 0.8746 0.8809 0.8777 705 : 0.9047 0.9419 0.9229 534 NNPS 0.7392 0.8584 0.7944 459 JJR 0.9358 0.9658 0.9506 468 EX 0.9871 0.9935 0.9903 307 JJS 0.9121 0.9520 0.9316 229 RBR 0.8848 0.8610 0.8727 223 -LRB- 1.0000 1.0000 1.0000 197 -RRB- 1.0000 1.0000 1.0000 196 $ 1.0000 0.9941 0.9971 170 PDT 0.9006 0.9277 0.9139 166 RBS 0.8818 0.8661 0.8739 112 FW 0.9286 0.6701 0.7784 97 NFP 0.9583 0.7667 0.8519 60 WP$ 1.0000 1.0000 1.0000 38 SYM 0.9355 0.9667 0.9508 30 XX 0.7407 0.6250 0.6780 32 ADD 0.9545 1.0000 0.9767 21 LS 1.0000 1.0000 1.0000 16 AFX 0.6667 0.6667 0.6667 3 accuracy 0.9811 169575 macro avg 0.9534 0.9486 0.9501 169575 weighted avg 0.9812 0.9811 0.9811 169575 2023-04-06 06:24:04,058 ----------------------------------------------------------------------------------------------------