2020-10-27 12:05:47,800 ----------------------------------------------------------------------------------------------------
2020-10-27 12:05:47,801 Model: "SequenceTagger(
  (embeddings): StackedEmbeddings(
    (list_embedding_0): WordEmbeddings('glove')
    (list_embedding_1): FlairEmbeddings(
      (lm): LanguageModel(
        (drop): Dropout(p=0.1, inplace=False)
        (encoder): Embedding(7125, 100)
        (rnn): LSTM(100, 2048)
        (decoder): Linear(in_features=2048, out_features=7125, bias=True)
      )
    )
    (list_embedding_2): FlairEmbeddings(
      (lm): LanguageModel(
        (drop): Dropout(p=0.1, inplace=False)
        (encoder): Embedding(7125, 100)
        (rnn): LSTM(100, 2048)
        (decoder): Linear(in_features=2048, out_features=7125, bias=True)
      )
    )
  )
  (word_dropout): WordDropout(p=0.05)
  (locked_dropout): LockedDropout(p=0.5)
  (embedding2nn): Linear(in_features=4196, out_features=4196, bias=True)
  (rnn): LSTM(4196, 256, batch_first=True, bidirectional=True)
  (linear): Linear(in_features=512, out_features=15, bias=True)
  (beta): 1.0
  (weights): None
  (weight_tensor) None
)"
2020-10-27 12:05:47,801 ----------------------------------------------------------------------------------------------------
2020-10-27 12:05:47,801 Corpus: "MultiCorpus: 7014 train + 779 dev + 865 test sentences
 - ColumnCorpus Corpus: 3025 train + 336 dev + 373 test sentences
 - ColumnCorpus Corpus: 3989 train + 443 dev + 492 test sentences"
2020-10-27 12:05:47,801 ----------------------------------------------------------------------------------------------------
2020-10-27 12:05:47,801 Parameters:
2020-10-27 12:05:47,801  - learning_rate: "0.22499999999999998"
2020-10-27 12:05:47,801  - mini_batch_size: "32"
2020-10-27 12:05:47,801  - patience: "3"
2020-10-27 12:05:47,801  - anneal_factor: "0.5"
2020-10-27 12:05:47,801  - max_epochs: "150"
2020-10-27 12:05:47,801  - shuffle: "True"
2020-10-27 12:05:47,801  - train_with_dev: "False"
2020-10-27 12:05:47,801  - batch_growth_annealing: "False"
2020-10-27 12:05:47,801 ----------------------------------------------------------------------------------------------------
2020-10-27 12:05:47,801 Model training base path: "/vol/fob-vol4/nebenf17/megahedm/PycharmProjects/thesis/standalone_scripts/resources/taggersg10/multi-ner-aqmar-aner-consistent0.22499999999999998"
2020-10-27 12:05:47,801 ----------------------------------------------------------------------------------------------------
2020-10-27 12:05:47,801 Device: cuda:0
2020-10-27 12:05:47,801 ----------------------------------------------------------------------------------------------------
2020-10-27 12:05:47,801 Embeddings storage mode: cpu
2020-10-27 12:05:47,805 ----------------------------------------------------------------------------------------------------
2020-10-27 12:06:02,247 epoch 1 - iter 22/220 - loss 21.72156876 - samples/sec: 48.76 - lr: 0.225000
2020-10-27 12:06:16,641 epoch 1 - iter 44/220 - loss 17.36658088 - samples/sec: 48.92 - lr: 0.225000
2020-10-27 12:06:28,991 epoch 1 - iter 66/220 - loss 14.93519770 - samples/sec: 57.03 - lr: 0.225000
2020-10-27 12:06:44,560 epoch 1 - iter 88/220 - loss 13.49500377 - samples/sec: 45.23 - lr: 0.225000
2020-10-27 12:07:03,016 epoch 1 - iter 110/220 - loss 12.35758358 - samples/sec: 38.15 - lr: 0.225000
2020-10-27 12:07:25,775 epoch 1 - iter 132/220 - loss 11.53746209 - samples/sec: 30.94 - lr: 0.225000
2020-10-27 12:07:38,625 epoch 1 - iter 154/220 - loss 10.81846843 - samples/sec: 54.80 - lr: 0.225000
2020-10-27 12:07:53,284 epoch 1 - iter 176/220 - loss 10.21996047 - samples/sec: 48.04 - lr: 0.225000
2020-10-27 12:08:05,590 epoch 1 - iter 198/220 - loss 9.69320295 - samples/sec: 57.22 - lr: 0.225000
2020-10-27 12:08:17,507 epoch 1 - iter 220/220 - loss 9.26085288 - samples/sec: 59.09 - lr: 0.225000
2020-10-27 12:08:17,507 ----------------------------------------------------------------------------------------------------
2020-10-27 12:08:17,507 EPOCH 1 done: loss 9.2609 - lr 0.2250000
2020-10-27 12:08:26,704 DEV : loss 4.357314109802246 - score 0.6514
2020-10-27 12:08:26,798 BAD EPOCHS (no improvement): 0
2020-10-27 12:08:33,060 ----------------------------------------------------------------------------------------------------
2020-10-27 12:08:47,131 epoch 2 - iter 22/220 - loss 5.43133376 - samples/sec: 50.05 - lr: 0.225000
2020-10-27 12:08:59,866 epoch 2 - iter 44/220 - loss 5.22724574 - samples/sec: 55.31 - lr: 0.225000
2020-10-27 12:09:11,147 epoch 2 - iter 66/220 - loss 5.00626698 - samples/sec: 62.44 - lr: 0.225000
2020-10-27 12:09:17,342 epoch 2 - iter 88/220 - loss 4.90757754 - samples/sec: 113.74 - lr: 0.225000
2020-10-27 12:09:21,949 epoch 2 - iter 110/220 - loss 4.83277285 - samples/sec: 152.95 - lr: 0.225000
2020-10-27 12:09:27,910 epoch 2 - iter 132/220 - loss 4.78532381 - samples/sec: 118.19 - lr: 0.225000
2020-10-27 12:09:35,404 epoch 2 - iter 154/220 - loss 4.82884749 - samples/sec: 94.01 - lr: 0.225000
2020-10-27 12:09:43,747 epoch 2 - iter 176/220 - loss 4.83316219 - samples/sec: 84.43 - lr: 0.225000
2020-10-27 12:09:56,645 epoch 2 - iter 198/220 - loss 4.74905284 - samples/sec: 54.61 - lr: 0.225000
2020-10-27 12:10:08,369 epoch 2 - iter 220/220 - loss 4.71844227 - samples/sec: 60.08 - lr: 0.225000
2020-10-27 12:10:08,369 ----------------------------------------------------------------------------------------------------
2020-10-27 12:10:08,369 EPOCH 2 done: loss 4.7184 - lr 0.2250000
2020-10-27 12:10:18,695 DEV : loss 3.650542736053467 - score 0.6858
2020-10-27 12:10:18,788 BAD EPOCHS (no improvement): 0
2020-10-27 12:10:26,768 ----------------------------------------------------------------------------------------------------
2020-10-27 12:10:39,090 epoch 3 - iter 22/220 - loss 4.23549428 - samples/sec: 57.17 - lr: 0.225000
2020-10-27 12:10:48,939 epoch 3 - iter 44/220 - loss 4.20114636 - samples/sec: 71.51 - lr: 0.225000
2020-10-27 12:10:53,806 epoch 3 - iter 66/220 - loss 4.08705768 - samples/sec: 144.76 - lr: 0.225000
2020-10-27 12:11:00,119 epoch 3 - iter 88/220 - loss 3.99443903 - samples/sec: 111.63 - lr: 0.225000
2020-10-27 12:11:08,559 epoch 3 - iter 110/220 - loss 4.12962436 - samples/sec: 83.47 - lr: 0.225000
2020-10-27 12:11:13,721 epoch 3 - iter 132/220 - loss 4.07941099 - samples/sec: 136.54 - lr: 0.225000
2020-10-27 12:11:23,796 epoch 3 - iter 154/220 - loss 4.08192258 - samples/sec: 69.91 - lr: 0.225000
2020-10-27 12:11:37,094 epoch 3 - iter 176/220 - loss 4.04203941 - samples/sec: 52.96 - lr: 0.225000
2020-10-27 12:11:49,578 epoch 3 - iter 198/220 - loss 3.99655353 - samples/sec: 56.42 - lr: 0.225000
2020-10-27 12:12:00,463 epoch 3 - iter 220/220 - loss 4.00937248 - samples/sec: 64.71 - lr: 0.225000
2020-10-27 12:12:00,464 ----------------------------------------------------------------------------------------------------
2020-10-27 12:12:00,464 EPOCH 3 done: loss 4.0094 - lr 0.2250000
2020-10-27 12:12:03,278 DEV : loss 3.3086931705474854 - score 0.7112
2020-10-27 12:12:03,369 BAD EPOCHS (no improvement): 0
2020-10-27 12:12:10,516 ----------------------------------------------------------------------------------------------------
2020-10-27 12:12:18,116 epoch 4 - iter 22/220 - loss 4.06768811 - samples/sec: 92.71 - lr: 0.225000
2020-10-27 12:12:27,666 epoch 4 - iter 44/220 - loss 3.76804103 - samples/sec: 73.76 - lr: 0.225000
2020-10-27 12:12:39,726 epoch 4 - iter 66/220 - loss 3.62168957 - samples/sec: 58.41 - lr: 0.225000
2020-10-27 12:12:51,645 epoch 4 - iter 88/220 - loss 3.65168832 - samples/sec: 59.09 - lr: 0.225000
2020-10-27 12:13:02,148 epoch 4 - iter 110/220 - loss 3.60192230 - samples/sec: 67.06 - lr: 0.225000
2020-10-27 12:13:08,158 epoch 4 - iter 132/220 - loss 3.62722392 - samples/sec: 117.19 - lr: 0.225000
2020-10-27 12:13:12,943 epoch 4 - iter 154/220 - loss 3.60788447 - samples/sec: 147.28 - lr: 0.225000
2020-10-27 12:13:18,082 epoch 4 - iter 176/220 - loss 3.57548313 - samples/sec: 137.10 - lr: 0.225000
2020-10-27 12:13:25,882 epoch 4 - iter 198/220 - loss 3.60188908 - samples/sec: 90.31 - lr: 0.225000
2020-10-27 12:13:32,638 epoch 4 - iter 220/220 - loss 3.62924645 - samples/sec: 104.30 - lr: 0.225000
2020-10-27 12:13:32,639 ----------------------------------------------------------------------------------------------------
2020-10-27 12:13:32,640 EPOCH 4 done: loss 3.6292 - lr 0.2250000
2020-10-27 12:13:35,343 DEV : loss 3.309011697769165 - score 0.7226
2020-10-27 12:13:35,432 BAD EPOCHS (no improvement): 0
2020-10-27 12:13:40,072 ----------------------------------------------------------------------------------------------------
2020-10-27 12:13:45,159 epoch 5 - iter 22/220 - loss 3.01724609 - samples/sec: 138.57 - lr: 0.225000
2020-10-27 12:13:53,704 epoch 5 - iter 44/220 - loss 3.37492144 - samples/sec: 82.44 - lr: 0.225000
2020-10-27 12:14:09,399 epoch 5 - iter 66/220 - loss 3.36007021 - samples/sec: 44.86 - lr: 0.225000
2020-10-27 12:14:21,882 epoch 5 - iter 88/220 - loss 3.36079020 - samples/sec: 56.42 - lr: 0.225000
2020-10-27 12:14:34,414 epoch 5 - iter 110/220 - loss 3.35267388 - samples/sec: 56.20 - lr: 0.225000
2020-10-27 12:14:39,791 epoch 5 - iter 132/220 - loss 3.31338031 - samples/sec: 131.05 - lr: 0.225000
2020-10-27 12:14:45,047 epoch 5 - iter 154/220 - loss 3.31246630 - samples/sec: 134.06 - lr: 0.225000
2020-10-27 12:14:49,917 epoch 5 - iter 176/220 - loss 3.26755987 - samples/sec: 144.70 - lr: 0.225000
2020-10-27 12:14:55,875 epoch 5 - iter 198/220 - loss 3.27954007 - samples/sec: 118.25 - lr: 0.225000
2020-10-27 12:15:03,448 epoch 5 - iter 220/220 - loss 3.27766744 - samples/sec: 93.02 - lr: 0.225000
2020-10-27 12:15:03,449 ----------------------------------------------------------------------------------------------------
2020-10-27 12:15:03,449 EPOCH 5 done: loss 3.2777 - lr 0.2250000
2020-10-27 12:15:14,088 DEV : loss 2.980397939682007 - score 0.7325
2020-10-27 12:15:14,189 BAD EPOCHS (no improvement): 0
2020-10-27 12:15:20,931 ----------------------------------------------------------------------------------------------------
2020-10-27 12:15:33,645 epoch 6 - iter 22/220 - loss 3.13215035 - samples/sec: 55.40 - lr: 0.225000
2020-10-27 12:15:42,571 epoch 6 - iter 44/220 - loss 3.15115563 - samples/sec: 78.93 - lr: 0.225000
2020-10-27 12:15:47,525 epoch 6 - iter 66/220 - loss 3.06673181 - samples/sec: 142.28 - lr: 0.225000
2020-10-27 12:15:55,721 epoch 6 - iter 88/220 - loss 3.21855947 - samples/sec: 85.96 - lr: 0.225000
2020-10-27 12:16:00,955 epoch 6 - iter 110/220 - loss 3.18619456 - samples/sec: 134.63 - lr: 0.225000
2020-10-27 12:16:06,219 epoch 6 - iter 132/220 - loss 3.14374787 - samples/sec: 133.89 - lr: 0.225000
2020-10-27 12:16:12,115 epoch 6 - iter 154/220 - loss 3.10764233 - samples/sec: 119.53 - lr: 0.225000
2020-10-27 12:16:27,493 epoch 6 - iter 176/220 - loss 3.13611876 - samples/sec: 45.80 - lr: 0.225000
2020-10-27 12:16:39,668 epoch 6 - iter 198/220 - loss 3.11878288 - samples/sec: 57.85 - lr: 0.225000
2020-10-27 12:16:52,598 epoch 6 - iter 220/220 - loss 3.14188431 - samples/sec: 54.47 - lr: 0.225000
2020-10-27 12:16:52,599 ----------------------------------------------------------------------------------------------------
2020-10-27 12:16:52,599 EPOCH 6 done: loss 3.1419 - lr 0.2250000
2020-10-27 12:16:55,396 DEV : loss 3.105419635772705 - score 0.7271
2020-10-27 12:16:55,492 BAD EPOCHS (no improvement): 1
2020-10-27 12:16:55,494 ----------------------------------------------------------------------------------------------------
2020-10-27 12:17:02,236 epoch 7 - iter 22/220 - loss 2.95124953 - samples/sec: 104.50 - lr: 0.225000
2020-10-27 12:17:09,483 epoch 7 - iter 44/220 - loss 2.97456730 - samples/sec: 97.23 - lr: 0.225000
2020-10-27 12:17:15,008 epoch 7 - iter 66/220 - loss 2.87065883 - samples/sec: 127.57 - lr: 0.225000
2020-10-27 12:17:20,680 epoch 7 - iter 88/220 - loss 2.87860410 - samples/sec: 124.21 - lr: 0.225000
2020-10-27 12:17:25,621 epoch 7 - iter 110/220 - loss 2.86451912 - samples/sec: 142.66 - lr: 0.225000
2020-10-27 12:17:33,397 epoch 7 - iter 132/220 - loss 2.86004330 - samples/sec: 90.60 - lr: 0.225000
2020-10-27 12:17:46,399 epoch 7 - iter 154/220 - loss 2.88575552 - samples/sec: 54.17 - lr: 0.225000
2020-10-27 12:17:59,296 epoch 7 - iter 176/220 - loss 2.88827809 - samples/sec: 54.61 - lr: 0.225000
2020-10-27 12:18:10,640 epoch 7 - iter 198/220 - loss 2.85777017 - samples/sec: 62.09 - lr: 0.225000
2020-10-27 12:18:18,189 epoch 7 - iter 220/220 - loss 2.90471944 - samples/sec: 93.32 - lr: 0.225000
2020-10-27 12:18:18,190 ----------------------------------------------------------------------------------------------------
2020-10-27 12:18:18,190 EPOCH 7 done: loss 2.9047 - lr 0.2250000
2020-10-27 12:18:21,109 DEV : loss 2.7731828689575195 - score 0.7536
2020-10-27 12:18:21,203 BAD EPOCHS (no improvement): 0
2020-10-27 12:18:26,559 ----------------------------------------------------------------------------------------------------
2020-10-27 12:18:34,900 epoch 8 - iter 22/220 - loss 3.34049469 - samples/sec: 84.46 - lr: 0.225000
2020-10-27 12:18:46,184 epoch 8 - iter 44/220 - loss 3.16908484 - samples/sec: 62.43 - lr: 0.225000
2020-10-27 12:18:58,793 epoch 8 - iter 66/220 - loss 3.03785880 - samples/sec: 55.85 - lr: 0.225000
2020-10-27 12:19:12,094 epoch 8 - iter 88/220 - loss 3.01154001 - samples/sec: 52.95 - lr: 0.225000
2020-10-27 12:19:21,720 epoch 8 - iter 110/220 - loss 2.99981178 - samples/sec: 73.17 - lr: 0.225000
2020-10-27 12:19:25,847 epoch 8 - iter 132/220 - loss 2.90764044 - samples/sec: 170.72 - lr: 0.225000
2020-10-27 12:19:30,049 epoch 8 - iter 154/220 - loss 2.87539509 - samples/sec: 167.69 - lr: 0.225000
2020-10-27 12:19:35,720 epoch 8 - iter 176/220 - loss 2.83428941 - samples/sec: 124.21 - lr: 0.225000
2020-10-27 12:19:41,247 epoch 8 - iter 198/220 - loss 2.81981459 - samples/sec: 127.43 - lr: 0.225000
2020-10-27 12:19:45,417 epoch 8 - iter 220/220 - loss 2.80632640 - samples/sec: 169.00 - lr: 0.225000
2020-10-27 12:19:45,418 ----------------------------------------------------------------------------------------------------
2020-10-27 12:19:45,418 EPOCH 8 done: loss 2.8063 - lr 0.2250000
2020-10-27 12:19:48,598 DEV : loss 2.779517412185669 - score 0.7655
2020-10-27 12:19:48,710 BAD EPOCHS (no improvement): 0
2020-10-27 12:19:53,507 ----------------------------------------------------------------------------------------------------
2020-10-27 12:20:05,390 epoch 9 - iter 22/220 - loss 2.31665069 - samples/sec: 59.28 - lr: 0.225000
2020-10-27 12:20:17,605 epoch 9 - iter 44/220 - loss 2.49296085 - samples/sec: 57.66 - lr: 0.225000
2020-10-27 12:20:30,572 epoch 9 - iter 66/220 - loss 2.57428936 - samples/sec: 54.32 - lr: 0.225000
2020-10-27 12:20:36,836 epoch 9 - iter 88/220 - loss 2.57129399 - samples/sec: 112.51 - lr: 0.225000
2020-10-27 12:20:45,053 epoch 9 - iter 110/220 - loss 2.66530282 - samples/sec: 85.74 - lr: 0.225000
2020-10-27 12:20:53,174 epoch 9 - iter 132/220 - loss 2.70965663 - samples/sec: 86.75 - lr: 0.225000
2020-10-27 12:21:06,632 epoch 9 - iter 154/220 - loss 2.69707268 - samples/sec: 52.33 - lr: 0.225000
2020-10-27 12:21:21,947 epoch 9 - iter 176/220 - loss 2.73986088 - samples/sec: 45.98 - lr: 0.225000
2020-10-27 12:21:32,129 epoch 9 - iter 198/220 - loss 2.74401933 - samples/sec: 69.17 - lr: 0.225000
2020-10-27 12:21:36,427 epoch 9 - iter 220/220 - loss 2.71851618 - samples/sec: 163.98 - lr: 0.225000
2020-10-27 12:21:36,428 ----------------------------------------------------------------------------------------------------
2020-10-27 12:21:36,428 EPOCH 9 done: loss 2.7185 - lr 0.2250000
2020-10-27 12:21:39,190 DEV : loss 2.793128252029419 - score 0.7567
2020-10-27 12:21:39,280 BAD EPOCHS (no improvement): 1
2020-10-27 12:21:39,282 ----------------------------------------------------------------------------------------------------
2020-10-27 12:21:43,750 epoch 10 - iter 22/220 - loss 2.63134474 - samples/sec: 157.70 - lr: 0.225000
2020-10-27 12:21:48,364 epoch 10 - iter 44/220 - loss 2.37763923 - samples/sec: 152.68 - lr: 0.225000
2020-10-27 12:21:52,698 epoch 10 - iter 66/220 - loss 2.35365622 - samples/sec: 162.58 - lr: 0.225000
2020-10-27 12:21:57,344 epoch 10 - iter 88/220 - loss 2.45656871 - samples/sec: 151.65 - lr: 0.225000
2020-10-27 12:22:02,876 epoch 10 - iter 110/220 - loss 2.51889483 - samples/sec: 127.36 - lr: 0.225000
2020-10-27 12:22:14,660 epoch 10 - iter 132/220 - loss 2.51060120 - samples/sec: 59.76 - lr: 0.225000
2020-10-27 12:22:25,893 epoch 10 - iter 154/220 - loss 2.50385649 - samples/sec: 62.69 - lr: 0.225000
2020-10-27 12:22:37,098 epoch 10 - iter 176/220 - loss 2.50285782 - samples/sec: 62.85 - lr: 0.225000
2020-10-27 12:22:52,373 epoch 10 - iter 198/220 - loss 2.53898486 - samples/sec: 46.10 - lr: 0.225000
2020-10-27 12:23:08,559 epoch 10 - iter 220/220 - loss 2.56980184 - samples/sec: 43.51 - lr: 0.225000
2020-10-27 12:23:08,560 ----------------------------------------------------------------------------------------------------
2020-10-27 12:23:08,560 EPOCH 10 done: loss 2.5698 - lr 0.2250000
2020-10-27 12:23:13,928 DEV : loss 2.7940151691436768 - score 0.7737
2020-10-27 12:23:14,019 BAD EPOCHS (no improvement): 0
2020-10-27 12:23:20,288 ----------------------------------------------------------------------------------------------------
2020-10-27 12:23:25,735 epoch 11 - iter 22/220 - loss 2.44968478 - samples/sec: 129.40 - lr: 0.225000
2020-10-27 12:23:30,940 epoch 11 - iter 44/220 - loss 2.38979800 - samples/sec: 135.39 - lr: 0.225000
2020-10-27 12:23:42,643 epoch 11 - iter 66/220 - loss 2.43096751 - samples/sec: 60.18 - lr: 0.225000
2020-10-27 12:23:58,584 epoch 11 - iter 88/220 - loss 2.54146342 - samples/sec: 44.18 - lr: 0.225000
2020-10-27 12:24:10,977 epoch 11 - iter 110/220 - loss 2.54165204 - samples/sec: 56.82 - lr: 0.225000
2020-10-27 12:24:17,182 epoch 11 - iter 132/220 - loss 2.49870276 - samples/sec: 113.52 - lr: 0.225000
2020-10-27 12:24:22,456 epoch 11 - iter 154/220 - loss 2.49199456 - samples/sec: 133.59 - lr: 0.225000
2020-10-27 12:24:27,829 epoch 11 - iter 176/220 - loss 2.52279860 - samples/sec: 131.14 - lr: 0.225000
2020-10-27 12:24:32,240 epoch 11 - iter 198/220 - loss 2.50187585 - samples/sec: 159.72 - lr: 0.225000
2020-10-27 12:24:36,315 epoch 11 - iter 220/220 - loss 2.48392507 - samples/sec: 172.95 - lr: 0.225000
2020-10-27 12:24:36,316 ----------------------------------------------------------------------------------------------------
2020-10-27 12:24:36,316 EPOCH 11 done: loss 2.4839 - lr 0.2250000
2020-10-27 12:24:39,033 DEV : loss 2.563488721847534 - score 0.7775
2020-10-27 12:24:39,122 BAD EPOCHS (no improvement): 0
2020-10-27 12:24:43,944 ----------------------------------------------------------------------------------------------------
2020-10-27 12:24:55,994 epoch 12 - iter 22/220 - loss 2.02714897 - samples/sec: 58.45 - lr: 0.225000
2020-10-27 12:25:09,092 epoch 12 - iter 44/220 - loss 2.21455734 - samples/sec: 53.77 - lr: 0.225000
2020-10-27 12:25:20,809 epoch 12 - iter 66/220 - loss 2.25643807 - samples/sec: 60.11 - lr: 0.225000
2020-10-27 12:25:30,051 epoch 12 - iter 88/220 - loss 2.35908209 - samples/sec: 76.22 - lr: 0.225000
2020-10-27 12:25:34,512 epoch 12 - iter 110/220 - loss 2.37587952 - samples/sec: 157.92 - lr: 0.225000
2020-10-27 12:25:38,700 epoch 12 - iter 132/220 - loss 2.34841751 - samples/sec: 168.23 - lr: 0.225000
2020-10-27 12:25:43,837 epoch 12 - iter 154/220 - loss 2.39308470 - samples/sec: 137.14 - lr: 0.225000
2020-10-27 12:25:48,725 epoch 12 - iter 176/220 - loss 2.41115915 - samples/sec: 144.12 - lr: 0.225000
2020-10-27 12:25:53,822 epoch 12 - iter 198/220 - loss 2.38664560 - samples/sec: 138.23 - lr: 0.225000
2020-10-27 12:26:04,264 epoch 12 - iter 220/220 - loss 2.40292959 - samples/sec: 67.45 - lr: 0.225000
2020-10-27 12:26:04,265 ----------------------------------------------------------------------------------------------------
2020-10-27 12:26:04,265 EPOCH 12 done: loss 2.4029 - lr 0.2250000
2020-10-27 12:26:15,991 DEV : loss 2.6262385845184326 - score 0.7815
2020-10-27 12:26:16,081 BAD EPOCHS (no improvement): 0
2020-10-27 12:26:21,124 ----------------------------------------------------------------------------------------------------
2020-10-27 12:26:35,360 epoch 13 - iter 22/220 - loss 2.53050756 - samples/sec: 49.47 - lr: 0.225000
2020-10-27 12:26:39,826 epoch 13 - iter 44/220 - loss 2.32096416 - samples/sec: 157.80 - lr: 0.225000
2020-10-27 12:26:44,233 epoch 13 - iter 66/220 - loss 2.21385196 - samples/sec: 159.91 - lr: 0.225000
2020-10-27 12:26:49,040 epoch 13 - iter 88/220 - loss 2.21185741 - samples/sec: 146.54 - lr: 0.225000
2020-10-27 12:26:53,581 epoch 13 - iter 110/220 - loss 2.26113133 - samples/sec: 155.19 - lr: 0.225000
2020-10-27 12:27:05,023 epoch 13 - iter 132/220 - loss 2.27267018 - samples/sec: 61.54 - lr: 0.225000
2020-10-27 12:27:17,261 epoch 13 - iter 154/220 - loss 2.29033957 - samples/sec: 57.55 - lr: 0.225000
2020-10-27 12:27:30,068 epoch 13 - iter 176/220 - loss 2.31603012 - samples/sec: 54.98 - lr: 0.225000
2020-10-27 12:27:38,530 epoch 13 - iter 198/220 - loss 2.33790645 - samples/sec: 83.23 - lr: 0.225000
2020-10-27 12:27:45,431 epoch 13 - iter 220/220 - loss 2.36088650 - samples/sec: 102.12 - lr: 0.225000
2020-10-27 12:27:45,431 ----------------------------------------------------------------------------------------------------
2020-10-27 12:27:45,432 EPOCH 13 done: loss 2.3609 - lr 0.2250000
2020-10-27 12:27:48,243 DEV : loss 2.4089651107788086 - score 0.7982
2020-10-27 12:27:48,334 BAD EPOCHS (no improvement): 0
2020-10-27 12:27:55,004 ----------------------------------------------------------------------------------------------------
2020-10-27 12:28:01,084 epoch 14 - iter 22/220 - loss 2.23864769 - samples/sec: 115.92 - lr: 0.225000
2020-10-27 12:28:10,092 epoch 14 - iter 44/220 - loss 2.31924421 - samples/sec: 78.21 - lr: 0.225000
2020-10-27 12:28:23,191 epoch 14 - iter 66/220 - loss 2.34592317 - samples/sec: 53.77 - lr: 0.225000
2020-10-27 12:28:35,182 epoch 14 - iter 88/220 - loss 2.26055756 - samples/sec: 58.73 - lr: 0.225000
2020-10-27 12:28:48,520 epoch 14 - iter 110/220 - loss 2.29314155 - samples/sec: 52.80 - lr: 0.225000
2020-10-27 12:28:53,809 epoch 14 - iter 132/220 - loss 2.26946366 - samples/sec: 133.24 - lr: 0.225000
2020-10-27 12:29:01,095 epoch 14 - iter 154/220 - loss 2.29191593 - samples/sec: 96.70 - lr: 0.225000
2020-10-27 12:29:06,911 epoch 14 - iter 176/220 - loss 2.29780499 - samples/sec: 121.14 - lr: 0.225000
2020-10-27 12:29:12,069 epoch 14 - iter 198/220 - loss 2.28559419 - samples/sec: 136.67 - lr: 0.225000
2020-10-27 12:29:16,611 epoch 14 - iter 220/220 - loss 2.25290804 - samples/sec: 155.21 - lr: 0.225000
2020-10-27 12:29:16,612 ----------------------------------------------------------------------------------------------------
2020-10-27 12:29:16,612 EPOCH 14 done: loss 2.2529 - lr 0.2250000
2020-10-27 12:29:19,349 DEV : loss 2.491441011428833 - score 0.7965
2020-10-27 12:29:19,441 BAD EPOCHS (no improvement): 1
2020-10-27 12:29:19,443 ----------------------------------------------------------------------------------------------------
2020-10-27 12:29:27,967 epoch 15 - iter 22/220 - loss 1.92287864 - samples/sec: 82.63 - lr: 0.225000
2020-10-27 12:29:42,698 epoch 15 - iter 44/220 - loss 2.12590682 - samples/sec: 47.81 - lr: 0.225000
2020-10-27 12:29:55,268 epoch 15 - iter 66/220 - loss 2.02216658 - samples/sec: 56.03 - lr: 0.225000
2020-10-27 12:30:04,125 epoch 15 - iter 88/220 - loss 2.08587442 - samples/sec: 79.54 - lr: 0.225000
2020-10-27 12:30:09,963 epoch 15 - iter 110/220 - loss 2.11496682 - samples/sec: 120.70 - lr: 0.225000
2020-10-27 12:30:16,215 epoch 15 - iter 132/220 - loss 2.16666134 - samples/sec: 112.72 - lr: 0.225000
2020-10-27 12:30:21,169 epoch 15 - iter 154/220 - loss 2.17134710 - samples/sec: 142.24 - lr: 0.225000
2020-10-27 12:30:25,738 epoch 15 - iter 176/220 - loss 2.16911508 - samples/sec: 154.30 - lr: 0.225000
2020-10-27 12:30:38,934 epoch 15 - iter 198/220 - loss 2.16545147 - samples/sec: 53.37 - lr: 0.225000
2020-10-27 12:30:54,058 epoch 15 - iter 220/220 - loss 2.17682712 - samples/sec: 46.57 - lr: 0.225000
2020-10-27 12:30:54,059 ----------------------------------------------------------------------------------------------------
2020-10-27 12:30:54,059 EPOCH 15 done: loss 2.1768 - lr 0.2250000
2020-10-27 12:31:04,716 DEV : loss 2.37196946144104 - score 0.8027
2020-10-27 12:31:04,810 BAD EPOCHS (no improvement): 0
2020-10-27 12:31:09,762 ----------------------------------------------------------------------------------------------------
2020-10-27 12:31:15,011 epoch 16 - iter 22/220 - loss 1.97623894 - samples/sec: 134.29 - lr: 0.225000
2020-10-27 12:31:23,231 epoch 16 - iter 44/220 - loss 2.03980692 - samples/sec: 85.71 - lr: 0.225000
2020-10-27 12:31:28,282 epoch 16 - iter 66/220 - loss 1.98214160 - samples/sec: 139.52 - lr: 0.225000
2020-10-27 12:31:34,695 epoch 16 - iter 88/220 - loss 2.02426663 - samples/sec: 109.87 - lr: 0.225000
2020-10-27 12:31:49,521 epoch 16 - iter 110/220 - loss 2.05081303 - samples/sec: 47.50 - lr: 0.225000
2020-10-27 12:32:02,747 epoch 16 - iter 132/220 - loss 2.01900621 - samples/sec: 53.25 - lr: 0.225000
2020-10-27 12:32:14,078 epoch 16 - iter 154/220 - loss 2.04827920 - samples/sec: 62.17 - lr: 0.225000
2020-10-27 12:32:18,855 epoch 16 - iter 176/220 - loss 2.07784161 - samples/sec: 147.50 - lr: 0.225000
2020-10-27 12:32:23,531 epoch 16 - iter 198/220 - loss 2.08952794 - samples/sec: 150.67 - lr: 0.225000
2020-10-27 12:32:28,382 epoch 16 - iter 220/220 - loss 2.10784333 - samples/sec: 145.23 - lr: 0.225000
2020-10-27 12:32:28,383 ----------------------------------------------------------------------------------------------------
2020-10-27 12:32:28,383 EPOCH 16 done: loss 2.1078 - lr 0.2250000
2020-10-27 12:32:32,273 DEV : loss 2.5245633125305176 - score 0.803
2020-10-27 12:32:32,365 BAD EPOCHS (no improvement): 0
2020-10-27 12:32:37,565 ----------------------------------------------------------------------------------------------------
2020-10-27 12:32:51,341 epoch 17 - iter 22/220 - loss 2.25919744 - samples/sec: 51.13 - lr: 0.225000
2020-10-27 12:33:03,845 epoch 17 - iter 44/220 - loss 2.12309913 - samples/sec: 56.33 - lr: 0.225000
2020-10-27 12:33:15,578 epoch 17 - iter 66/220 - loss 2.03627871 - samples/sec: 60.04 - lr: 0.225000
2020-10-27 12:33:22,955 epoch 17 - iter 88/220 - loss 2.04245588 - samples/sec: 95.50 - lr: 0.225000
2020-10-27 12:33:30,773 epoch 17 - iter 110/220 - loss 2.08617968 - samples/sec: 90.10 - lr: 0.225000
2020-10-27 12:33:36,567 epoch 17 - iter 132/220 - loss 2.08618107 - samples/sec: 121.63 - lr: 0.225000
2020-10-27 12:33:41,773 epoch 17 - iter 154/220 - loss 2.07305496 - samples/sec: 135.37 - lr: 0.225000
2020-10-27 12:33:46,561 epoch 17 - iter 176/220 - loss 2.05039975 - samples/sec: 147.18 - lr: 0.225000
2020-10-27 12:33:52,530 epoch 17 - iter 198/220 - loss 2.05137526 - samples/sec: 118.05 - lr: 0.225000
2020-10-27 12:34:02,039 epoch 17 - iter 220/220 - loss 2.03644036 - samples/sec: 74.08 - lr: 0.225000
2020-10-27 12:34:02,039 ----------------------------------------------------------------------------------------------------
2020-10-27 12:34:02,040 EPOCH 17 done: loss 2.0364 - lr 0.2250000
2020-10-27 12:34:11,961 DEV : loss 2.453366994857788 - score 0.8065
2020-10-27 12:34:12,052 BAD EPOCHS (no improvement): 0
2020-10-27 12:34:17,298 ----------------------------------------------------------------------------------------------------
2020-10-27 12:34:28,812 epoch 18 - iter 22/220 - loss 1.88277048 - samples/sec: 61.17 - lr: 0.225000
2020-10-27 12:34:43,634 epoch 18 - iter 44/220 - loss 2.00759000 - samples/sec: 47.51 - lr: 0.225000
2020-10-27 12:34:57,932 epoch 18 - iter 66/220 - loss 2.05621321 - samples/sec: 49.25 - lr: 0.225000
2020-10-27 12:35:02,286 epoch 18 - iter 88/220 - loss 2.03819990 - samples/sec: 161.83 - lr: 0.225000
2020-10-27 12:35:06,748 epoch 18 - iter 110/220 - loss 1.97785278 - samples/sec: 157.91 - lr: 0.225000
2020-10-27 12:35:12,093 epoch 18 - iter 132/220 - loss 1.99511385 - samples/sec: 131.79 - lr: 0.225000
2020-10-27 12:35:16,795 epoch 18 - iter 154/220 - loss 1.98887253 - samples/sec: 149.81 - lr: 0.225000
2020-10-27 12:35:21,616 epoch 18 - iter 176/220 - loss 1.97946972 - samples/sec: 146.16 - lr: 0.225000
2020-10-27 12:35:29,227 epoch 18 - iter 198/220 - loss 1.98102472 - samples/sec: 92.53 - lr: 0.225000
2020-10-27 12:35:41,596 epoch 18 - iter 220/220 - loss 2.01778167 - samples/sec: 56.94 - lr: 0.225000
2020-10-27 12:35:41,597 ----------------------------------------------------------------------------------------------------
2020-10-27 12:35:41,597 EPOCH 18 done: loss 2.0178 - lr 0.2250000
2020-10-27 12:35:52,222 DEV : loss 2.3601646423339844 - score 0.8032
2020-10-27 12:35:52,313 BAD EPOCHS (no improvement): 1
2020-10-27 12:35:52,315 ----------------------------------------------------------------------------------------------------
2020-10-27 12:36:03,902 epoch 19 - iter 22/220 - loss 1.77557576 - samples/sec: 60.78 - lr: 0.225000
2020-10-27 12:36:09,788 epoch 19 - iter 44/220 - loss 1.75028176 - samples/sec: 119.69 - lr: 0.225000
2020-10-27 12:36:14,412 epoch 19 - iter 66/220 - loss 1.80401198 - samples/sec: 152.39 - lr: 0.225000
2020-10-27 12:36:20,460 epoch 19 - iter 88/220 - loss 1.87274519 - samples/sec: 116.47 - lr: 0.225000
2020-10-27 12:36:29,106 epoch 19 - iter 110/220 - loss 1.92952758 - samples/sec: 81.46 - lr: 0.225000
2020-10-27 12:36:40,893 epoch 19 - iter 132/220 - loss 1.87542219 - samples/sec: 59.74 - lr: 0.225000
2020-10-27 12:36:55,273 epoch 19 - iter 154/220 - loss 1.90419455 - samples/sec: 48.97 - lr: 0.225000
2020-10-27 12:37:06,884 epoch 19 - iter 176/220 - loss 1.90992625 - samples/sec: 60.65 - lr: 0.225000
2020-10-27 12:37:12,838 epoch 19 - iter 198/220 - loss 1.91041818 - samples/sec: 118.37 - lr: 0.225000
2020-10-27 12:37:18,142 epoch 19 - iter 220/220 - loss 1.92723032 - samples/sec: 132.87 - lr: 0.225000
2020-10-27 12:37:18,142 ----------------------------------------------------------------------------------------------------
2020-10-27 12:37:18,142 EPOCH 19 done: loss 1.9272 - lr 0.2250000
2020-10-27 12:37:20,946 DEV : loss 2.360044240951538 - score 0.8085
2020-10-27 12:37:21,035 BAD EPOCHS (no improvement): 0
2020-10-27 12:37:25,967 ----------------------------------------------------------------------------------------------------
2020-10-27 12:37:36,762 epoch 20 - iter 22/220 - loss 1.99471245 - samples/sec: 65.25 - lr: 0.225000
2020-10-27 12:37:50,022 epoch 20 - iter 44/220 - loss 1.97245984 - samples/sec: 53.11 - lr: 0.225000
2020-10-27 12:38:03,183 epoch 20 - iter 66/220 - loss 1.90306253 - samples/sec: 53.51 - lr: 0.225000
2020-10-27 12:38:12,191 epoch 20 - iter 88/220 - loss 1.86059390 - samples/sec: 78.19 - lr: 0.225000
2020-10-27 12:38:19,219 epoch 20 - iter 110/220 - loss 1.86575733 - samples/sec: 100.24 - lr: 0.225000
2020-10-27 12:38:24,310 epoch 20 - iter 132/220 - loss 1.87260439 - samples/sec: 138.42 - lr: 0.225000
2020-10-27 12:38:29,671 epoch 20 - iter 154/220 - loss 1.87507673 - samples/sec: 131.48 - lr: 0.225000
2020-10-27 12:38:35,114 epoch 20 - iter 176/220 - loss 1.89309079 - samples/sec: 129.43 - lr: 0.225000
2020-10-27 12:38:41,713 epoch 20 - iter 198/220 - loss 1.90511416 - samples/sec: 106.76 - lr: 0.225000
2020-10-27 12:38:49,270 epoch 20 - iter 220/220 - loss 1.90412496 - samples/sec: 93.22 - lr: 0.225000
2020-10-27 12:38:49,271 ----------------------------------------------------------------------------------------------------
2020-10-27 12:38:49,271 EPOCH 20 done: loss 1.9041 - lr 0.2250000
2020-10-27 12:39:01,022 DEV : loss 2.4554529190063477 - score 0.8069
2020-10-27 12:39:01,113 BAD EPOCHS (no improvement): 1
2020-10-27 12:39:01,117 ----------------------------------------------------------------------------------------------------
2020-10-27 12:39:13,432 epoch 21 - iter 22/220 - loss 1.86487066 - samples/sec: 57.18 - lr: 0.225000
2020-10-27 12:39:24,535 epoch 21 - iter 44/220 - loss 1.74311205 - samples/sec: 63.42 - lr: 0.225000
2020-10-27 12:39:29,734 epoch 21 - iter 66/220 - loss 1.78015232 - samples/sec: 135.54 - lr: 0.225000
2020-10-27 12:39:35,186 epoch 21 - iter 88/220 - loss 1.83119386 - samples/sec: 129.21 - lr: 0.225000
2020-10-27 12:39:40,207 epoch 21 - iter 110/220 - loss 1.86643042 - samples/sec: 140.28 - lr: 0.225000
2020-10-27 12:39:46,702 epoch 21 - iter 132/220 - loss 1.86979185 - samples/sec: 108.46 - lr: 0.225000
2020-10-27 12:39:51,844 epoch 21 - iter 154/220 - loss 1.85645070 - samples/sec: 137.00 - lr: 0.225000
2020-10-27 12:39:56,607 epoch 21 - iter 176/220 - loss 1.83186082 - samples/sec: 147.91 - lr: 0.225000
2020-10-27 12:40:02,156 epoch 21 - iter 198/220 - loss 1.82740227 - samples/sec: 126.94 - lr: 0.225000
2020-10-27 12:40:16,298 epoch 21 - iter 220/220 - loss 1.84204045 - samples/sec: 49.79 - lr: 0.225000
2020-10-27 12:40:16,299 ----------------------------------------------------------------------------------------------------
2020-10-27 12:40:16,299 EPOCH 21 done: loss 1.8420 - lr 0.2250000
2020-10-27 12:40:26,861 DEV : loss 2.573260545730591 - score 0.8185
2020-10-27 12:40:26,952 BAD EPOCHS (no improvement): 0
2020-10-27 12:40:32,054 ----------------------------------------------------------------------------------------------------
2020-10-27 12:40:43,473 epoch 22 - iter 22/220 - loss 1.74188938 - samples/sec: 61.68 - lr: 0.225000
2020-10-27 12:40:48,489 epoch 22 - iter 44/220 - loss 1.72658179 - samples/sec: 140.52 - lr: 0.225000
2020-10-27 12:40:53,577 epoch 22 - iter 66/220 - loss 1.72961534 - samples/sec: 138.51 - lr: 0.225000
2020-10-27 12:40:58,806 epoch 22 - iter 88/220 - loss 1.75085494 - samples/sec: 134.77 - lr: 0.225000
2020-10-27 12:41:03,768 epoch 22 - iter 110/220 - loss 1.70912222 - samples/sec: 142.04 - lr: 0.225000
2020-10-27 12:41:12,312 epoch 22 - iter 132/220 - loss 1.76422907 - samples/sec: 82.44 - lr: 0.225000
2020-10-27 12:41:25,422 epoch 22 - iter 154/220 - loss 1.77905672 - samples/sec: 53.73 - lr: 0.225000
2020-10-27 12:41:38,125 epoch 22 - iter 176/220 - loss 1.78336771 - samples/sec: 55.44 - lr: 0.225000
2020-10-27 12:41:51,784 epoch 22 - iter 198/220 - loss 1.80363764 - samples/sec: 51.56 - lr: 0.225000
2020-10-27 12:41:56,516 epoch 22 - iter 220/220 - loss 1.80974004 - samples/sec: 148.93 - lr: 0.225000
2020-10-27 12:41:56,517 ----------------------------------------------------------------------------------------------------
2020-10-27 12:41:56,517 EPOCH 22 done: loss 1.8097 - lr 0.2250000
2020-10-27 12:41:59,253 DEV : loss 2.4855546951293945 - score 0.808
2020-10-27 12:41:59,342 BAD EPOCHS (no improvement): 1
2020-10-27 12:41:59,344 ----------------------------------------------------------------------------------------------------
2020-10-27 12:42:05,049 epoch 23 - iter 22/220 - loss 1.86688779 - samples/sec: 123.49 - lr: 0.225000
2020-10-27 12:42:10,230 epoch 23 - iter 44/220 - loss 1.74858929 - samples/sec: 136.05 - lr: 0.225000
2020-10-27 12:42:19,742 epoch 23 - iter 66/220 - loss 1.71376983 - samples/sec: 74.06 - lr: 0.225000
2020-10-27 12:42:32,806 epoch 23 - iter 88/220 - loss 1.73621455 - samples/sec: 53.91 - lr: 0.225000
2020-10-27 12:42:51,013 epoch 23 - iter 110/220 - loss 1.79062642 - samples/sec: 38.68 - lr: 0.225000
2020-10-27 12:42:57,875 epoch 23 - iter 132/220 - loss 1.78013757 - samples/sec: 102.67 - lr: 0.225000
2020-10-27 12:43:02,826 epoch 23 - iter 154/220 - loss 1.75113731 - samples/sec: 142.36 - lr: 0.225000
2020-10-27 12:43:07,208 epoch 23 - iter 176/220 - loss 1.75324832 - samples/sec: 160.86 - lr: 0.225000
2020-10-27 12:43:13,519 epoch 23 - iter 198/220 - loss 1.75215422 - samples/sec: 111.65 - lr: 0.225000
2020-10-27 12:43:26,366 epoch 23 - iter 220/220 - loss 1.75435917 - samples/sec: 54.82 - lr: 0.225000
2020-10-27 12:43:26,366 ----------------------------------------------------------------------------------------------------
2020-10-27 12:43:26,366 EPOCH 23 done: loss 1.7544 - lr 0.2250000
2020-10-27 12:43:36,928 DEV : loss 2.5096943378448486 - score 0.811
2020-10-27 12:43:37,019 BAD EPOCHS (no improvement): 2
2020-10-27 12:43:37,022 ----------------------------------------------------------------------------------------------------
2020-10-27 12:43:49,574 epoch 24 - iter 22/220 - loss 1.74223502 - samples/sec: 56.11 - lr: 0.225000
2020-10-27 12:43:56,655 epoch 24 - iter 44/220 - loss 1.67732832 - samples/sec: 99.47 - lr: 0.225000
2020-10-27 12:44:04,323 epoch 24 - iter 66/220 - loss 1.79097070 - samples/sec: 91.86 - lr: 0.225000
2020-10-27 12:44:11,673 epoch 24 - iter 88/220 - loss 1.84229901 - samples/sec: 95.84 - lr: 0.225000
2020-10-27 12:44:16,367 epoch 24 - iter 110/220 - loss 1.77077905 - samples/sec: 150.11 - lr: 0.225000
2020-10-27 12:44:22,366 epoch 24 - iter 132/220 - loss 1.75484464 - samples/sec: 117.42 - lr: 0.225000
2020-10-27 12:44:27,014 epoch 24 - iter 154/220 - loss 1.73447485 - samples/sec: 151.62 - lr: 0.225000
2020-10-27 12:44:37,937 epoch 24 - iter 176/220 - loss 1.73411978 - samples/sec: 64.47 - lr: 0.225000
2020-10-27 12:44:50,314 epoch 24 - iter 198/220 - loss 1.73462506 - samples/sec: 56.91 - lr: 0.225000
2020-10-27 12:45:02,901 epoch 24 - iter 220/220 - loss 1.73644311 - samples/sec: 55.95 - lr: 0.225000
2020-10-27 12:45:02,903 ----------------------------------------------------------------------------------------------------
2020-10-27 12:45:02,904 EPOCH 24 done: loss 1.7364 - lr 0.2250000
2020-10-27 12:45:10,226 DEV : loss 2.474473476409912 - score 0.809
2020-10-27 12:45:10,316 BAD EPOCHS (no improvement): 3
2020-10-27 12:45:10,318 ----------------------------------------------------------------------------------------------------
2020-10-27 12:45:15,991 epoch 25 - iter 22/220 - loss 1.64802131 - samples/sec: 124.21 - lr: 0.225000
2020-10-27 12:45:23,214 epoch 25 - iter 44/220 - loss 1.77049944 - samples/sec: 97.54 - lr: 0.225000
2020-10-27 12:45:27,888 epoch 25 - iter 66/220 - loss 1.68406257 - samples/sec: 150.84 - lr: 0.225000
2020-10-27 12:45:33,509 epoch 25 - iter 88/220 - loss 1.71061383 - samples/sec: 125.35 - lr: 0.225000
2020-10-27 12:45:38,375 epoch 25 - iter 110/220 - loss 1.68498092 - samples/sec: 144.88 - lr: 0.225000
2020-10-27 12:45:52,441 epoch 25 - iter 132/220 - loss 1.73319588 - samples/sec: 50.07 - lr: 0.225000
2020-10-27 12:46:03,402 epoch 25 - iter 154/220 - loss 1.71563311 - samples/sec: 64.26 - lr: 0.225000
2020-10-27 12:46:15,455 epoch 25 - iter 176/220 - loss 1.73312951 - samples/sec: 58.43 - lr: 0.225000
2020-10-27 12:46:27,041 epoch 25 - iter 198/220 - loss 1.72981594 - samples/sec: 60.78 - lr: 0.225000
2020-10-27 12:46:38,311 epoch 25 - iter 220/220 - loss 1.72111837 - samples/sec: 62.49 - lr: 0.225000
2020-10-27 12:46:38,312 ----------------------------------------------------------------------------------------------------
2020-10-27 12:46:38,312 EPOCH 25 done: loss 1.7211 - lr 0.2250000
2020-10-27 12:46:48,911 DEV : loss 2.4124410152435303 - score 0.8202
2020-10-27 12:46:49,002 BAD EPOCHS (no improvement): 0
2020-10-27 12:46:55,062 ----------------------------------------------------------------------------------------------------
2020-10-27 12:47:00,507 epoch 26 - iter 22/220 - loss 1.47689831 - samples/sec: 129.44 - lr: 0.225000
2020-10-27 12:47:06,061 epoch 26 - iter 44/220 - loss 1.61913649 - samples/sec: 126.92 - lr: 0.225000
2020-10-27 12:47:14,984 epoch 26 - iter 66/220 - loss 1.68473643 - samples/sec: 78.94 - lr: 0.225000
2020-10-27 12:47:27,813 epoch 26 - iter 88/220 - loss 1.65883661 - samples/sec: 54.90 - lr: 0.225000
2020-10-27 12:47:41,523 epoch 26 - iter 110/220 - loss 1.65635245 - samples/sec: 51.37 - lr: 0.225000
2020-10-27 12:47:52,889 epoch 26 - iter 132/220 - loss 1.65112599 - samples/sec: 61.97 - lr: 0.225000
2020-10-27 12:47:59,810 epoch 26 - iter 154/220 - loss 1.65904180 - samples/sec: 101.79 - lr: 0.225000
2020-10-27 12:48:04,855 epoch 26 - iter 176/220 - loss 1.68027522 - samples/sec: 139.71 - lr: 0.225000
2020-10-27 12:48:10,039 epoch 26 - iter 198/220 - loss 1.70725280 - samples/sec: 135.95 - lr: 0.225000
2020-10-27 12:48:20,106 epoch 26 - iter 220/220 - loss 1.70943521 - samples/sec: 69.97 - lr: 0.225000
2020-10-27 12:48:20,107 ----------------------------------------------------------------------------------------------------
2020-10-27 12:48:20,107 EPOCH 26 done: loss 1.7094 - lr 0.2250000
2020-10-27 12:48:30,762 DEV : loss 2.500894069671631 - score 0.8204
2020-10-27 12:48:30,852 BAD EPOCHS (no improvement): 0
2020-10-27 12:48:35,794 ----------------------------------------------------------------------------------------------------
2020-10-27 12:48:48,980 epoch 27 - iter 22/220 - loss 1.62387518 - samples/sec: 53.42 - lr: 0.225000
2020-10-27 12:48:58,202 epoch 27 - iter 44/220 - loss 1.62897398 - samples/sec: 76.39 - lr: 0.225000
2020-10-27 12:49:03,304 epoch 27 - iter 66/220 - loss 1.54914082 - samples/sec: 138.17 - lr: 0.225000
2020-10-27 12:49:08,926 epoch 27 - iter 88/220 - loss 1.57666769 - samples/sec: 125.34 - lr: 0.225000
2020-10-27 12:49:13,857 epoch 27 - iter 110/220 - loss 1.59424242 - samples/sec: 142.93 - lr: 0.225000
2020-10-27 12:49:19,450 epoch 27 - iter 132/220 - loss 1.61215915 - samples/sec: 125.98 - lr: 0.225000
2020-10-27 12:49:33,779 epoch 27 - iter 154/220 - loss 1.61058897 - samples/sec: 49.15 - lr: 0.225000
2020-10-27 12:49:47,037 epoch 27 - iter 176/220 - loss 1.61811885 - samples/sec: 53.12 - lr: 0.225000
2020-10-27 12:49:59,139 epoch 27 - iter 198/220 - loss 1.62752966 - samples/sec: 58.20 - lr: 0.225000
2020-10-27 12:50:05,876 epoch 27 - iter 220/220 - loss 1.64880991 - samples/sec: 104.56 - lr: 0.225000
2020-10-27 12:50:05,877 ----------------------------------------------------------------------------------------------------
2020-10-27 12:50:05,877 EPOCH 27 done: loss 1.6488 - lr 0.2250000
2020-10-27 12:50:08,647 DEV : loss 2.494999885559082 - score 0.8088
2020-10-27 12:50:08,739 BAD EPOCHS (no improvement): 1
2020-10-27 12:50:08,742 ----------------------------------------------------------------------------------------------------
2020-10-27 12:50:14,282 epoch 28 - iter 22/220 - loss 1.39837461 - samples/sec: 127.19 - lr: 0.225000
2020-10-27 12:50:21,138 epoch 28 - iter 44/220 - loss 1.57322506 - samples/sec: 102.74 - lr: 0.225000
2020-10-27 12:50:28,904 epoch 28 - iter 66/220 - loss 1.64102983 - samples/sec: 90.72 - lr: 0.225000
2020-10-27 12:50:33,789 epoch 28 - iter 88/220 - loss 1.62348568 - samples/sec: 144.26 - lr: 0.225000
2020-10-27 12:50:42,420 epoch 28 - iter 110/220 - loss 1.61600936 - samples/sec: 81.61 - lr: 0.225000
2020-10-27 12:50:54,680 epoch 28 - iter 132/220 - loss 1.61103183 - samples/sec: 57.45 - lr: 0.225000
2020-10-27 12:51:07,425 epoch 28 - iter 154/220 - loss 1.60252403 - samples/sec: 55.26 - lr: 0.225000
2020-10-27 12:51:18,152 epoch 28 - iter 176/220 - loss 1.61057354 - samples/sec: 65.66 - lr: 0.225000
2020-10-27 12:51:25,356 epoch 28 - iter 198/220 - loss 1.61322303 - samples/sec: 97.81 - lr: 0.225000
2020-10-27 12:51:30,281 epoch 28 - iter 220/220 - loss 1.60192129 - samples/sec: 143.07 - lr: 0.225000
2020-10-27 12:51:30,282 ----------------------------------------------------------------------------------------------------
2020-10-27 12:51:30,283 EPOCH 28 done: loss 1.6019 - lr 0.2250000
2020-10-27 12:51:33,025 DEV : loss 2.357501983642578 - score 0.8259
2020-10-27 12:51:33,116 BAD EPOCHS (no improvement): 0
2020-10-27 12:51:38,642 ----------------------------------------------------------------------------------------------------
2020-10-27 12:51:44,632 epoch 29 - iter 22/220 - loss 1.61494890 - samples/sec: 117.65 - lr: 0.225000
2020-10-27 12:51:51,062 epoch 29 - iter 44/220 - loss 1.64715882 - samples/sec: 109.62 - lr: 0.225000
2020-10-27 12:52:01,714 epoch 29 - iter 66/220 - loss 1.59307289 - samples/sec: 66.12 - lr: 0.225000
2020-10-27 12:52:14,632 epoch 29 - iter 88/220 - loss 1.57276455 - samples/sec: 54.52 - lr: 0.225000
2020-10-27 12:52:26,715 epoch 29 - iter 110/220 - loss 1.55219387 - samples/sec: 58.29 - lr: 0.225000
2020-10-27 12:52:36,805 epoch 29 - iter 132/220 - loss 1.53066039 - samples/sec: 69.81 - lr: 0.225000
2020-10-27 12:52:41,655 epoch 29 - iter 154/220 - loss 1.53942226 - samples/sec: 145.28 - lr: 0.225000
2020-10-27 12:52:47,396 epoch 29 - iter 176/220 - loss 1.53856985 - samples/sec: 122.75 - lr: 0.225000
2020-10-27 12:52:55,002 epoch 29 - iter 198/220 - loss 1.58049706 - samples/sec: 92.62 - lr: 0.225000
2020-10-27 12:53:00,834 epoch 29 - iter 220/220 - loss 1.58201135 - samples/sec: 120.83 - lr: 0.225000
2020-10-27 12:53:00,836 ----------------------------------------------------------------------------------------------------
2020-10-27 12:53:00,836 EPOCH 29 done: loss 1.5820 - lr 0.2250000
2020-10-27 12:53:10,990 DEV : loss 2.561706781387329 - score 0.8203
2020-10-27 12:53:11,080 BAD EPOCHS (no improvement): 1
2020-10-27 12:53:11,082 ----------------------------------------------------------------------------------------------------
2020-10-27 12:53:23,805 epoch 30 - iter 22/220 - loss 1.58375690 - samples/sec: 55.35 - lr: 0.225000
2020-10-27 12:53:36,263 epoch 30 - iter 44/220 - loss 1.48649856 - samples/sec: 56.53 - lr: 0.225000
2020-10-27 12:53:45,511 epoch 30 - iter 66/220 - loss 1.63751886 - samples/sec: 76.17 - lr: 0.225000
2020-10-27 12:53:51,766 epoch 30 - iter 88/220 - loss 1.63109810 - samples/sec: 112.65 - lr: 0.225000
2020-10-27 12:53:57,335 epoch 30 - iter 110/220 - loss 1.63818902 - samples/sec: 126.55 - lr: 0.225000
2020-10-27 12:54:06,776 epoch 30 - iter 132/220 - loss 1.61220647 - samples/sec: 74.60 - lr: 0.225000
2020-10-27 12:54:19,617 epoch 30 - iter 154/220 - loss 1.58777726 - samples/sec: 54.85 - lr: 0.225000
2020-10-27 12:54:31,714 epoch 30 - iter 176/220 - loss 1.59743841 - samples/sec: 58.22 - lr: 0.225000
2020-10-27 12:54:42,770 epoch 30 - iter 198/220 - loss 1.62242889 - samples/sec: 63.71 - lr: 0.225000
2020-10-27 12:54:47,900 epoch 30 - iter 220/220 - loss 1.61271666 - samples/sec: 137.36 - lr: 0.225000
2020-10-27 12:54:47,902 ----------------------------------------------------------------------------------------------------
2020-10-27 12:54:47,902 EPOCH 30 done: loss 1.6127 - lr 0.2250000
2020-10-27 12:54:50,650 DEV : loss 2.413987636566162 - score 0.825
2020-10-27 12:54:50,743 BAD EPOCHS (no improvement): 2
2020-10-27 12:54:50,745 ----------------------------------------------------------------------------------------------------
2020-10-27 12:54:55,977 epoch 31 - iter 22/220 - loss 1.40717926 - samples/sec: 134.70 - lr: 0.225000
2020-10-27 12:55:02,406 epoch 31 - iter 44/220 - loss 1.41368911 - samples/sec: 109.59 - lr: 0.225000
2020-10-27 12:55:07,281 epoch 31 - iter 66/220 - loss 1.38486818 - samples/sec: 144.57 - lr: 0.225000
2020-10-27 12:55:18,057 epoch 31 - iter 88/220 - loss 1.40993762 - samples/sec: 65.36 - lr: 0.225000
2020-10-27 12:55:30,822 epoch 31 - iter 110/220 - loss 1.41606141 - samples/sec: 55.17 - lr: 0.225000
2020-10-27 12:55:42,883 epoch 31 - iter 132/220 - loss 1.44028818 - samples/sec: 58.40 - lr: 0.225000
2020-10-27 12:55:52,730 epoch 31 - iter 154/220 - loss 1.45108284 - samples/sec: 71.53 - lr: 0.225000
2020-10-27 12:55:58,864 epoch 31 - iter 176/220 - loss 1.47279506 - samples/sec: 114.87 - lr: 0.225000
2020-10-27 12:56:03,369 epoch 31 - iter 198/220 - loss 1.46984735 - samples/sec: 156.41 - lr: 0.225000
2020-10-27 12:56:11,074 epoch 31 - iter 220/220 - loss 1.51545400 - samples/sec: 91.42 - lr: 0.225000
2020-10-27 12:56:11,075 ----------------------------------------------------------------------------------------------------
2020-10-27 12:56:11,075 EPOCH 31 done: loss 1.5155 - lr 0.2250000
2020-10-27 12:56:13,868 DEV : loss 2.4587478637695312 - score 0.8251
2020-10-27 12:56:13,959 BAD EPOCHS (no improvement): 3
2020-10-27 12:56:13,961 ----------------------------------------------------------------------------------------------------
2020-10-27 12:56:18,850 epoch 32 - iter 22/220 - loss 1.48440505 - samples/sec: 144.14 - lr: 0.225000
2020-10-27 12:56:24,368 epoch 32 - iter 44/220 - loss 1.37109821 - samples/sec: 127.72 - lr: 0.225000
2020-10-27 12:56:38,994 epoch 32 - iter 66/220 - loss 1.46685502 - samples/sec: 48.15 - lr: 0.225000
2020-10-27 12:56:51,439 epoch 32 - iter 88/220 - loss 1.47329702 - samples/sec: 56.59 - lr: 0.225000
2020-10-27 12:57:04,461 epoch 32 - iter 110/220 - loss 1.48993013 - samples/sec: 54.08 - lr: 0.225000
2020-10-27 12:57:12,013 epoch 32 - iter 132/220 - loss 1.47246012 - samples/sec: 93.29 - lr: 0.225000
2020-10-27 12:57:17,732 epoch 32 - iter 154/220 - loss 1.47774610 - samples/sec: 123.21 - lr: 0.225000
2020-10-27 12:57:23,154 epoch 32 - iter 176/220 - loss 1.46848402 - samples/sec: 129.98 - lr: 0.225000
2020-10-27 12:57:28,886 epoch 32 - iter 198/220 - loss 1.46889405 - samples/sec: 122.90 - lr: 0.225000
2020-10-27 12:57:35,923 epoch 32 - iter 220/220 - loss 1.49541470 - samples/sec: 100.14 - lr: 0.225000
2020-10-27 12:57:35,923 ----------------------------------------------------------------------------------------------------
2020-10-27 12:57:35,923 EPOCH 32 done: loss 1.4954 - lr 0.2250000
2020-10-27 12:57:43,480 DEV : loss 2.3382327556610107 - score 0.8309
2020-10-27 12:57:43,569 BAD EPOCHS (no improvement): 0
2020-10-27 12:57:50,358 ----------------------------------------------------------------------------------------------------
2020-10-27 12:57:59,929 epoch 33 - iter 22/220 - loss 1.36102121 - samples/sec: 73.63 - lr: 0.225000
2020-10-27 12:58:08,482 epoch 33 - iter 44/220 - loss 1.57588377 - samples/sec: 82.36 - lr: 0.225000
2020-10-27 12:58:14,569 epoch 33 - iter 66/220 - loss 1.56591325 - samples/sec: 115.77 - lr: 0.225000
2020-10-27 12:58:20,229 epoch 33 - iter 88/220 - loss 1.56487136 - samples/sec: 124.51 - lr: 0.225000
2020-10-27 12:58:28,440 epoch 33 - iter 110/220 - loss 1.56812069 - samples/sec: 85.80 - lr: 0.225000
2020-10-27 12:58:37,161 epoch 33 - iter 132/220 - loss 1.55786607 - samples/sec: 80.76 - lr: 0.225000
2020-10-27 12:58:48,419 epoch 33 - iter 154/220 - loss 1.52647791 - samples/sec: 62.56 - lr: 0.225000
2020-10-27 12:59:00,098 epoch 33 - iter 176/220 - loss 1.51322494 - samples/sec: 60.30 - lr: 0.225000
2020-10-27 12:59:11,605 epoch 33 - iter 198/220 - loss 1.49051402 - samples/sec: 61.20 - lr: 0.225000
2020-10-27 12:59:17,019 epoch 33 - iter 220/220 - loss 1.49217498 - samples/sec: 130.13 - lr: 0.225000
2020-10-27 12:59:17,019 ----------------------------------------------------------------------------------------------------
2020-10-27 12:59:17,019 EPOCH 33 done: loss 1.4922 - lr 0.2250000
2020-10-27 12:59:19,735 DEV : loss 2.349717140197754 - score 0.8298
2020-10-27 12:59:19,825 BAD EPOCHS (no improvement): 1
2020-10-27 12:59:19,827 ----------------------------------------------------------------------------------------------------
2020-10-27 12:59:24,535 epoch 34 - iter 22/220 - loss 1.43937592 - samples/sec: 149.64 - lr: 0.225000
2020-10-27 12:59:29,756 epoch 34 - iter 44/220 - loss 1.41240240 - samples/sec: 134.95 - lr: 0.225000
2020-10-27 12:59:42,272 epoch 34 - iter 66/220 - loss 1.41759862 - samples/sec: 56.27 - lr: 0.225000
2020-10-27 12:59:56,732 epoch 34 - iter 88/220 - loss 1.46062047 - samples/sec: 48.70 - lr: 0.225000
2020-10-27 13:00:09,760 epoch 34 - iter 110/220 - loss 1.46803004 - samples/sec: 54.05 - lr: 0.225000
2020-10-27 13:00:13,896 epoch 34 - iter 132/220 - loss 1.44626426 - samples/sec: 170.36 - lr: 0.225000
2020-10-27 13:00:18,067 epoch 34 - iter 154/220 - loss 1.44228034 - samples/sec: 168.92 - lr: 0.225000
2020-10-27 13:00:25,762 epoch 34 - iter 176/220 - loss 1.47808350 - samples/sec: 91.53 - lr: 0.225000
2020-10-27 13:00:30,688 epoch 34 - iter 198/220 - loss 1.47626379 - samples/sec: 143.01 - lr: 0.225000
2020-10-27 13:00:35,792 epoch 34 - iter 220/220 - loss 1.46635973 - samples/sec: 138.01 - lr: 0.225000
2020-10-27 13:00:35,793 ----------------------------------------------------------------------------------------------------
2020-10-27 13:00:35,793 EPOCH 34 done: loss 1.4664 - lr 0.2250000
2020-10-27 13:00:45,876 DEV : loss 2.5646040439605713 - score 0.8225
2020-10-27 13:00:45,966 BAD EPOCHS (no improvement): 2
2020-10-27 13:00:45,973 ----------------------------------------------------------------------------------------------------
2020-10-27 13:00:57,937 epoch 35 - iter 22/220 - loss 1.34801367 - samples/sec: 58.86 - lr: 0.225000
2020-10-27 13:01:09,736 epoch 35 - iter 44/220 - loss 1.29323228 - samples/sec: 59.69 - lr: 0.225000
2020-10-27 13:01:20,418 epoch 35 - iter 66/220 - loss 1.33720862 - samples/sec: 65.93 - lr: 0.225000
2020-10-27 13:01:26,147 epoch 35 - iter 88/220 - loss 1.33441344 - samples/sec: 122.95 - lr: 0.225000
2020-10-27 13:01:31,239 epoch 35 - iter 110/220 - loss 1.34094476 - samples/sec: 138.34 - lr: 0.225000
2020-10-27 13:01:38,098 epoch 35 - iter 132/220 - loss 1.39527539 - samples/sec: 102.69 - lr: 0.225000
2020-10-27 13:01:43,223 epoch 35 - iter 154/220 - loss 1.41820403 - samples/sec: 137.47 - lr: 0.225000
2020-10-27 13:01:52,484 epoch 35 - iter 176/220 - loss 1.40928714 - samples/sec: 76.05 - lr: 0.225000
2020-10-27 13:02:03,806 epoch 35 - iter 198/220 - loss 1.39435094 - samples/sec: 62.20 - lr: 0.225000
2020-10-27 13:02:16,136 epoch 35 - iter 220/220 - loss 1.39695105 - samples/sec: 57.12 - lr: 0.225000
2020-10-27 13:02:16,136 ----------------------------------------------------------------------------------------------------
2020-10-27 13:02:16,136 EPOCH 35 done: loss 1.3970 - lr 0.2250000
2020-10-27 13:02:24,885 DEV : loss 2.526184558868408 - score 0.8308
2020-10-27 13:02:24,979 BAD EPOCHS (no improvement): 3
2020-10-27 13:02:24,984 ----------------------------------------------------------------------------------------------------
2020-10-27 13:02:29,646 epoch 36 - iter 22/220 - loss 1.30053040 - samples/sec: 151.12 - lr: 0.225000
2020-10-27 13:02:34,208 epoch 36 - iter 44/220 - loss 1.35997048 - samples/sec: 154.48 - lr: 0.225000
2020-10-27 13:02:38,380 epoch 36 - iter 66/220 - loss 1.33943211 - samples/sec: 168.89 - lr: 0.225000
2020-10-27 13:02:42,785 epoch 36 - iter 88/220 - loss 1.33730066 - samples/sec: 159.95 - lr: 0.225000
2020-10-27 13:02:48,743 epoch 36 - iter 110/220 - loss 1.38363578 - samples/sec: 118.24 - lr: 0.225000
2020-10-27 13:02:59,025 epoch 36 - iter 132/220 - loss 1.40173315 - samples/sec: 68.49 - lr: 0.225000
2020-10-27 13:03:10,938 epoch 36 - iter 154/220 - loss 1.38130611 - samples/sec: 59.11 - lr: 0.225000
2020-10-27 13:03:22,731 epoch 36 - iter 176/220 - loss 1.37951175 - samples/sec: 59.72 - lr: 0.225000
2020-10-27 13:03:33,720 epoch 36 - iter 198/220 - loss 1.39986166 - samples/sec: 64.09 - lr: 0.225000
2020-10-27 13:03:40,995 epoch 36 - iter 220/220 - loss 1.41202424 - samples/sec: 96.81 - lr: 0.225000
2020-10-27 13:03:40,996 ----------------------------------------------------------------------------------------------------
2020-10-27 13:03:40,996 EPOCH 36 done: loss 1.4120 - lr 0.2250000
2020-10-27 13:03:43,720 DEV : loss 2.5475125312805176 - score 0.8275
2020-10-27 13:03:43,811 BAD EPOCHS (no improvement): 4
2020-10-27 13:03:43,813 ----------------------------------------------------------------------------------------------------
2020-10-27 13:03:48,297 epoch 37 - iter 22/220 - loss 1.16522852 - samples/sec: 157.12 - lr: 0.112500
2020-10-27 13:03:52,988 epoch 37 - iter 44/220 - loss 1.20989015 - samples/sec: 150.20 - lr: 0.112500
2020-10-27 13:03:58,388 epoch 37 - iter 66/220 - loss 1.23118213 - samples/sec: 130.46 - lr: 0.112500
2020-10-27 13:04:03,158 epoch 37 - iter 88/220 - loss 1.21402848 - samples/sec: 147.70 - lr: 0.112500
2020-10-27 13:04:09,748 epoch 37 - iter 110/220 - loss 1.23571769 - samples/sec: 106.88 - lr: 0.112500
2020-10-27 13:04:21,734 epoch 37 - iter 132/220 - loss 1.23664525 - samples/sec: 58.75 - lr: 0.112500
2020-10-27 13:04:33,908 epoch 37 - iter 154/220 - loss 1.22190616 - samples/sec: 57.85 - lr: 0.112500
2020-10-27 13:04:50,631 epoch 37 - iter 176/220 - loss 1.26636531 - samples/sec: 42.11 - lr: 0.112500
2020-10-27 13:04:55,390 epoch 37 - iter 198/220 - loss 1.26111739 - samples/sec: 148.07 - lr: 0.112500
2020-10-27 13:04:59,966 epoch 37 - iter 220/220 - loss 1.24431537 - samples/sec: 153.97 - lr: 0.112500
2020-10-27 13:04:59,967 ----------------------------------------------------------------------------------------------------
2020-10-27 13:04:59,967 EPOCH 37 done: loss 1.2443 - lr 0.1125000
2020-10-27 13:05:03,829 DEV : loss 2.533643960952759 - score 0.8399
2020-10-27 13:05:03,919 BAD EPOCHS (no improvement): 0
2020-10-27 13:05:12,249 ----------------------------------------------------------------------------------------------------
2020-10-27 13:05:18,351 epoch 38 - iter 22/220 - loss 1.05645639 - samples/sec: 115.50 - lr: 0.112500
2020-10-27 13:05:26,236 epoch 38 - iter 44/220 - loss 1.17057375 - samples/sec: 89.35 - lr: 0.112500
2020-10-27 13:05:36,362 epoch 38 - iter 66/220 - loss 1.15205331 - samples/sec: 69.56 - lr: 0.112500
2020-10-27 13:05:50,321 epoch 38 - iter 88/220 - loss 1.17765528 - samples/sec: 50.45 - lr: 0.112500
2020-10-27 13:06:03,654 epoch 38 - iter 110/220 - loss 1.18789212 - samples/sec: 52.82 - lr: 0.112500
2020-10-27 13:06:15,037 epoch 38 - iter 132/220 - loss 1.17082181 - samples/sec: 61.88 - lr: 0.112500
2020-10-27 13:06:20,797 epoch 38 - iter 154/220 - loss 1.17320436 - samples/sec: 122.38 - lr: 0.112500
2020-10-27 13:06:26,514 epoch 38 - iter 176/220 - loss 1.18456747 - samples/sec: 123.27 - lr: 0.112500
2020-10-27 13:06:34,149 epoch 38 - iter 198/220 - loss 1.19421670 - samples/sec: 92.27 - lr: 0.112500
2020-10-27 13:06:40,501 epoch 38 - iter 220/220 - loss 1.16663566 - samples/sec: 110.93 - lr: 0.112500
2020-10-27 13:06:40,502 ----------------------------------------------------------------------------------------------------
2020-10-27 13:06:40,502 EPOCH 38 done: loss 1.1666 - lr 0.1125000
2020-10-27 13:06:52,102 DEV : loss 2.435422658920288 - score 0.8357
2020-10-27 13:06:52,211 BAD EPOCHS (no improvement): 1
2020-10-27 13:06:52,216 ----------------------------------------------------------------------------------------------------
2020-10-27 13:07:05,979 epoch 39 - iter 22/220 - loss 1.10592498 - samples/sec: 51.17 - lr: 0.112500
2020-10-27 13:07:18,404 epoch 39 - iter 44/220 - loss 1.10495405 - samples/sec: 56.68 - lr: 0.112500
2020-10-27 13:07:23,483 epoch 39 - iter 66/220 - loss 1.12785858 - samples/sec: 138.76 - lr: 0.112500
2020-10-27 13:07:31,211 epoch 39 - iter 88/220 - loss 1.16620872 - samples/sec: 91.15 - lr: 0.112500
2020-10-27 13:07:37,741 epoch 39 - iter 110/220 - loss 1.16255074 - samples/sec: 107.90 - lr: 0.112500
2020-10-27 13:07:45,861 epoch 39 - iter 132/220 - loss 1.15946863 - samples/sec: 86.75 - lr: 0.112500
2020-10-27 13:07:57,958 epoch 39 - iter 154/220 - loss 1.13342445 - samples/sec: 58.23 - lr: 0.112500
2020-10-27 13:08:12,955 epoch 39 - iter 176/220 - loss 1.14717589 - samples/sec: 46.95 - lr: 0.112500
2020-10-27 13:08:23,251 epoch 39 - iter 198/220 - loss 1.13790430 - samples/sec: 68.41 - lr: 0.112500
2020-10-27 13:08:28,253 epoch 39 - iter 220/220 - loss 1.14453408 - samples/sec: 140.91 - lr: 0.112500
2020-10-27 13:08:28,254 ----------------------------------------------------------------------------------------------------
2020-10-27 13:08:28,254 EPOCH 39 done: loss 1.1445 - lr 0.1125000
2020-10-27 13:08:31,014 DEV : loss 2.4387664794921875 - score 0.8342
2020-10-27 13:08:31,103 BAD EPOCHS (no improvement): 2
2020-10-27 13:08:31,106 ----------------------------------------------------------------------------------------------------
2020-10-27 13:08:38,250 epoch 40 - iter 22/220 - loss 1.27574570 - samples/sec: 98.61 - lr: 0.112500
2020-10-27 13:08:43,687 epoch 40 - iter 44/220 - loss 1.17873196 - samples/sec: 129.57 - lr: 0.112500
2020-10-27 13:08:53,188 epoch 40 - iter 66/220 - loss 1.11032047 - samples/sec: 74.13 - lr: 0.112500
2020-10-27 13:09:06,876 epoch 40 - iter 88/220 - loss 1.12161206 - samples/sec: 51.45 - lr: 0.112500
2020-10-27 13:09:18,517 epoch 40 - iter 110/220 - loss 1.11557675 - samples/sec: 60.51 - lr: 0.112500
2020-10-27 13:09:28,477 epoch 40 - iter 132/220 - loss 1.09953980 - samples/sec: 70.72 - lr: 0.112500
2020-10-27 13:09:36,420 epoch 40 - iter 154/220 - loss 1.12108603 - samples/sec: 88.69 - lr: 0.112500
2020-10-27 13:09:41,658 epoch 40 - iter 176/220 - loss 1.12516843 - samples/sec: 134.50 - lr: 0.112500
2020-10-27 13:09:47,188 epoch 40 - iter 198/220 - loss 1.11975942 - samples/sec: 127.43 - lr: 0.112500
2020-10-27 13:09:52,281 epoch 40 - iter 220/220 - loss 1.11452913 - samples/sec: 138.41 - lr: 0.112500
2020-10-27 13:09:52,282 ----------------------------------------------------------------------------------------------------
2020-10-27 13:09:52,282 EPOCH 40 done: loss 1.1145 - lr 0.1125000
2020-10-27 13:09:55,036 DEV : loss 2.422804117202759 - score 0.837
2020-10-27 13:09:55,127 BAD EPOCHS (no improvement): 3
2020-10-27 13:09:55,132 ----------------------------------------------------------------------------------------------------
2020-10-27 13:10:00,268 epoch 41 - iter 22/220 - loss 0.99314000 - samples/sec: 137.19 - lr: 0.112500
2020-10-27 13:10:12,698 epoch 41 - iter 44/220 - loss 1.08531681 - samples/sec: 56.66 - lr: 0.112500
2020-10-27 13:10:24,005 epoch 41 - iter 66/220 - loss 1.02519016 - samples/sec: 62.29 - lr: 0.112500
2020-10-27 13:10:33,719 epoch 41 - iter 88/220 - loss 1.03161212 - samples/sec: 72.53 - lr: 0.112500
2020-10-27 13:10:39,988 epoch 41 - iter 110/220 - loss 1.05876476 - samples/sec: 112.40 - lr: 0.112500
2020-10-27 13:10:46,040 epoch 41 - iter 132/220 - loss 1.05406060 - samples/sec: 116.45 - lr: 0.112500
2020-10-27 13:10:52,789 epoch 41 - iter 154/220 - loss 1.05820770 - samples/sec: 104.39 - lr: 0.112500
2020-10-27 13:10:58,270 epoch 41 - iter 176/220 - loss 1.06802812 - samples/sec: 128.58 - lr: 0.112500
2020-10-27 13:11:05,323 epoch 41 - iter 198/220 - loss 1.07915005 - samples/sec: 99.90 - lr: 0.112500
2020-10-27 13:11:10,369 epoch 41 - iter 220/220 - loss 1.07977417 - samples/sec: 139.66 - lr: 0.112500
2020-10-27 13:11:10,370 ----------------------------------------------------------------------------------------------------
2020-10-27 13:11:10,370 EPOCH 41 done: loss 1.0798 - lr 0.1125000
2020-10-27 13:11:14,209 DEV : loss 2.462563991546631 - score 0.837
2020-10-27 13:11:14,298 BAD EPOCHS (no improvement): 4
2020-10-27 13:11:14,416 ----------------------------------------------------------------------------------------------------
2020-10-27 13:11:23,335 epoch 42 - iter 22/220 - loss 1.05203831 - samples/sec: 78.98 - lr: 0.056250
2020-10-27 13:11:35,326 epoch 42 - iter 44/220 - loss 1.04549230 - samples/sec: 58.73 - lr: 0.056250
2020-10-27 13:11:48,633 epoch 42 - iter 66/220 - loss 1.02370581 - samples/sec: 52.93 - lr: 0.056250
2020-10-27 13:12:00,369 epoch 42 - iter 88/220 - loss 1.03150711 - samples/sec: 60.02 - lr: 0.056250
2020-10-27 13:12:06,321 epoch 42 - iter 110/220 - loss 1.04346986 - samples/sec: 118.36 - lr: 0.056250
2020-10-27 13:12:14,728 epoch 42 - iter 132/220 - loss 1.02090114 - samples/sec: 83.80 - lr: 0.056250
2020-10-27 13:12:26,510 epoch 42 - iter 154/220 - loss 1.01781430 - samples/sec: 59.78 - lr: 0.056250
2020-10-27 13:12:40,869 epoch 42 - iter 176/220 - loss 1.01950243 - samples/sec: 49.04 - lr: 0.056250
2020-10-27 13:12:53,443 epoch 42 - iter 198/220 - loss 1.02934017 - samples/sec: 56.01 - lr: 0.056250
2020-10-27 13:12:58,189 epoch 42 - iter 220/220 - loss 1.02086602 - samples/sec: 148.49 - lr: 0.056250
2020-10-27 13:12:58,190 ----------------------------------------------------------------------------------------------------
2020-10-27 13:12:58,190 EPOCH 42 done: loss 1.0209 - lr 0.0562500
2020-10-27 13:13:00,972 DEV : loss 2.470247507095337 - score 0.8421
2020-10-27 13:13:01,061 BAD EPOCHS (no improvement): 0
2020-10-27 13:13:10,992 ----------------------------------------------------------------------------------------------------
2020-10-27 13:13:16,427 epoch 43 - iter 22/220 - loss 0.92197161 - samples/sec: 129.69 - lr: 0.056250
2020-10-27 13:13:22,305 epoch 43 - iter 44/220 - loss 0.92393714 - samples/sec: 119.87 - lr: 0.056250
2020-10-27 13:13:27,221 epoch 43 - iter 66/220 - loss 0.95969282 - samples/sec: 143.38 - lr: 0.056250
2020-10-27 13:13:32,406 epoch 43 - iter 88/220 - loss 0.95748630 - samples/sec: 135.92 - lr: 0.056250
2020-10-27 13:13:44,039 epoch 43 - iter 110/220 - loss 0.95647211 - samples/sec: 60.55 - lr: 0.056250
2020-10-27 13:13:55,946 epoch 43 - iter 132/220 - loss 0.96130417 - samples/sec: 59.15 - lr: 0.056250
2020-10-27 13:14:11,690 epoch 43 - iter 154/220 - loss 0.98300179 - samples/sec: 44.73 - lr: 0.056250
2020-10-27 13:14:20,448 epoch 43 - iter 176/220 - loss 0.98955942 - samples/sec: 80.44 - lr: 0.056250
2020-10-27 13:14:25,458 epoch 43 - iter 198/220 - loss 0.98290865 - samples/sec: 140.65 - lr: 0.056250
2020-10-27 13:14:31,041 epoch 43 - iter 220/220 - loss 0.98036252 - samples/sec: 126.21 - lr: 0.056250
2020-10-27 13:14:31,042 ----------------------------------------------------------------------------------------------------
2020-10-27 13:14:31,042 EPOCH 43 done: loss 0.9804 - lr 0.0562500
2020-10-27 13:14:33,882 DEV : loss 2.5262420177459717 - score 0.8419
2020-10-27 13:14:33,974 BAD EPOCHS (no improvement): 1
2020-10-27 13:14:33,979 ----------------------------------------------------------------------------------------------------
2020-10-27 13:14:41,094 epoch 44 - iter 22/220 - loss 1.15282032 - samples/sec: 98.99 - lr: 0.056250
2020-10-27 13:14:51,202 epoch 44 - iter 44/220 - loss 1.10190891 - samples/sec: 69.68 - lr: 0.056250
2020-10-27 13:15:07,366 epoch 44 - iter 66/220 - loss 1.14145625 - samples/sec: 43.56 - lr: 0.056250
2020-10-27 13:15:18,689 epoch 44 - iter 88/220 - loss 1.08208410 - samples/sec: 62.20 - lr: 0.056250
2020-10-27 13:15:25,862 epoch 44 - iter 110/220 - loss 1.04041998 - samples/sec: 98.20 - lr: 0.056250
2020-10-27 13:15:30,416 epoch 44 - iter 132/220 - loss 1.01993639 - samples/sec: 154.68 - lr: 0.056250
2020-10-27 13:15:35,838 epoch 44 - iter 154/220 - loss 1.01140966 - samples/sec: 129.93 - lr: 0.056250
2020-10-27 13:15:40,453 epoch 44 - iter 176/220 - loss 1.00704774 - samples/sec: 152.71 - lr: 0.056250
2020-10-27 13:15:45,125 epoch 44 - iter 198/220 - loss 0.98261817 - samples/sec: 150.83 - lr: 0.056250
2020-10-27 13:15:49,577 epoch 44 - iter 220/220 - loss 0.98133454 - samples/sec: 158.25 - lr: 0.056250
2020-10-27 13:15:49,577 ----------------------------------------------------------------------------------------------------
2020-10-27 13:15:49,577 EPOCH 44 done: loss 0.9813 - lr 0.0562500
2020-10-27 13:15:52,280 DEV : loss 2.5188729763031006 - score 0.8428
2020-10-27 13:15:52,370 BAD EPOCHS (no improvement): 0
2020-10-27 13:16:02,534 ----------------------------------------------------------------------------------------------------
2020-10-27 13:16:15,482 epoch 45 - iter 22/220 - loss 1.05916934 - samples/sec: 54.40 - lr: 0.056250
2020-10-27 13:16:27,111 epoch 45 - iter 44/220 - loss 0.98298628 - samples/sec: 60.57 - lr: 0.056250
2020-10-27 13:16:40,887 epoch 45 - iter 66/220 - loss 0.99646418 - samples/sec: 51.11 - lr: 0.056250
2020-10-27 13:16:47,495 epoch 45 - iter 88/220 - loss 1.02387967 - samples/sec: 106.61 - lr: 0.056250
2020-10-27 13:16:52,292 epoch 45 - iter 110/220 - loss 1.00225710 - samples/sec: 146.86 - lr: 0.056250
2020-10-27 13:16:56,576 epoch 45 - iter 132/220 - loss 0.96569289 - samples/sec: 164.51 - lr: 0.056250
2020-10-27 13:17:01,534 epoch 45 - iter 154/220 - loss 0.94421488 - samples/sec: 142.10 - lr: 0.056250
2020-10-27 13:17:06,289 epoch 45 - iter 176/220 - loss 0.94545936 - samples/sec: 148.17 - lr: 0.056250
2020-10-27 13:17:10,983 epoch 45 - iter 198/220 - loss 0.94727790 - samples/sec: 150.11 - lr: 0.056250
2020-10-27 13:17:16,548 epoch 45 - iter 220/220 - loss 0.94221345 - samples/sec: 126.61 - lr: 0.056250
2020-10-27 13:17:16,548 ----------------------------------------------------------------------------------------------------
2020-10-27 13:17:16,548 EPOCH 45 done: loss 0.9422 - lr 0.0562500
2020-10-27 13:17:19,268 DEV : loss 2.4754765033721924 - score 0.8402
2020-10-27 13:17:19,357 BAD EPOCHS (no improvement): 1
2020-10-27 13:17:19,360 ----------------------------------------------------------------------------------------------------
2020-10-27 13:17:32,715 epoch 46 - iter 22/220 - loss 0.94297589 - samples/sec: 52.73 - lr: 0.056250
2020-10-27 13:17:45,279 epoch 46 - iter 44/220 - loss 0.94233782 - samples/sec: 56.05 - lr: 0.056250
2020-10-27 13:17:58,174 epoch 46 - iter 66/220 - loss 0.92441542 - samples/sec: 54.62 - lr: 0.056250
2020-10-27 13:18:04,942 epoch 46 - iter 88/220 - loss 0.91450543 - samples/sec: 104.10 - lr: 0.056250
2020-10-27 13:18:10,513 epoch 46 - iter 110/220 - loss 0.92339149 - samples/sec: 126.49 - lr: 0.056250
2020-10-27 13:18:15,554 epoch 46 - iter 132/220 - loss 0.90292983 - samples/sec: 139.80 - lr: 0.056250
2020-10-27 13:18:22,859 epoch 46 - iter 154/220 - loss 0.91215495 - samples/sec: 96.44 - lr: 0.056250
2020-10-27 13:18:27,620 epoch 46 - iter 176/220 - loss 0.90893752 - samples/sec: 148.08 - lr: 0.056250
2020-10-27 13:18:34,598 epoch 46 - iter 198/220 - loss 0.91334683 - samples/sec: 100.96 - lr: 0.056250
2020-10-27 13:18:46,398 epoch 46 - iter 220/220 - loss 0.91053038 - samples/sec: 59.69 - lr: 0.056250
2020-10-27 13:18:46,399 ----------------------------------------------------------------------------------------------------
2020-10-27 13:18:46,399 EPOCH 46 done: loss 0.9105 - lr 0.0562500
2020-10-27 13:18:56,760 DEV : loss 2.5216598510742188 - score 0.8419
2020-10-27 13:18:56,858 BAD EPOCHS (no improvement): 2
2020-10-27 13:18:56,892 ----------------------------------------------------------------------------------------------------
2020-10-27 13:19:08,897 epoch 47 - iter 22/220 - loss 0.87513952 - samples/sec: 58.67 - lr: 0.056250
2020-10-27 13:19:19,215 epoch 47 - iter 44/220 - loss 0.98409100 - samples/sec: 68.26 - lr: 0.056250
2020-10-27 13:19:26,895 epoch 47 - iter 66/220 - loss 1.00283777 - samples/sec: 91.73 - lr: 0.056250
2020-10-27 13:19:33,408 epoch 47 - iter 88/220 - loss 0.97328014 - samples/sec: 108.18 - lr: 0.056250
2020-10-27 13:19:41,973 epoch 47 - iter 110/220 - loss 0.98597009 - samples/sec: 82.25 - lr: 0.056250
2020-10-27 13:19:53,507 epoch 47 - iter 132/220 - loss 0.97136771 - samples/sec: 61.07 - lr: 0.056250
2020-10-27 13:20:05,547 epoch 47 - iter 154/220 - loss 0.95439269 - samples/sec: 58.50 - lr: 0.056250
2020-10-27 13:20:17,901 epoch 47 - iter 176/220 - loss 0.93949812 - samples/sec: 57.01 - lr: 0.056250
2020-10-27 13:20:22,760 epoch 47 - iter 198/220 - loss 0.92313701 - samples/sec: 145.03 - lr: 0.056250
2020-10-27 13:20:28,138 epoch 47 - iter 220/220 - loss 0.91238795 - samples/sec: 131.04 - lr: 0.056250
2020-10-27 13:20:28,139 ----------------------------------------------------------------------------------------------------
2020-10-27 13:20:28,139 EPOCH 47 done: loss 0.9124 - lr 0.0562500
2020-10-27 13:20:30,894 DEV : loss 2.5284831523895264 - score 0.8422
2020-10-27 13:20:30,983 BAD EPOCHS (no improvement): 3
2020-10-27 13:20:30,986 ----------------------------------------------------------------------------------------------------
2020-10-27 13:20:37,029 epoch 48 - iter 22/220 - loss 0.90708944 - samples/sec: 116.58 - lr: 0.056250
2020-10-27 13:20:43,077 epoch 48 - iter 44/220 - loss 0.85996373 - samples/sec: 116.51 - lr: 0.056250
2020-10-27 13:20:58,223 epoch 48 - iter 66/220 - loss 0.92432939 - samples/sec: 46.50 - lr: 0.056250
2020-10-27 13:21:11,720 epoch 48 - iter 88/220 - loss 0.91459197 - samples/sec: 52.18 - lr: 0.056250
2020-10-27 13:21:25,250 epoch 48 - iter 110/220 - loss 0.93743315 - samples/sec: 52.06 - lr: 0.056250
2020-10-27 13:21:30,281 epoch 48 - iter 132/220 - loss 0.91487017 - samples/sec: 140.06 - lr: 0.056250
2020-10-27 13:21:35,273 epoch 48 - iter 154/220 - loss 0.91027841 - samples/sec: 141.20 - lr: 0.056250
2020-10-27 13:21:40,934 epoch 48 - iter 176/220 - loss 0.90673855 - samples/sec: 124.44 - lr: 0.056250
2020-10-27 13:21:46,394 epoch 48 - iter 198/220 - loss 0.89479377 - samples/sec: 129.08 - lr: 0.056250
2020-10-27 13:21:51,548 epoch 48 - iter 220/220 - loss 0.88915852 - samples/sec: 136.74 - lr: 0.056250
2020-10-27 13:21:51,548 ----------------------------------------------------------------------------------------------------
2020-10-27 13:21:51,549 EPOCH 48 done: loss 0.8892 - lr 0.0562500
2020-10-27 13:21:54,303 DEV : loss 2.523089647293091 - score 0.8405
2020-10-27 13:21:54,394 BAD EPOCHS (no improvement): 4
2020-10-27 13:21:54,397 ----------------------------------------------------------------------------------------------------
2020-10-27 13:22:01,988 epoch 49 - iter 22/220 - loss 0.84447744 - samples/sec: 92.79 - lr: 0.028125
2020-10-27 13:22:14,383 epoch 49 - iter 44/220 - loss 0.80515634 - samples/sec: 56.82 - lr: 0.028125
2020-10-27 13:22:28,318 epoch 49 - iter 66/220 - loss 0.85984281 - samples/sec: 50.54 - lr: 0.028125
2020-10-27 13:22:39,591 epoch 49 - iter 88/220 - loss 0.84864366 - samples/sec: 62.48 - lr: 0.028125
2020-10-27 13:22:45,252 epoch 49 - iter 110/220 - loss 0.84501325 - samples/sec: 124.46 - lr: 0.028125
2020-10-27 13:22:52,242 epoch 49 - iter 132/220 - loss 0.86637460 - samples/sec: 100.80 - lr: 0.028125
2020-10-27 13:22:58,078 epoch 49 - iter 154/220 - loss 0.86622640 - samples/sec: 120.73 - lr: 0.028125
2020-10-27 13:23:03,325 epoch 49 - iter 176/220 - loss 0.87005005 - samples/sec: 134.33 - lr: 0.028125
2020-10-27 13:23:08,069 epoch 49 - iter 198/220 - loss 0.85644886 - samples/sec: 148.55 - lr: 0.028125
2020-10-27 13:23:16,055 epoch 49 - iter 220/220 - loss 0.85906543 - samples/sec: 88.22 - lr: 0.028125
2020-10-27 13:23:16,055 ----------------------------------------------------------------------------------------------------
2020-10-27 13:23:16,055 EPOCH 49 done: loss 0.8591 - lr 0.0281250
2020-10-27 13:23:25,981 DEV : loss 2.5021955966949463 - score 0.8402
2020-10-27 13:23:26,070 BAD EPOCHS (no improvement): 1
2020-10-27 13:23:26,073 ----------------------------------------------------------------------------------------------------
2020-10-27 13:23:37,175 epoch 50 - iter 22/220 - loss 0.70316546 - samples/sec: 63.44 - lr: 0.028125
2020-10-27 13:23:46,872 epoch 50 - iter 44/220 - loss 0.79006088 - samples/sec: 72.64 - lr: 0.028125
2020-10-27 13:23:51,913 epoch 50 - iter 66/220 - loss 0.78944103 - samples/sec: 139.85 - lr: 0.028125
2020-10-27 13:23:57,339 epoch 50 - iter 88/220 - loss 0.81583705 - samples/sec: 129.85 - lr: 0.028125
2020-10-27 13:24:03,366 epoch 50 - iter 110/220 - loss 0.80158309 - samples/sec: 116.90 - lr: 0.028125
2020-10-27 13:24:18,587 epoch 50 - iter 132/220 - loss 0.83791371 - samples/sec: 46.27 - lr: 0.028125
2020-10-27 13:24:30,718 epoch 50 - iter 154/220 - loss 0.83855873 - samples/sec: 58.06 - lr: 0.028125
2020-10-27 13:24:43,979 epoch 50 - iter 176/220 - loss 0.83070116 - samples/sec: 53.10 - lr: 0.028125
2020-10-27 13:24:49,397 epoch 50 - iter 198/220 - loss 0.82277375 - samples/sec: 130.04 - lr: 0.028125
2020-10-27 13:24:56,660 epoch 50 - iter 220/220 - loss 0.83723797 - samples/sec: 96.99 - lr: 0.028125
2020-10-27 13:24:56,660 ----------------------------------------------------------------------------------------------------
2020-10-27 13:24:56,660 EPOCH 50 done: loss 0.8372 - lr 0.0281250
2020-10-27 13:24:59,408 DEV : loss 2.542654037475586 - score 0.8403
2020-10-27 13:24:59,500 BAD EPOCHS (no improvement): 2
2020-10-27 13:24:59,503 ----------------------------------------------------------------------------------------------------
2020-10-27 13:25:10,040 epoch 51 - iter 22/220 - loss 0.75451282 - samples/sec: 66.85 - lr: 0.028125
2020-10-27 13:25:26,389 epoch 51 - iter 44/220 - loss 0.82612407 - samples/sec: 43.07 - lr: 0.028125
2020-10-27 13:25:41,496 epoch 51 - iter 66/220 - loss 0.89257190 - samples/sec: 46.62 - lr: 0.028125
2020-10-27 13:25:46,298 epoch 51 - iter 88/220 - loss 0.87641522 - samples/sec: 146.75 - lr: 0.028125
2020-10-27 13:25:51,397 epoch 51 - iter 110/220 - loss 0.87005863 - samples/sec: 138.14 - lr: 0.028125
2020-10-27 13:25:55,500 epoch 51 - iter 132/220 - loss 0.83899376 - samples/sec: 171.81 - lr: 0.028125
2020-10-27 13:26:01,188 epoch 51 - iter 154/220 - loss 0.83673336 - samples/sec: 123.85 - lr: 0.028125
2020-10-27 13:26:05,826 epoch 51 - iter 176/220 - loss 0.83682750 - samples/sec: 151.90 - lr: 0.028125
2020-10-27 13:26:13,358 epoch 51 - iter 198/220 - loss 0.82759951 - samples/sec: 93.50 - lr: 0.028125
2020-10-27 13:26:24,067 epoch 51 - iter 220/220 - loss 0.82545256 - samples/sec: 65.76 - lr: 0.028125
2020-10-27 13:26:24,068 ----------------------------------------------------------------------------------------------------
2020-10-27 13:26:24,068 EPOCH 51 done: loss 0.8255 - lr 0.0281250
2020-10-27 13:26:34,822 DEV : loss 2.5343987941741943 - score 0.8426
2020-10-27 13:26:34,913 BAD EPOCHS (no improvement): 3
2020-10-27 13:26:34,915 ----------------------------------------------------------------------------------------------------
2020-10-27 13:26:47,456 epoch 52 - iter 22/220 - loss 0.88640390 - samples/sec: 56.15 - lr: 0.028125
2020-10-27 13:26:54,613 epoch 52 - iter 44/220 - loss 0.93125703 - samples/sec: 98.42 - lr: 0.028125
2020-10-27 13:27:00,944 epoch 52 - iter 66/220 - loss 0.91573352 - samples/sec: 111.25 - lr: 0.028125
2020-10-27 13:27:05,151 epoch 52 - iter 88/220 - loss 0.88981656 - samples/sec: 167.53 - lr: 0.028125
2020-10-27 13:27:10,340 epoch 52 - iter 110/220 - loss 0.89585213 - samples/sec: 135.78 - lr: 0.028125
2020-10-27 13:27:15,587 epoch 52 - iter 132/220 - loss 0.88461797 - samples/sec: 134.27 - lr: 0.028125
2020-10-27 13:27:21,267 epoch 52 - iter 154/220 - loss 0.86924732 - samples/sec: 124.02 - lr: 0.028125
2020-10-27 13:27:36,248 epoch 52 - iter 176/220 - loss 0.87100768 - samples/sec: 47.00 - lr: 0.028125
2020-10-27 13:27:47,401 epoch 52 - iter 198/220 - loss 0.85052676 - samples/sec: 63.15 - lr: 0.028125
2020-10-27 13:27:58,595 epoch 52 - iter 220/220 - loss 0.83468645 - samples/sec: 62.91 - lr: 0.028125
2020-10-27 13:27:58,596 ----------------------------------------------------------------------------------------------------
2020-10-27 13:27:58,596 EPOCH 52 done: loss 0.8347 - lr 0.0281250
2020-10-27 13:28:01,990 DEV : loss 2.5548853874206543 - score 0.8421
2020-10-27 13:28:02,080 BAD EPOCHS (no improvement): 4
2020-10-27 13:28:02,083 ----------------------------------------------------------------------------------------------------
2020-10-27 13:28:06,944 epoch 53 - iter 22/220 - loss 0.86792078 - samples/sec: 144.94 - lr: 0.014062
2020-10-27 13:28:11,715 epoch 53 - iter 44/220 - loss 0.82292070 - samples/sec: 147.66 - lr: 0.014062
2020-10-27 13:28:16,899 epoch 53 - iter 66/220 - loss 0.80355146 - samples/sec: 135.90 - lr: 0.014062
2020-10-27 13:28:21,882 epoch 53 - iter 88/220 - loss 0.79897022 - samples/sec: 141.36 - lr: 0.014062
2020-10-27 13:28:34,701 epoch 53 - iter 110/220 - loss 0.82363551 - samples/sec: 54.94 - lr: 0.014062
2020-10-27 13:28:45,387 epoch 53 - iter 132/220 - loss 0.83167195 - samples/sec: 65.90 - lr: 0.014062
2020-10-27 13:28:56,910 epoch 53 - iter 154/220 - loss 0.82614833 - samples/sec: 61.12 - lr: 0.014062
2020-10-27 13:29:04,167 epoch 53 - iter 176/220 - loss 0.82679963 - samples/sec: 97.06 - lr: 0.014062
2020-10-27 13:29:11,105 epoch 53 - iter 198/220 - loss 0.83715317 - samples/sec: 101.53 - lr: 0.014062
2020-10-27 13:29:18,182 epoch 53 - iter 220/220 - loss 0.84375058 - samples/sec: 99.52 - lr: 0.014062
2020-10-27 13:29:18,183 ----------------------------------------------------------------------------------------------------
2020-10-27 13:29:18,183 EPOCH 53 done: loss 0.8438 - lr 0.0140625
2020-10-27 13:29:20,909 DEV : loss 2.5114331245422363 - score 0.8419
2020-10-27 13:29:21,000 BAD EPOCHS (no improvement): 1
2020-10-27 13:29:21,002 ----------------------------------------------------------------------------------------------------
2020-10-27 13:29:25,940 epoch 54 - iter 22/220 - loss 0.81095554 - samples/sec: 142.65 - lr: 0.014062
2020-10-27 13:29:30,306 epoch 54 - iter 44/220 - loss 0.79236363 - samples/sec: 161.38 - lr: 0.014062
2020-10-27 13:29:35,338 epoch 54 - iter 66/220 - loss 0.81225118 - samples/sec: 139.99 - lr: 0.014062
2020-10-27 13:29:47,197 epoch 54 - iter 88/220 - loss 0.83359535 - samples/sec: 59.39 - lr: 0.014062
2020-10-27 13:29:58,885 epoch 54 - iter 110/220 - loss 0.82381064 - samples/sec: 60.26 - lr: 0.014062
2020-10-27 13:30:10,465 epoch 54 - iter 132/220 - loss 0.81547419 - samples/sec: 60.81 - lr: 0.014062
2020-10-27 13:30:19,281 epoch 54 - iter 154/220 - loss 0.81024634 - samples/sec: 79.89 - lr: 0.014062
2020-10-27 13:30:24,816 epoch 54 - iter 176/220 - loss 0.81411840 - samples/sec: 127.28 - lr: 0.014062
2020-10-27 13:30:31,456 epoch 54 - iter 198/220 - loss 0.82345117 - samples/sec: 106.09 - lr: 0.014062
2020-10-27 13:30:38,189 epoch 54 - iter 220/220 - loss 0.81938500 - samples/sec: 104.64 - lr: 0.014062
2020-10-27 13:30:38,189 ----------------------------------------------------------------------------------------------------
2020-10-27 13:30:38,189 EPOCH 54 done: loss 0.8194 - lr 0.0140625
2020-10-27 13:30:42,050 DEV : loss 2.544163703918457 - score 0.8447
2020-10-27 13:30:42,141 BAD EPOCHS (no improvement): 0
2020-10-27 13:30:47,535 ----------------------------------------------------------------------------------------------------
2020-10-27 13:30:52,141 epoch 55 - iter 22/220 - loss 0.69458473 - samples/sec: 152.99 - lr: 0.014062
2020-10-27 13:30:58,225 epoch 55 - iter 44/220 - loss 0.70733128 - samples/sec: 115.80 - lr: 0.014062
2020-10-27 13:31:10,182 epoch 55 - iter 66/220 - loss 0.74621369 - samples/sec: 58.90 - lr: 0.014062
2020-10-27 13:31:25,301 epoch 55 - iter 88/220 - loss 0.80333176 - samples/sec: 46.58 - lr: 0.014062
2020-10-27 13:31:39,398 epoch 55 - iter 110/220 - loss 0.82155799 - samples/sec: 49.95 - lr: 0.014062
2020-10-27 13:31:43,702 epoch 55 - iter 132/220 - loss 0.79658994 - samples/sec: 163.73 - lr: 0.014062
2020-10-27 13:31:48,548 epoch 55 - iter 154/220 - loss 0.79289366 - samples/sec: 145.37 - lr: 0.014062
2020-10-27 13:31:52,864 epoch 55 - iter 176/220 - loss 0.77799653 - samples/sec: 163.27 - lr: 0.014062
2020-10-27 13:31:57,682 epoch 55 - iter 198/220 - loss 0.77376549 - samples/sec: 146.21 - lr: 0.014062
2020-10-27 13:32:02,522 epoch 55 - iter 220/220 - loss 0.78264538 - samples/sec: 145.57 - lr: 0.014062
2020-10-27 13:32:02,523 ----------------------------------------------------------------------------------------------------
2020-10-27 13:32:02,523 EPOCH 55 done: loss 0.7826 - lr 0.0140625
2020-10-27 13:32:05,768 DEV : loss 2.5780465602874756 - score 0.8431
2020-10-27 13:32:05,858 BAD EPOCHS (no improvement): 1
2020-10-27 13:32:05,860 ----------------------------------------------------------------------------------------------------
2020-10-27 13:32:17,355 epoch 56 - iter 22/220 - loss 0.69483655 - samples/sec: 61.26 - lr: 0.014062
2020-10-27 13:32:29,127 epoch 56 - iter 44/220 - loss 0.76258168 - samples/sec: 59.82 - lr: 0.014062
2020-10-27 13:32:41,046 epoch 56 - iter 66/220 - loss 0.76616085 - samples/sec: 59.08 - lr: 0.014062
2020-10-27 13:32:51,792 epoch 56 - iter 88/220 - loss 0.78687197 - samples/sec: 65.53 - lr: 0.014062
2020-10-27 13:32:56,224 epoch 56 - iter 110/220 - loss 0.79269512 - samples/sec: 158.99 - lr: 0.014062
2020-10-27 13:33:00,923 epoch 56 - iter 132/220 - loss 0.78583450 - samples/sec: 149.92 - lr: 0.014062
2020-10-27 13:33:05,822 epoch 56 - iter 154/220 - loss 0.77039644 - samples/sec: 143.83 - lr: 0.014062
2020-10-27 13:33:15,764 epoch 56 - iter 176/220 - loss 0.77792277 - samples/sec: 70.84 - lr: 0.014062
2020-10-27 13:33:30,670 epoch 56 - iter 198/220 - loss 0.78955118 - samples/sec: 47.24 - lr: 0.014062
2020-10-27 13:33:43,415 epoch 56 - iter 220/220 - loss 0.78447708 - samples/sec: 55.25 - lr: 0.014062
2020-10-27 13:33:43,417 ----------------------------------------------------------------------------------------------------
2020-10-27 13:33:43,417 EPOCH 56 done: loss 0.7845 - lr 0.0140625
2020-10-27 13:33:50,840 DEV : loss 2.55763578414917 - score 0.8446
2020-10-27 13:33:50,930 BAD EPOCHS (no improvement): 2
2020-10-27 13:33:50,933 ----------------------------------------------------------------------------------------------------
2020-10-27 13:33:55,871 epoch 57 - iter 22/220 - loss 0.83115446 - samples/sec: 142.70 - lr: 0.014062
2020-10-27 13:34:00,250 epoch 57 - iter 44/220 - loss 0.75879852 - samples/sec: 160.90 - lr: 0.014062
2020-10-27 13:34:04,818 epoch 57 - iter 66/220 - loss 0.73382654 - samples/sec: 154.25 - lr: 0.014062
2020-10-27 13:34:09,809 epoch 57 - iter 88/220 - loss 0.75729879 - samples/sec: 141.14 - lr: 0.014062
2020-10-27 13:34:16,467 epoch 57 - iter 110/220 - loss 0.79139213 - samples/sec: 105.81 - lr: 0.014062
2020-10-27 13:34:27,029 epoch 57 - iter 132/220 - loss 0.81610992 - samples/sec: 66.68 - lr: 0.014062
2020-10-27 13:34:38,682 epoch 57 - iter 154/220 - loss 0.79470041 - samples/sec: 60.43 - lr: 0.014062
2020-10-27 13:34:50,391 epoch 57 - iter 176/220 - loss 0.78797926 - samples/sec: 60.15 - lr: 0.014062
2020-10-27 13:35:02,145 epoch 57 - iter 198/220 - loss 0.79799498 - samples/sec: 59.91 - lr: 0.014062
2020-10-27 13:35:07,447 epoch 57 - iter 220/220 - loss 0.79855500 - samples/sec: 132.89 - lr: 0.014062
2020-10-27 13:35:07,447 ----------------------------------------------------------------------------------------------------
2020-10-27 13:35:07,447 EPOCH 57 done: loss 0.7986 - lr 0.0140625
2020-10-27 13:35:10,189 DEV : loss 2.54221510887146 - score 0.8455
2020-10-27 13:35:10,280 BAD EPOCHS (no improvement): 0
2020-10-27 13:35:15,327 ----------------------------------------------------------------------------------------------------
2020-10-27 13:35:21,101 epoch 58 - iter 22/220 - loss 0.81151636 - samples/sec: 122.05 - lr: 0.014062
2020-10-27 13:35:28,559 epoch 58 - iter 44/220 - loss 0.79497833 - samples/sec: 94.47 - lr: 0.014062
2020-10-27 13:35:33,796 epoch 58 - iter 66/220 - loss 0.78116593 - samples/sec: 134.56 - lr: 0.014062
2020-10-27 13:35:41,934 epoch 58 - iter 88/220 - loss 0.77830277 - samples/sec: 86.57 - lr: 0.014062
2020-10-27 13:35:54,387 epoch 58 - iter 110/220 - loss 0.77286181 - samples/sec: 56.56 - lr: 0.014062
2020-10-27 13:36:08,087 epoch 58 - iter 132/220 - loss 0.77185309 - samples/sec: 51.41 - lr: 0.014062
2020-10-27 13:36:20,453 epoch 58 - iter 154/220 - loss 0.77095704 - samples/sec: 56.95 - lr: 0.014062
2020-10-27 13:36:32,942 epoch 58 - iter 176/220 - loss 0.77188429 - samples/sec: 56.39 - lr: 0.014062
2020-10-27 13:36:46,044 epoch 58 - iter 198/220 - loss 0.77585456 - samples/sec: 53.75 - lr: 0.014062
2020-10-27 13:36:50,832 epoch 58 - iter 220/220 - loss 0.77159310 - samples/sec: 147.19 - lr: 0.014062
2020-10-27 13:36:50,833 ----------------------------------------------------------------------------------------------------
2020-10-27 13:36:50,834 EPOCH 58 done: loss 0.7716 - lr 0.0140625
2020-10-27 13:36:53,612 DEV : loss 2.5759453773498535 - score 0.8442
2020-10-27 13:36:53,703 BAD EPOCHS (no improvement): 1
2020-10-27 13:36:53,711 ----------------------------------------------------------------------------------------------------
2020-10-27 13:36:59,818 epoch 59 - iter 22/220 - loss 0.68955987 - samples/sec: 115.37 - lr: 0.014062
2020-10-27 13:37:06,079 epoch 59 - iter 44/220 - loss 0.76780081 - samples/sec: 112.52 - lr: 0.014062
2020-10-27 13:37:18,339 epoch 59 - iter 66/220 - loss 0.77533144 - samples/sec: 57.45 - lr: 0.014062
2020-10-27 13:37:31,081 epoch 59 - iter 88/220 - loss 0.79488993 - samples/sec: 55.28 - lr: 0.014062
2020-10-27 13:37:47,349 epoch 59 - iter 110/220 - loss 0.82394836 - samples/sec: 43.29 - lr: 0.014062
2020-10-27 13:37:51,888 epoch 59 - iter 132/220 - loss 0.79560555 - samples/sec: 155.24 - lr: 0.014062
2020-10-27 13:37:56,451 epoch 59 - iter 154/220 - loss 0.78513776 - samples/sec: 154.41 - lr: 0.014062
2020-10-27 13:38:00,879 epoch 59 - iter 176/220 - loss 0.77164196 - samples/sec: 159.16 - lr: 0.014062
2020-10-27 13:38:07,399 epoch 59 - iter 198/220 - loss 0.78855693 - samples/sec: 108.02 - lr: 0.014062
2020-10-27 13:38:11,746 epoch 59 - iter 220/220 - loss 0.77297962 - samples/sec: 162.08 - lr: 0.014062
2020-10-27 13:38:11,747 ----------------------------------------------------------------------------------------------------
2020-10-27 13:38:11,747 EPOCH 59 done: loss 0.7730 - lr 0.0140625
2020-10-27 13:38:14,499 DEV : loss 2.5753190517425537 - score 0.8439
2020-10-27 13:38:14,590 BAD EPOCHS (no improvement): 2
2020-10-27 13:38:14,593 ----------------------------------------------------------------------------------------------------
2020-10-27 13:38:22,139 epoch 60 - iter 22/220 - loss 0.66354364 - samples/sec: 93.34 - lr: 0.014062
2020-10-27 13:38:36,569 epoch 60 - iter 44/220 - loss 0.73596049 - samples/sec: 48.80 - lr: 0.014062
2020-10-27 13:38:52,059 epoch 60 - iter 66/220 - loss 0.78979971 - samples/sec: 45.46 - lr: 0.014062
2020-10-27 13:38:59,736 epoch 60 - iter 88/220 - loss 0.76828865 - samples/sec: 91.74 - lr: 0.014062
2020-10-27 13:39:05,760 epoch 60 - iter 110/220 - loss 0.77475610 - samples/sec: 116.98 - lr: 0.014062
2020-10-27 13:39:11,275 epoch 60 - iter 132/220 - loss 0.77007997 - samples/sec: 127.78 - lr: 0.014062
2020-10-27 13:39:16,378 epoch 60 - iter 154/220 - loss 0.75538412 - samples/sec: 138.10 - lr: 0.014062
2020-10-27 13:39:21,592 epoch 60 - iter 176/220 - loss 0.76982837 - samples/sec: 135.18 - lr: 0.014062
2020-10-27 13:39:27,536 epoch 60 - iter 198/220 - loss 0.76882314 - samples/sec: 118.55 - lr: 0.014062
2020-10-27 13:39:36,152 epoch 60 - iter 220/220 - loss 0.77121000 - samples/sec: 81.75 - lr: 0.014062
2020-10-27 13:39:36,152 ----------------------------------------------------------------------------------------------------
2020-10-27 13:39:36,152 EPOCH 60 done: loss 0.7712 - lr 0.0140625
2020-10-27 13:39:46,616 DEV : loss 2.547548294067383 - score 0.848
2020-10-27 13:39:46,707 BAD EPOCHS (no improvement): 0
2020-10-27 13:39:51,786 ----------------------------------------------------------------------------------------------------
2020-10-27 13:40:03,755 epoch 61 - iter 22/220 - loss 0.72794236 - samples/sec: 58.85 - lr: 0.014062
2020-10-27 13:40:14,803 epoch 61 - iter 44/220 - loss 0.83131055 - samples/sec: 63.75 - lr: 0.014062
2020-10-27 13:40:21,120 epoch 61 - iter 66/220 - loss 0.83180076 - samples/sec: 111.51 - lr: 0.014062
2020-10-27 13:40:27,169 epoch 61 - iter 88/220 - loss 0.80326300 - samples/sec: 116.48 - lr: 0.014062
2020-10-27 13:40:35,796 epoch 61 - iter 110/220 - loss 0.79092343 - samples/sec: 81.65 - lr: 0.014062
2020-10-27 13:40:47,853 epoch 61 - iter 132/220 - loss 0.75761835 - samples/sec: 58.41 - lr: 0.014062
2020-10-27 13:41:00,768 epoch 61 - iter 154/220 - loss 0.75829591 - samples/sec: 54.53 - lr: 0.014062
2020-10-27 13:41:11,685 epoch 61 - iter 176/220 - loss 0.75524390 - samples/sec: 64.52 - lr: 0.014062
2020-10-27 13:41:19,376 epoch 61 - iter 198/220 - loss 0.77359084 - samples/sec: 91.59 - lr: 0.014062
2020-10-27 13:41:24,350 epoch 61 - iter 220/220 - loss 0.77057761 - samples/sec: 141.70 - lr: 0.014062
2020-10-27 13:41:24,350 ----------------------------------------------------------------------------------------------------
2020-10-27 13:41:24,351 EPOCH 61 done: loss 0.7706 - lr 0.0140625
2020-10-27 13:41:27,066 DEV : loss 2.5444252490997314 - score 0.8468
2020-10-27 13:41:27,156 BAD EPOCHS (no improvement): 1
2020-10-27 13:41:27,159 ----------------------------------------------------------------------------------------------------
2020-10-27 13:41:33,002 epoch 62 - iter 22/220 - loss 0.75715994 - samples/sec: 120.57 - lr: 0.014062
2020-10-27 13:41:38,279 epoch 62 - iter 44/220 - loss 0.72086504 - samples/sec: 133.54 - lr: 0.014062
2020-10-27 13:41:50,745 epoch 62 - iter 66/220 - loss 0.73651064 - samples/sec: 56.49 - lr: 0.014062
2020-10-27 13:42:03,158 epoch 62 - iter 88/220 - loss 0.74173876 - samples/sec: 56.74 - lr: 0.014062
2020-10-27 13:42:17,891 epoch 62 - iter 110/220 - loss 0.76390190 - samples/sec: 47.80 - lr: 0.014062
2020-10-27 13:42:24,762 epoch 62 - iter 132/220 - loss 0.76314549 - samples/sec: 102.53 - lr: 0.014062
2020-10-27 13:42:30,343 epoch 62 - iter 154/220 - loss 0.77478905 - samples/sec: 126.26 - lr: 0.014062
2020-10-27 13:42:37,408 epoch 62 - iter 176/220 - loss 0.78048141 - samples/sec: 99.73 - lr: 0.014062
2020-10-27 13:42:42,621 epoch 62 - iter 198/220 - loss 0.78051408 - samples/sec: 135.19 - lr: 0.014062
2020-10-27 13:42:48,174 epoch 62 - iter 220/220 - loss 0.77995096 - samples/sec: 126.88 - lr: 0.014062
2020-10-27 13:42:48,174 ----------------------------------------------------------------------------------------------------
2020-10-27 13:42:48,174 EPOCH 62 done: loss 0.7800 - lr 0.0140625
2020-10-27 13:42:50,953 DEV : loss 2.5408847332000732 - score 0.8461
2020-10-27 13:42:51,043 BAD EPOCHS (no improvement): 2
2020-10-27 13:42:51,046 ----------------------------------------------------------------------------------------------------
2020-10-27 13:42:56,559 epoch 63 - iter 22/220 - loss 0.78371787 - samples/sec: 127.82 - lr: 0.014062
2020-10-27 13:43:03,682 epoch 63 - iter 44/220 - loss 0.79114808 - samples/sec: 98.90 - lr: 0.014062
2020-10-27 13:43:16,353 epoch 63 - iter 66/220 - loss 0.76666048 - samples/sec: 55.58 - lr: 0.014062
2020-10-27 13:43:30,471 epoch 63 - iter 88/220 - loss 0.78309629 - samples/sec: 49.88 - lr: 0.014062
2020-10-27 13:43:42,944 epoch 63 - iter 110/220 - loss 0.79990198 - samples/sec: 56.47 - lr: 0.014062
2020-10-27 13:43:48,981 epoch 63 - iter 132/220 - loss 0.78760807 - samples/sec: 116.73 - lr: 0.014062
2020-10-27 13:43:56,126 epoch 63 - iter 154/220 - loss 0.81450301 - samples/sec: 98.62 - lr: 0.014062
2020-10-27 13:44:01,942 epoch 63 - iter 176/220 - loss 0.81122444 - samples/sec: 121.13 - lr: 0.014062
2020-10-27 13:44:07,095 epoch 63 - iter 198/220 - loss 0.80092254 - samples/sec: 136.77 - lr: 0.014062
2020-10-27 13:44:12,515 epoch 63 - iter 220/220 - loss 0.81166668 - samples/sec: 130.01 - lr: 0.014062
2020-10-27 13:44:12,517 ----------------------------------------------------------------------------------------------------
2020-10-27 13:44:12,518 EPOCH 63 done: loss 0.8117 - lr 0.0140625
2020-10-27 13:44:15,275 DEV : loss 2.523728847503662 - score 0.8454
2020-10-27 13:44:15,366 BAD EPOCHS (no improvement): 3
2020-10-27 13:44:15,368 ----------------------------------------------------------------------------------------------------
2020-10-27 13:44:21,955 epoch 64 - iter 22/220 - loss 0.83139271 - samples/sec: 106.94 - lr: 0.014062
2020-10-27 13:44:26,882 epoch 64 - iter 44/220 - loss 0.76813367 - samples/sec: 143.03 - lr: 0.014062
2020-10-27 13:44:39,555 epoch 64 - iter 66/220 - loss 0.76095573 - samples/sec: 55.57 - lr: 0.014062
2020-10-27 13:44:51,330 epoch 64 - iter 88/220 - loss 0.75111395 - samples/sec: 59.81 - lr: 0.014062
2020-10-27 13:45:02,798 epoch 64 - iter 110/220 - loss 0.72235151 - samples/sec: 61.41 - lr: 0.014062
2020-10-27 13:45:11,003 epoch 64 - iter 132/220 - loss 0.73094216 - samples/sec: 85.86 - lr: 0.014062
2020-10-27 13:45:20,278 epoch 64 - iter 154/220 - loss 0.77029187 - samples/sec: 75.95 - lr: 0.014062
2020-10-27 13:45:26,320 epoch 64 - iter 176/220 - loss 0.77000306 - samples/sec: 116.62 - lr: 0.014062
2020-10-27 13:45:34,076 epoch 64 - iter 198/220 - loss 0.76789374 - samples/sec: 90.83 - lr: 0.014062
2020-10-27 13:45:46,149 epoch 64 - iter 220/220 - loss 0.76392832 - samples/sec: 58.34 - lr: 0.014062
2020-10-27 13:45:46,151 ----------------------------------------------------------------------------------------------------
2020-10-27 13:45:46,151 EPOCH 64 done: loss 0.7639 - lr 0.0140625
2020-10-27 13:45:56,672 DEV : loss 2.5651512145996094 - score 0.8461
2020-10-27 13:45:56,768 BAD EPOCHS (no improvement): 4
2020-10-27 13:45:56,772 ----------------------------------------------------------------------------------------------------
2020-10-27 13:46:09,150 epoch 65 - iter 22/220 - loss 0.88944627 - samples/sec: 56.90 - lr: 0.007031
2020-10-27 13:46:14,548 epoch 65 - iter 44/220 - loss 0.81305926 - samples/sec: 130.57 - lr: 0.007031
2020-10-27 13:46:19,236 epoch 65 - iter 66/220 - loss 0.74032527 - samples/sec: 150.33 - lr: 0.007031
2020-10-27 13:46:23,808 epoch 65 - iter 88/220 - loss 0.75174340 - samples/sec: 154.14 - lr: 0.007031
2020-10-27 13:46:28,965 epoch 65 - iter 110/220 - loss 0.75311308 - samples/sec: 136.65 - lr: 0.007031
2020-10-27 13:46:43,664 epoch 65 - iter 132/220 - loss 0.77585851 - samples/sec: 47.91 - lr: 0.007031
2020-10-27 13:46:58,497 epoch 65 - iter 154/220 - loss 0.77448122 - samples/sec: 47.48 - lr: 0.007031
2020-10-27 13:47:10,461 epoch 65 - iter 176/220 - loss 0.76959580 - samples/sec: 58.87 - lr: 0.007031
2020-10-27 13:47:17,166 epoch 65 - iter 198/220 - loss 0.77538870 - samples/sec: 105.07 - lr: 0.007031
2020-10-27 13:47:22,201 epoch 65 - iter 220/220 - loss 0.77595300 - samples/sec: 139.99 - lr: 0.007031
2020-10-27 13:47:22,202 ----------------------------------------------------------------------------------------------------
2020-10-27 13:47:22,202 EPOCH 65 done: loss 0.7760 - lr 0.0070312
2020-10-27 13:47:24,969 DEV : loss 2.567673683166504 - score 0.8489
2020-10-27 13:47:25,060 BAD EPOCHS (no improvement): 0
2020-10-27 13:47:30,118 ----------------------------------------------------------------------------------------------------
2020-10-27 13:47:35,622 epoch 66 - iter 22/220 - loss 0.69326727 - samples/sec: 128.04 - lr: 0.007031
2020-10-27 13:47:40,242 epoch 66 - iter 44/220 - loss 0.69668559 - samples/sec: 152.55 - lr: 0.007031
2020-10-27 13:47:46,161 epoch 66 - iter 66/220 - loss 0.70625676 - samples/sec: 119.05 - lr: 0.007031
2020-10-27 13:47:57,723 epoch 66 - iter 88/220 - loss 0.71072443 - samples/sec: 60.92 - lr: 0.007031
2020-10-27 13:48:10,857 epoch 66 - iter 110/220 - loss 0.73190625 - samples/sec: 53.62 - lr: 0.007031
2020-10-27 13:48:27,612 epoch 66 - iter 132/220 - loss 0.77831126 - samples/sec: 42.03 - lr: 0.007031
2020-10-27 13:48:39,675 epoch 66 - iter 154/220 - loss 0.76237197 - samples/sec: 58.39 - lr: 0.007031
2020-10-27 13:48:52,227 epoch 66 - iter 176/220 - loss 0.75369785 - samples/sec: 56.11 - lr: 0.007031
2020-10-27 13:49:00,933 epoch 66 - iter 198/220 - loss 0.77233136 - samples/sec: 80.92 - lr: 0.007031
2020-10-27 13:49:05,672 epoch 66 - iter 220/220 - loss 0.76956215 - samples/sec: 148.71 - lr: 0.007031
2020-10-27 13:49:05,672 ----------------------------------------------------------------------------------------------------
2020-10-27 13:49:05,673 EPOCH 66 done: loss 0.7696 - lr 0.0070312
2020-10-27 13:49:08,467 DEV : loss 2.552175283432007 - score 0.8495
2020-10-27 13:49:08,557 BAD EPOCHS (no improvement): 0
2020-10-27 13:49:15,342 ----------------------------------------------------------------------------------------------------
2020-10-27 13:49:31,911 epoch 67 - iter 22/220 - loss 0.97122257 - samples/sec: 42.50 - lr: 0.007031
2020-10-27 13:49:45,533 epoch 67 - iter 44/220 - loss 0.87676592 - samples/sec: 51.71 - lr: 0.007031
2020-10-27 13:49:58,339 epoch 67 - iter 66/220 - loss 0.83754447 - samples/sec: 55.00 - lr: 0.007031
2020-10-27 13:50:03,600 epoch 67 - iter 88/220 - loss 0.82219449 - samples/sec: 133.94 - lr: 0.007031
2020-10-27 13:50:08,928 epoch 67 - iter 110/220 - loss 0.81474683 - samples/sec: 132.28 - lr: 0.007031
2020-10-27 13:50:14,219 epoch 67 - iter 132/220 - loss 0.79132660 - samples/sec: 133.19 - lr: 0.007031
2020-10-27 13:50:20,577 epoch 67 - iter 154/220 - loss 0.77469864 - samples/sec: 110.81 - lr: 0.007031
2020-10-27 13:50:25,676 epoch 67 - iter 176/220 - loss 0.76593535 - samples/sec: 138.16 - lr: 0.007031
2020-10-27 13:50:31,146 epoch 67 - iter 198/220 - loss 0.75835394 - samples/sec: 128.83 - lr: 0.007031
2020-10-27 13:50:41,240 epoch 67 - iter 220/220 - loss 0.75930131 - samples/sec: 69.78 - lr: 0.007031
2020-10-27 13:50:41,241 ----------------------------------------------------------------------------------------------------
2020-10-27 13:50:41,241 EPOCH 67 done: loss 0.7593 - lr 0.0070312
2020-10-27 13:50:51,636 DEV : loss 2.5460643768310547 - score 0.8475
2020-10-27 13:50:51,727 BAD EPOCHS (no improvement): 1
2020-10-27 13:50:51,729 ----------------------------------------------------------------------------------------------------
2020-10-27 13:51:03,962 epoch 68 - iter 22/220 - loss 0.73824701 - samples/sec: 57.57 - lr: 0.007031
2020-10-27 13:51:15,495 epoch 68 - iter 44/220 - loss 0.75138746 - samples/sec: 61.07 - lr: 0.007031
2020-10-27 13:51:24,289 epoch 68 - iter 66/220 - loss 0.79136279 - samples/sec: 80.11 - lr: 0.007031
2020-10-27 13:51:30,266 epoch 68 - iter 88/220 - loss 0.73336303 - samples/sec: 117.87 - lr: 0.007031
2020-10-27 13:51:35,107 epoch 68 - iter 110/220 - loss 0.74386349 - samples/sec: 145.58 - lr: 0.007031
2020-10-27 13:51:40,237 epoch 68 - iter 132/220 - loss 0.74571100 - samples/sec: 137.37 - lr: 0.007031
2020-10-27 13:51:45,811 epoch 68 - iter 154/220 - loss 0.74468917 - samples/sec: 126.42 - lr: 0.007031
2020-10-27 13:51:51,235 epoch 68 - iter 176/220 - loss 0.74513855 - samples/sec: 129.89 - lr: 0.007031
2020-10-27 13:52:03,271 epoch 68 - iter 198/220 - loss 0.74513764 - samples/sec: 58.51 - lr: 0.007031
2020-10-27 13:52:16,497 epoch 68 - iter 220/220 - loss 0.73822963 - samples/sec: 53.25 - lr: 0.007031
2020-10-27 13:52:16,498 ----------------------------------------------------------------------------------------------------
2020-10-27 13:52:16,498 EPOCH 68 done: loss 0.7382 - lr 0.0070312
2020-10-27 13:52:20,953 DEV : loss 2.5439980030059814 - score 0.8462
2020-10-27 13:52:21,044 BAD EPOCHS (no improvement): 2
2020-10-27 13:52:21,047 ----------------------------------------------------------------------------------------------------
2020-10-27 13:52:26,319 epoch 69 - iter 22/220 - loss 0.73607652 - samples/sec: 133.65 - lr: 0.007031
2020-10-27 13:52:31,839 epoch 69 - iter 44/220 - loss 0.69441874 - samples/sec: 127.64 - lr: 0.007031
2020-10-27 13:52:37,173 epoch 69 - iter 66/220 - loss 0.71305207 - samples/sec: 132.11 - lr: 0.007031
2020-10-27 13:52:46,538 epoch 69 - iter 88/220 - loss 0.75314416 - samples/sec: 75.22 - lr: 0.007031
2020-10-27 13:52:59,001 epoch 69 - iter 110/220 - loss 0.74968571 - samples/sec: 56.51 - lr: 0.007031
2020-10-27 13:53:13,431 epoch 69 - iter 132/220 - loss 0.76596623 - samples/sec: 48.81 - lr: 0.007031
2020-10-27 13:53:24,112 epoch 69 - iter 154/220 - loss 0.77902736 - samples/sec: 65.93 - lr: 0.007031
2020-10-27 13:53:28,640 epoch 69 - iter 176/220 - loss 0.77588723 - samples/sec: 155.63 - lr: 0.007031
2020-10-27 13:53:34,199 epoch 69 - iter 198/220 - loss 0.76559095 - samples/sec: 126.74 - lr: 0.007031
2020-10-27 13:53:38,414 epoch 69 - iter 220/220 - loss 0.75788923 - samples/sec: 167.19 - lr: 0.007031
2020-10-27 13:53:38,415 ----------------------------------------------------------------------------------------------------
2020-10-27 13:53:38,415 EPOCH 69 done: loss 0.7579 - lr 0.0070312
2020-10-27 13:53:41,210 DEV : loss 2.552311420440674 - score 0.846
2020-10-27 13:53:41,300 BAD EPOCHS (no improvement): 3
2020-10-27 13:53:41,311 ----------------------------------------------------------------------------------------------------
2020-10-27 13:53:48,320 epoch 70 - iter 22/220 - loss 0.84531442 - samples/sec: 100.48 - lr: 0.007031
2020-10-27 13:54:01,313 epoch 70 - iter 44/220 - loss 0.84087171 - samples/sec: 54.20 - lr: 0.007031
2020-10-27 13:54:13,232 epoch 70 - iter 66/220 - loss 0.77527172 - samples/sec: 59.09 - lr: 0.007031
2020-10-27 13:54:27,975 epoch 70 - iter 88/220 - loss 0.79515181 - samples/sec: 47.76 - lr: 0.007031
2020-10-27 13:54:32,786 epoch 70 - iter 110/220 - loss 0.77145845 - samples/sec: 146.43 - lr: 0.007031
2020-10-27 13:54:37,193 epoch 70 - iter 132/220 - loss 0.76455989 - samples/sec: 159.89 - lr: 0.007031
2020-10-27 13:54:41,395 epoch 70 - iter 154/220 - loss 0.77443107 - samples/sec: 167.65 - lr: 0.007031
2020-10-27 13:54:46,416 epoch 70 - iter 176/220 - loss 0.76551509 - samples/sec: 140.31 - lr: 0.007031
2020-10-27 13:54:50,579 epoch 70 - iter 198/220 - loss 0.75443452 - samples/sec: 169.31 - lr: 0.007031
2020-10-27 13:54:55,630 epoch 70 - iter 220/220 - loss 0.74504462 - samples/sec: 139.47 - lr: 0.007031
2020-10-27 13:54:55,631 ----------------------------------------------------------------------------------------------------
2020-10-27 13:54:55,631 EPOCH 70 done: loss 0.7450 - lr 0.0070312
2020-10-27 13:54:58,384 DEV : loss 2.5591118335723877 - score 0.8486
2020-10-27 13:54:58,475 BAD EPOCHS (no improvement): 4
2020-10-27 13:54:58,478 ----------------------------------------------------------------------------------------------------
2020-10-27 13:55:03,044 epoch 71 - iter 22/220 - loss 0.66314305 - samples/sec: 154.29 - lr: 0.003516
2020-10-27 13:55:13,276 epoch 71 - iter 44/220 - loss 0.69616433 - samples/sec: 68.82 - lr: 0.003516
2020-10-27 13:55:25,046 epoch 71 - iter 66/220 - loss 0.72357611 - samples/sec: 59.83 - lr: 0.003516
2020-10-27 13:55:36,514 epoch 71 - iter 88/220 - loss 0.70218758 - samples/sec: 61.41 - lr: 0.003516
2020-10-27 13:55:47,797 epoch 71 - iter 110/220 - loss 0.72710539 - samples/sec: 62.41 - lr: 0.003516
2020-10-27 13:55:52,832 epoch 71 - iter 132/220 - loss 0.72192355 - samples/sec: 139.93 - lr: 0.003516
2020-10-27 13:55:57,823 epoch 71 - iter 154/220 - loss 0.73976838 - samples/sec: 141.16 - lr: 0.003516
2020-10-27 13:56:04,342 epoch 71 - iter 176/220 - loss 0.75831947 - samples/sec: 108.06 - lr: 0.003516
2020-10-27 13:56:11,040 epoch 71 - iter 198/220 - loss 0.76120440 - samples/sec: 105.16 - lr: 0.003516
2020-10-27 13:56:15,382 epoch 71 - iter 220/220 - loss 0.76275933 - samples/sec: 162.26 - lr: 0.003516
2020-10-27 13:56:15,383 ----------------------------------------------------------------------------------------------------
2020-10-27 13:56:15,383 EPOCH 71 done: loss 0.7628 - lr 0.0035156
2020-10-27 13:56:19,271 DEV : loss 2.555922508239746 - score 0.8475
2020-10-27 13:56:19,363 BAD EPOCHS (no improvement): 1
2020-10-27 13:56:19,377 ----------------------------------------------------------------------------------------------------
2020-10-27 13:56:23,943 epoch 72 - iter 22/220 - loss 0.74342851 - samples/sec: 154.31 - lr: 0.003516
2020-10-27 13:56:31,264 epoch 72 - iter 44/220 - loss 0.71386777 - samples/sec: 96.20 - lr: 0.003516
2020-10-27 13:56:47,272 epoch 72 - iter 66/220 - loss 0.78607483 - samples/sec: 43.99 - lr: 0.003516
2020-10-27 13:57:00,124 epoch 72 - iter 88/220 - loss 0.76592775 - samples/sec: 54.79 - lr: 0.003516
2020-10-27 13:57:09,604 epoch 72 - iter 110/220 - loss 0.75723540 - samples/sec: 74.30 - lr: 0.003516
2020-10-27 13:57:16,351 epoch 72 - iter 132/220 - loss 0.76166551 - samples/sec: 104.40 - lr: 0.003516
2020-10-27 13:57:21,852 epoch 72 - iter 154/220 - loss 0.76719997 - samples/sec: 128.08 - lr: 0.003516
2020-10-27 13:57:26,089 epoch 72 - iter 176/220 - loss 0.75902678 - samples/sec: 166.29 - lr: 0.003516
2020-10-27 13:57:30,530 epoch 72 - iter 198/220 - loss 0.75070565 - samples/sec: 158.68 - lr: 0.003516
2020-10-27 13:57:35,840 epoch 72 - iter 220/220 - loss 0.74820302 - samples/sec: 132.66 - lr: 0.003516
2020-10-27 13:57:35,840 ----------------------------------------------------------------------------------------------------
2020-10-27 13:57:35,840 EPOCH 72 done: loss 0.7482 - lr 0.0035156
2020-10-27 13:57:46,282 DEV : loss 2.559976816177368 - score 0.8493
2020-10-27 13:57:46,374 BAD EPOCHS (no improvement): 2
2020-10-27 13:57:46,380 ----------------------------------------------------------------------------------------------------
2020-10-27 13:58:01,475 epoch 73 - iter 22/220 - loss 0.76978745 - samples/sec: 46.65 - lr: 0.003516
2020-10-27 13:58:14,635 epoch 73 - iter 44/220 - loss 0.73880357 - samples/sec: 53.52 - lr: 0.003516
2020-10-27 13:58:20,124 epoch 73 - iter 66/220 - loss 0.72647668 - samples/sec: 128.38 - lr: 0.003516
2020-10-27 13:58:26,320 epoch 73 - iter 88/220 - loss 0.73600963 - samples/sec: 113.72 - lr: 0.003516
2020-10-27 13:58:31,440 epoch 73 - iter 110/220 - loss 0.72001369 - samples/sec: 137.62 - lr: 0.003516
2020-10-27 13:58:39,251 epoch 73 - iter 132/220 - loss 0.71946934 - samples/sec: 90.18 - lr: 0.003516
2020-10-27 13:58:54,400 epoch 73 - iter 154/220 - loss 0.74334372 - samples/sec: 46.49 - lr: 0.003516
2020-10-27 13:59:06,760 epoch 73 - iter 176/220 - loss 0.73143600 - samples/sec: 56.98 - lr: 0.003516
2020-10-27 13:59:17,735 epoch 73 - iter 198/220 - loss 0.73788560 - samples/sec: 64.17 - lr: 0.003516
2020-10-27 13:59:21,845 epoch 73 - iter 220/220 - loss 0.73364306 - samples/sec: 171.44 - lr: 0.003516
2020-10-27 13:59:21,846 ----------------------------------------------------------------------------------------------------
2020-10-27 13:59:21,846 EPOCH 73 done: loss 0.7336 - lr 0.0035156
2020-10-27 13:59:24,608 DEV : loss 2.560823917388916 - score 0.8491
2020-10-27 13:59:24,699 BAD EPOCHS (no improvement): 3
2020-10-27 13:59:24,702 ----------------------------------------------------------------------------------------------------
2020-10-27 13:59:29,593 epoch 74 - iter 22/220 - loss 0.73510678 - samples/sec: 144.04 - lr: 0.003516
2020-10-27 13:59:34,088 epoch 74 - iter 44/220 - loss 0.75239172 - samples/sec: 156.78 - lr: 0.003516
2020-10-27 13:59:38,330 epoch 74 - iter 66/220 - loss 0.72237480 - samples/sec: 166.11 - lr: 0.003516
2020-10-27 13:59:43,318 epoch 74 - iter 88/220 - loss 0.71265950 - samples/sec: 141.25 - lr: 0.003516
2020-10-27 13:59:52,284 epoch 74 - iter 110/220 - loss 0.71418524 - samples/sec: 78.54 - lr: 0.003516
2020-10-27 14:00:06,001 epoch 74 - iter 132/220 - loss 0.72993684 - samples/sec: 51.34 - lr: 0.003516
2020-10-27 14:00:18,043 epoch 74 - iter 154/220 - loss 0.73612553 - samples/sec: 58.48 - lr: 0.003516
2020-10-27 14:00:30,204 epoch 74 - iter 176/220 - loss 0.73597059 - samples/sec: 57.91 - lr: 0.003516
2020-10-27 14:00:43,192 epoch 74 - iter 198/220 - loss 0.73151245 - samples/sec: 54.22 - lr: 0.003516
2020-10-27 14:00:55,739 epoch 74 - iter 220/220 - loss 0.73578717 - samples/sec: 56.13 - lr: 0.003516
2020-10-27 14:00:55,740 ----------------------------------------------------------------------------------------------------
2020-10-27 14:00:55,740 EPOCH 74 done: loss 0.7358 - lr 0.0035156
2020-10-27 14:00:58,487 DEV : loss 2.5617048740386963 - score 0.8478
2020-10-27 14:00:58,577 BAD EPOCHS (no improvement): 4
2020-10-27 14:00:58,584 ----------------------------------------------------------------------------------------------------
2020-10-27 14:01:03,904 epoch 75 - iter 22/220 - loss 0.78782503 - samples/sec: 132.40 - lr: 0.001758
2020-10-27 14:01:08,579 epoch 75 - iter 44/220 - loss 0.76348391 - samples/sec: 150.74 - lr: 0.001758
2020-10-27 14:01:13,038 epoch 75 - iter 66/220 - loss 0.76815170 - samples/sec: 158.01 - lr: 0.001758
2020-10-27 14:01:18,580 epoch 75 - iter 88/220 - loss 0.78722863 - samples/sec: 127.12 - lr: 0.001758
2020-10-27 14:01:30,637 epoch 75 - iter 110/220 - loss 0.75866913 - samples/sec: 58.41 - lr: 0.001758
2020-10-27 14:01:43,118 epoch 75 - iter 132/220 - loss 0.74443039 - samples/sec: 56.42 - lr: 0.001758
2020-10-27 14:01:57,832 epoch 75 - iter 154/220 - loss 0.74602233 - samples/sec: 47.86 - lr: 0.001758
2020-10-27 14:02:03,670 epoch 75 - iter 176/220 - loss 0.73156157 - samples/sec: 120.67 - lr: 0.001758
2020-10-27 14:02:08,867 epoch 75 - iter 198/220 - loss 0.72256424 - samples/sec: 135.58 - lr: 0.001758
2020-10-27 14:02:15,241 epoch 75 - iter 220/220 - loss 0.72898514 - samples/sec: 110.50 - lr: 0.001758
2020-10-27 14:02:15,242 ----------------------------------------------------------------------------------------------------
2020-10-27 14:02:15,242 EPOCH 75 done: loss 0.7290 - lr 0.0017578
2020-10-27 14:02:18,012 DEV : loss 2.566305160522461 - score 0.8477
2020-10-27 14:02:18,102 BAD EPOCHS (no improvement): 1
2020-10-27 14:02:18,105 ----------------------------------------------------------------------------------------------------
2020-10-27 14:02:23,079 epoch 76 - iter 22/220 - loss 0.80835643 - samples/sec: 141.63 - lr: 0.001758
2020-10-27 14:02:33,708 epoch 76 - iter 44/220 - loss 0.87377035 - samples/sec: 66.26 - lr: 0.001758
2020-10-27 14:02:38,433 epoch 76 - iter 66/220 - loss 0.84418964 - samples/sec: 149.07 - lr: 0.001758
2020-10-27 14:02:44,787 epoch 76 - iter 88/220 - loss 0.80587756 - samples/sec: 110.83 - lr: 0.001758
2020-10-27 14:02:57,349 epoch 76 - iter 110/220 - loss 0.79864196 - samples/sec: 56.06 - lr: 0.001758
2020-10-27 14:03:10,271 epoch 76 - iter 132/220 - loss 0.79149242 - samples/sec: 54.50 - lr: 0.001758
2020-10-27 14:03:21,210 epoch 76 - iter 154/220 - loss 0.77798836 - samples/sec: 64.38 - lr: 0.001758
2020-10-27 14:03:26,969 epoch 76 - iter 176/220 - loss 0.76886930 - samples/sec: 122.32 - lr: 0.001758
2020-10-27 14:03:31,533 epoch 76 - iter 198/220 - loss 0.76324215 - samples/sec: 154.39 - lr: 0.001758
2020-10-27 14:03:35,822 epoch 76 - iter 220/220 - loss 0.75542070 - samples/sec: 164.29 - lr: 0.001758
2020-10-27 14:03:35,823 ----------------------------------------------------------------------------------------------------
2020-10-27 14:03:35,823 EPOCH 76 done: loss 0.7554 - lr 0.0017578
2020-10-27 14:03:38,603 DEV : loss 2.560495138168335 - score 0.8483
2020-10-27 14:03:38,693 BAD EPOCHS (no improvement): 2
2020-10-27 14:03:38,696 ----------------------------------------------------------------------------------------------------
2020-10-27 14:03:45,241 epoch 77 - iter 22/220 - loss 0.79198265 - samples/sec: 107.62 - lr: 0.001758
2020-10-27 14:03:49,740 epoch 77 - iter 44/220 - loss 0.73285973 - samples/sec: 156.62 - lr: 0.001758
2020-10-27 14:03:54,696 epoch 77 - iter 66/220 - loss 0.71684734 - samples/sec: 142.15 - lr: 0.001758
2020-10-27 14:04:00,142 epoch 77 - iter 88/220 - loss 0.72774928 - samples/sec: 129.36 - lr: 0.001758
2020-10-27 14:04:07,515 epoch 77 - iter 110/220 - loss 0.72310392 - samples/sec: 95.52 - lr: 0.001758
2020-10-27 14:04:19,453 epoch 77 - iter 132/220 - loss 0.72305037 - samples/sec: 58.99 - lr: 0.001758
2020-10-27 14:04:31,450 epoch 77 - iter 154/220 - loss 0.72666597 - samples/sec: 58.70 - lr: 0.001758
2020-10-27 14:04:44,110 epoch 77 - iter 176/220 - loss 0.74577429 - samples/sec: 55.63 - lr: 0.001758
2020-10-27 14:04:49,208 epoch 77 - iter 198/220 - loss 0.73650878 - samples/sec: 138.21 - lr: 0.001758
2020-10-27 14:04:55,741 epoch 77 - iter 220/220 - loss 0.78665760 - samples/sec: 107.81 - lr: 0.001758
2020-10-27 14:04:55,743 ----------------------------------------------------------------------------------------------------
2020-10-27 14:04:55,745 EPOCH 77 done: loss 0.7867 - lr 0.0017578
2020-10-27 14:04:58,523 DEV : loss 2.554443359375 - score 0.8477
2020-10-27 14:04:58,612 BAD EPOCHS (no improvement): 3
2020-10-27 14:04:58,615 ----------------------------------------------------------------------------------------------------
2020-10-27 14:05:06,736 epoch 78 - iter 22/220 - loss 0.93389106 - samples/sec: 86.73 - lr: 0.001758
2020-10-27 14:05:11,647 epoch 78 - iter 44/220 - loss 0.78874994 - samples/sec: 143.43 - lr: 0.001758
2020-10-27 14:05:16,486 epoch 78 - iter 66/220 - loss 0.79312749 - samples/sec: 145.61 - lr: 0.001758
2020-10-27 14:05:24,552 epoch 78 - iter 88/220 - loss 0.76393055 - samples/sec: 87.31 - lr: 0.001758
2020-10-27 14:05:35,723 epoch 78 - iter 110/220 - loss 0.75188205 - samples/sec: 63.04 - lr: 0.001758
2020-10-27 14:05:47,355 epoch 78 - iter 132/220 - loss 0.72762508 - samples/sec: 60.55 - lr: 0.001758
2020-10-27 14:05:59,841 epoch 78 - iter 154/220 - loss 0.73318811 - samples/sec: 56.40 - lr: 0.001758
2020-10-27 14:06:05,339 epoch 78 - iter 176/220 - loss 0.72749703 - samples/sec: 128.17 - lr: 0.001758
2020-10-27 14:06:12,443 epoch 78 - iter 198/220 - loss 0.73738850 - samples/sec: 99.17 - lr: 0.001758
2020-10-27 14:06:17,403 epoch 78 - iter 220/220 - loss 0.73527395 - samples/sec: 142.07 - lr: 0.001758
2020-10-27 14:06:17,404 ----------------------------------------------------------------------------------------------------
2020-10-27 14:06:17,404 EPOCH 78 done: loss 0.7353 - lr 0.0017578
2020-10-27 14:06:20,175 DEV : loss 2.558873176574707 - score 0.8484
2020-10-27 14:06:20,266 BAD EPOCHS (no improvement): 4
2020-10-27 14:06:20,268 ----------------------------------------------------------------------------------------------------
2020-10-27 14:06:27,148 epoch 79 - iter 22/220 - loss 0.79009653 - samples/sec: 102.41 - lr: 0.000879
2020-10-27 14:06:39,960 epoch 79 - iter 44/220 - loss 0.75890918 - samples/sec: 54.96 - lr: 0.000879
2020-10-27 14:06:51,687 epoch 79 - iter 66/220 - loss 0.74483612 - samples/sec: 60.06 - lr: 0.000879
2020-10-27 14:07:03,762 epoch 79 - iter 88/220 - loss 0.74240445 - samples/sec: 58.33 - lr: 0.000879
2020-10-27 14:07:10,049 epoch 79 - iter 110/220 - loss 0.74927940 - samples/sec: 112.09 - lr: 0.000879
2020-10-27 14:07:15,070 epoch 79 - iter 132/220 - loss 0.72094423 - samples/sec: 140.38 - lr: 0.000879
2020-10-27 14:07:20,074 epoch 79 - iter 154/220 - loss 0.71319099 - samples/sec: 140.85 - lr: 0.000879
2020-10-27 14:07:26,278 epoch 79 - iter 176/220 - loss 0.71731035 - samples/sec: 113.57 - lr: 0.000879
2020-10-27 14:07:42,686 epoch 79 - iter 198/220 - loss 0.72070827 - samples/sec: 42.92 - lr: 0.000879
2020-10-27 14:07:57,437 epoch 79 - iter 220/220 - loss 0.73091852 - samples/sec: 47.74 - lr: 0.000879
2020-10-27 14:07:57,438 ----------------------------------------------------------------------------------------------------
2020-10-27 14:07:57,438 EPOCH 79 done: loss 0.7309 - lr 0.0008789
2020-10-27 14:08:07,600 DEV : loss 2.5565788745880127 - score 0.8477
2020-10-27 14:08:07,690 BAD EPOCHS (no improvement): 1
2020-10-27 14:08:07,692 ----------------------------------------------------------------------------------------------------
2020-10-27 14:08:13,125 epoch 80 - iter 22/220 - loss 0.63667959 - samples/sec: 129.69 - lr: 0.000879
2020-10-27 14:08:20,641 epoch 80 - iter 44/220 - loss 0.70752737 - samples/sec: 93.75 - lr: 0.000879
2020-10-27 14:08:25,767 epoch 80 - iter 66/220 - loss 0.72509670 - samples/sec: 137.47 - lr: 0.000879
2020-10-27 14:08:31,330 epoch 80 - iter 88/220 - loss 0.74531931 - samples/sec: 126.66 - lr: 0.000879
2020-10-27 14:08:37,588 epoch 80 - iter 110/220 - loss 0.72860991 - samples/sec: 112.58 - lr: 0.000879
2020-10-27 14:08:46,092 epoch 80 - iter 132/220 - loss 0.73656901 - samples/sec: 82.83 - lr: 0.000879
2020-10-27 14:08:59,807 epoch 80 - iter 154/220 - loss 0.75145837 - samples/sec: 51.34 - lr: 0.000879
2020-10-27 14:09:14,713 epoch 80 - iter 176/220 - loss 0.76817567 - samples/sec: 47.25 - lr: 0.000879
2020-10-27 14:09:23,713 epoch 80 - iter 198/220 - loss 0.75960557 - samples/sec: 78.27 - lr: 0.000879
2020-10-27 14:09:28,486 epoch 80 - iter 220/220 - loss 0.75715655 - samples/sec: 147.66 - lr: 0.000879
2020-10-27 14:09:28,487 ----------------------------------------------------------------------------------------------------
2020-10-27 14:09:28,487 EPOCH 80 done: loss 0.7572 - lr 0.0008789
2020-10-27 14:09:31,319 DEV : loss 2.5566999912261963 - score 0.8478
2020-10-27 14:09:31,410 BAD EPOCHS (no improvement): 2
2020-10-27 14:09:31,413 ----------------------------------------------------------------------------------------------------
2020-10-27 14:09:36,639 epoch 81 - iter 22/220 - loss 0.66483675 - samples/sec: 134.81 - lr: 0.000879
2020-10-27 14:09:41,810 epoch 81 - iter 44/220 - loss 0.67708506 - samples/sec: 136.29 - lr: 0.000879
2020-10-27 14:09:47,933 epoch 81 - iter 66/220 - loss 0.67256030 - samples/sec: 115.08 - lr: 0.000879
2020-10-27 14:09:53,365 epoch 81 - iter 88/220 - loss 0.70218107 - samples/sec: 129.77 - lr: 0.000879
2020-10-27 14:09:58,084 epoch 81 - iter 110/220 - loss 0.69410347 - samples/sec: 149.36 - lr: 0.000879
2020-10-27 14:10:09,724 epoch 81 - iter 132/220 - loss 0.73143148 - samples/sec: 60.50 - lr: 0.000879
2020-10-27 14:10:22,748 epoch 81 - iter 154/220 - loss 0.74327261 - samples/sec: 54.08 - lr: 0.000879
2020-10-27 14:10:35,460 epoch 81 - iter 176/220 - loss 0.72652327 - samples/sec: 55.41 - lr: 0.000879
2020-10-27 14:10:44,265 epoch 81 - iter 198/220 - loss 0.72436108 - samples/sec: 80.01 - lr: 0.000879
2020-10-27 14:10:51,670 epoch 81 - iter 220/220 - loss 0.74623565 - samples/sec: 95.15 - lr: 0.000879
2020-10-27 14:10:51,671 ----------------------------------------------------------------------------------------------------
2020-10-27 14:10:51,671 EPOCH 81 done: loss 0.7462 - lr 0.0008789
2020-10-27 14:10:54,419 DEV : loss 2.557149648666382 - score 0.848
2020-10-27 14:10:54,511 BAD EPOCHS (no improvement): 3
2020-10-27 14:10:54,513 ----------------------------------------------------------------------------------------------------
2020-10-27 14:11:00,184 epoch 82 - iter 22/220 - loss 0.70944599 - samples/sec: 124.25 - lr: 0.000879
2020-10-27 14:11:07,683 epoch 82 - iter 44/220 - loss 0.78064131 - samples/sec: 93.95 - lr: 0.000879
2020-10-27 14:11:13,037 epoch 82 - iter 66/220 - loss 0.76784074 - samples/sec: 131.64 - lr: 0.000879
2020-10-27 14:11:28,010 epoch 82 - iter 88/220 - loss 0.76844939 - samples/sec: 47.03 - lr: 0.000879
2020-10-27 14:11:41,172 epoch 82 - iter 110/220 - loss 0.76743544 - samples/sec: 53.51 - lr: 0.000879
2020-10-27 14:11:53,466 epoch 82 - iter 132/220 - loss 0.77351111 - samples/sec: 57.29 - lr: 0.000879
2020-10-27 14:11:58,883 epoch 82 - iter 154/220 - loss 0.75520215 - samples/sec: 130.09 - lr: 0.000879
2020-10-27 14:12:05,171 epoch 82 - iter 176/220 - loss 0.75344744 - samples/sec: 112.07 - lr: 0.000879
2020-10-27 14:12:09,929 epoch 82 - iter 198/220 - loss 0.74233328 - samples/sec: 148.14 - lr: 0.000879
2020-10-27 14:12:14,741 epoch 82 - iter 220/220 - loss 0.73712598 - samples/sec: 146.43 - lr: 0.000879
2020-10-27 14:12:14,742 ----------------------------------------------------------------------------------------------------
2020-10-27 14:12:14,742 EPOCH 82 done: loss 0.7371 - lr 0.0008789
2020-10-27 14:12:17,959 DEV : loss 2.5589756965637207 - score 0.8478
2020-10-27 14:12:18,051 BAD EPOCHS (no improvement): 4
2020-10-27 14:12:18,053 ----------------------------------------------------------------------------------------------------
2020-10-27 14:12:31,967 epoch 83 - iter 22/220 - loss 0.79152904 - samples/sec: 50.61 - lr: 0.000439
2020-10-27 14:12:44,502 epoch 83 - iter 44/220 - loss 0.75484141 - samples/sec: 56.19 - lr: 0.000439
2020-10-27 14:12:57,115 epoch 83 - iter 66/220 - loss 0.75638600 - samples/sec: 55.84 - lr: 0.000439
2020-10-27 14:13:10,355 epoch 83 - iter 88/220 - loss 0.74459570 - samples/sec: 53.19 - lr: 0.000439
2020-10-27 14:13:22,446 epoch 83 - iter 110/220 - loss 0.72546109 - samples/sec: 58.25 - lr: 0.000439
2020-10-27 14:13:30,571 epoch 83 - iter 132/220 - loss 0.72702539 - samples/sec: 86.71 - lr: 0.000439
2020-10-27 14:13:38,406 epoch 83 - iter 154/220 - loss 0.75622075 - samples/sec: 89.90 - lr: 0.000439
2020-10-27 14:13:46,524 epoch 83 - iter 176/220 - loss 0.78042591 - samples/sec: 86.77 - lr: 0.000439
2020-10-27 14:13:57,692 epoch 83 - iter 198/220 - loss 0.76599031 - samples/sec: 63.06 - lr: 0.000439
2020-10-27 14:14:08,798 epoch 83 - iter 220/220 - loss 0.75240199 - samples/sec: 63.42 - lr: 0.000439
2020-10-27 14:14:08,799 ----------------------------------------------------------------------------------------------------
2020-10-27 14:14:08,799 EPOCH 83 done: loss 0.7524 - lr 0.0004395
2020-10-27 14:14:19,226 DEV : loss 2.557966470718384 - score 0.8478
2020-10-27 14:14:19,317 BAD EPOCHS (no improvement): 1
2020-10-27 14:14:19,320 ----------------------------------------------------------------------------------------------------
2020-10-27 14:14:28,077 epoch 84 - iter 22/220 - loss 0.62085245 - samples/sec: 80.43 - lr: 0.000439
2020-10-27 14:14:33,865 epoch 84 - iter 44/220 - loss 0.66246190 - samples/sec: 121.73 - lr: 0.000439
2020-10-27 14:14:38,967 epoch 84 - iter 66/220 - loss 0.67194419 - samples/sec: 138.11 - lr: 0.000439
2020-10-27 14:14:43,767 epoch 84 - iter 88/220 - loss 0.68124426 - samples/sec: 146.84 - lr: 0.000439
2020-10-27 14:14:52,430 epoch 84 - iter 110/220 - loss 0.67119044 - samples/sec: 81.31 - lr: 0.000439
2020-10-27 14:15:09,846 epoch 84 - iter 132/220 - loss 0.70901037 - samples/sec: 40.43 - lr: 0.000439
2020-10-27 14:15:23,462 epoch 84 - iter 154/220 - loss 0.72066745 - samples/sec: 51.72 - lr: 0.000439
2020-10-27 14:15:31,616 epoch 84 - iter 176/220 - loss 0.73815959 - samples/sec: 86.41 - lr: 0.000439
2020-10-27 14:15:37,684 epoch 84 - iter 198/220 - loss 0.74234556 - samples/sec: 116.12 - lr: 0.000439
2020-10-27 14:15:44,456 epoch 84 - iter 220/220 - loss 0.73764652 - samples/sec: 104.03 - lr: 0.000439
2020-10-27 14:15:44,457 ----------------------------------------------------------------------------------------------------
2020-10-27 14:15:44,457 EPOCH 84 done: loss 0.7376 - lr 0.0004395
2020-10-27 14:15:47,243 DEV : loss 2.5576038360595703 - score 0.8478
2020-10-27 14:15:47,333 BAD EPOCHS (no improvement): 2
2020-10-27 14:15:47,341 ----------------------------------------------------------------------------------------------------
2020-10-27 14:15:52,238 epoch 85 - iter 22/220 - loss 0.75306329 - samples/sec: 143.86 - lr: 0.000439
2020-10-27 14:15:59,573 epoch 85 - iter 44/220 - loss 0.81703909 - samples/sec: 96.03 - lr: 0.000439
2020-10-27 14:16:10,764 epoch 85 - iter 66/220 - loss 0.85954936 - samples/sec: 62.94 - lr: 0.000439
2020-10-27 14:16:23,206 epoch 85 - iter 88/220 - loss 0.84545968 - samples/sec: 56.60 - lr: 0.000439
2020-10-27 14:16:34,528 epoch 85 - iter 110/220 - loss 0.81002897 - samples/sec: 62.20 - lr: 0.000439
2020-10-27 14:16:45,646 epoch 85 - iter 132/220 - loss 0.77691812 - samples/sec: 63.35 - lr: 0.000439
2020-10-27 14:16:51,483 epoch 85 - iter 154/220 - loss 0.77182908 - samples/sec: 120.75 - lr: 0.000439
2020-10-27 14:16:58,447 epoch 85 - iter 176/220 - loss 0.76736499 - samples/sec: 101.16 - lr: 0.000439
2020-10-27 14:17:03,599 epoch 85 - iter 198/220 - loss 0.76008684 - samples/sec: 136.75 - lr: 0.000439
2020-10-27 14:17:10,025 epoch 85 - iter 220/220 - loss 0.75728861 - samples/sec: 109.64 - lr: 0.000439
2020-10-27 14:17:10,025 ----------------------------------------------------------------------------------------------------
2020-10-27 14:17:10,025 EPOCH 85 done: loss 0.7573 - lr 0.0004395
2020-10-27 14:17:13,413 DEV : loss 2.555994987487793 - score 0.8478
2020-10-27 14:17:13,525 BAD EPOCHS (no improvement): 3
2020-10-27 14:17:13,527 ----------------------------------------------------------------------------------------------------
2020-10-27 14:17:18,851 epoch 86 - iter 22/220 - loss 0.66805630 - samples/sec: 132.36 - lr: 0.000439
2020-10-27 14:17:27,373 epoch 86 - iter 44/220 - loss 0.73981817 - samples/sec: 82.66 - lr: 0.000439
2020-10-27 14:17:41,833 epoch 86 - iter 66/220 - loss 0.73383959 - samples/sec: 48.70 - lr: 0.000439
2020-10-27 14:17:53,540 epoch 86 - iter 88/220 - loss 0.71327380 - samples/sec: 60.16 - lr: 0.000439
2020-10-27 14:18:07,431 epoch 86 - iter 110/220 - loss 0.71763674 - samples/sec: 50.70 - lr: 0.000439
2020-10-27 14:18:12,427 epoch 86 - iter 132/220 - loss 0.70800924 - samples/sec: 141.10 - lr: 0.000439
2020-10-27 14:18:17,352 epoch 86 - iter 154/220 - loss 0.71208093 - samples/sec: 143.08 - lr: 0.000439
2020-10-27 14:18:24,518 epoch 86 - iter 176/220 - loss 0.72167351 - samples/sec: 98.30 - lr: 0.000439
2020-10-27 14:18:29,295 epoch 86 - iter 198/220 - loss 0.72953833 - samples/sec: 147.54 - lr: 0.000439
2020-10-27 14:18:33,481 epoch 86 - iter 220/220 - loss 0.72375054 - samples/sec: 168.33 - lr: 0.000439
2020-10-27 14:18:33,481 ----------------------------------------------------------------------------------------------------
2020-10-27 14:18:33,481 EPOCH 86 done: loss 0.7238 - lr 0.0004395
2020-10-27 14:18:36,223 DEV : loss 2.55780029296875 - score 0.8478
2020-10-27 14:18:36,313 BAD EPOCHS (no improvement): 4
2020-10-27 14:18:36,315 ----------------------------------------------------------------------------------------------------
2020-10-27 14:18:48,962 epoch 87 - iter 22/220 - loss 0.78782597 - samples/sec: 55.68 - lr: 0.000220
2020-10-27 14:19:00,734 epoch 87 - iter 44/220 - loss 0.73247283 - samples/sec: 59.82 - lr: 0.000220
2020-10-27 14:19:14,735 epoch 87 - iter 66/220 - loss 0.77350939 - samples/sec: 50.30 - lr: 0.000220
2020-10-27 14:19:23,076 epoch 87 - iter 88/220 - loss 0.77501657 - samples/sec: 84.44 - lr: 0.000220
2020-10-27 14:19:27,801 epoch 87 - iter 110/220 - loss 0.76517051 - samples/sec: 149.09 - lr: 0.000220
2020-10-27 14:19:32,364 epoch 87 - iter 132/220 - loss 0.76218274 - samples/sec: 154.40 - lr: 0.000220
2020-10-27 14:19:36,556 epoch 87 - iter 154/220 - loss 0.73784231 - samples/sec: 168.10 - lr: 0.000220
2020-10-27 14:19:45,575 epoch 87 - iter 176/220 - loss 0.74190831 - samples/sec: 78.09 - lr: 0.000220
2020-10-27 14:19:57,411 epoch 87 - iter 198/220 - loss 0.73591104 - samples/sec: 59.49 - lr: 0.000220
2020-10-27 14:20:10,138 epoch 87 - iter 220/220 - loss 0.73301073 - samples/sec: 55.33 - lr: 0.000220
2020-10-27 14:20:10,138 ----------------------------------------------------------------------------------------------------
2020-10-27 14:20:10,138 EPOCH 87 done: loss 0.7330 - lr 0.0002197
2020-10-27 14:20:19,837 DEV : loss 2.5574586391448975 - score 0.8478
2020-10-27 14:20:19,929 BAD EPOCHS (no improvement): 1
2020-10-27 14:20:19,931 ----------------------------------------------------------------------------------------------------
2020-10-27 14:20:24,704 epoch 88 - iter 22/220 - loss 0.62210908 - samples/sec: 147.62 - lr: 0.000220
2020-10-27 14:20:31,091 epoch 88 - iter 44/220 - loss 0.65638454 - samples/sec: 110.28 - lr: 0.000220
2020-10-27 14:20:37,825 epoch 88 - iter 66/220 - loss 0.72794051 - samples/sec: 104.59 - lr: 0.000220
2020-10-27 14:20:43,043 epoch 88 - iter 88/220 - loss 0.72672503 - samples/sec: 134.99 - lr: 0.000220
2020-10-27 14:20:50,255 epoch 88 - iter 110/220 - loss 0.73399970 - samples/sec: 97.66 - lr: 0.000220
2020-10-27 14:21:02,424 epoch 88 - iter 132/220 - loss 0.73494060 - samples/sec: 57.87 - lr: 0.000220
2020-10-27 14:21:13,635 epoch 88 - iter 154/220 - loss 0.73429945 - samples/sec: 62.82 - lr: 0.000220
2020-10-27 14:21:26,258 epoch 88 - iter 176/220 - loss 0.73918052 - samples/sec: 55.78 - lr: 0.000220
2020-10-27 14:21:31,543 epoch 88 - iter 198/220 - loss 0.73440874 - samples/sec: 133.31 - lr: 0.000220
2020-10-27 14:21:36,627 epoch 88 - iter 220/220 - loss 0.74252653 - samples/sec: 138.58 - lr: 0.000220
2020-10-27 14:21:36,627 ----------------------------------------------------------------------------------------------------
2020-10-27 14:21:36,627 EPOCH 88 done: loss 0.7425 - lr 0.0002197
2020-10-27 14:21:40,473 DEV : loss 2.5569777488708496 - score 0.8478
2020-10-27 14:21:40,563 BAD EPOCHS (no improvement): 2
2020-10-27 14:21:40,569 ----------------------------------------------------------------------------------------------------
2020-10-27 14:21:46,192 epoch 89 - iter 22/220 - loss 0.80436967 - samples/sec: 125.26 - lr: 0.000220
2020-10-27 14:21:50,715 epoch 89 - iter 44/220 - loss 0.75736612 - samples/sec: 155.75 - lr: 0.000220
2020-10-27 14:21:56,011 epoch 89 - iter 66/220 - loss 0.73793438 - samples/sec: 133.00 - lr: 0.000220
2020-10-27 14:22:00,296 epoch 89 - iter 88/220 - loss 0.73160681 - samples/sec: 164.44 - lr: 0.000220
2020-10-27 14:22:14,199 epoch 89 - iter 110/220 - loss 0.74391027 - samples/sec: 50.65 - lr: 0.000220
2020-10-27 14:22:28,076 epoch 89 - iter 132/220 - loss 0.74980794 - samples/sec: 50.74 - lr: 0.000220
2020-10-27 14:22:41,035 epoch 89 - iter 154/220 - loss 0.74546749 - samples/sec: 54.34 - lr: 0.000220
2020-10-27 14:22:46,915 epoch 89 - iter 176/220 - loss 0.74021508 - samples/sec: 119.81 - lr: 0.000220
2020-10-27 14:22:51,993 epoch 89 - iter 198/220 - loss 0.72824492 - samples/sec: 138.74 - lr: 0.000220
2020-10-27 14:22:56,576 epoch 89 - iter 220/220 - loss 0.72926427 - samples/sec: 153.71 - lr: 0.000220
2020-10-27 14:22:56,576 ----------------------------------------------------------------------------------------------------
2020-10-27 14:22:56,577 EPOCH 89 done: loss 0.7293 - lr 0.0002197
2020-10-27 14:22:59,324 DEV : loss 2.5572075843811035 - score 0.8478
2020-10-27 14:22:59,415 BAD EPOCHS (no improvement): 3
2020-10-27 14:22:59,418 ----------------------------------------------------------------------------------------------------
2020-10-27 14:23:04,570 epoch 90 - iter 22/220 - loss 0.77535993 - samples/sec: 136.72 - lr: 0.000220
2020-10-27 14:23:09,227 epoch 90 - iter 44/220 - loss 0.75897400 - samples/sec: 151.28 - lr: 0.000220
2020-10-27 14:23:13,732 epoch 90 - iter 66/220 - loss 0.72699886 - samples/sec: 156.38 - lr: 0.000220
2020-10-27 14:23:26,302 epoch 90 - iter 88/220 - loss 0.74122452 - samples/sec: 56.02 - lr: 0.000220
2020-10-27 14:23:37,751 epoch 90 - iter 110/220 - loss 0.73401646 - samples/sec: 61.51 - lr: 0.000220
2020-10-27 14:23:53,818 epoch 90 - iter 132/220 - loss 0.76098377 - samples/sec: 43.83 - lr: 0.000220
2020-10-27 14:24:00,335 epoch 90 - iter 154/220 - loss 0.74252153 - samples/sec: 108.11 - lr: 0.000220
2020-10-27 14:24:05,813 epoch 90 - iter 176/220 - loss 0.74120385 - samples/sec: 128.59 - lr: 0.000220
2020-10-27 14:24:10,084 epoch 90 - iter 198/220 - loss 0.74235515 - samples/sec: 165.01 - lr: 0.000220
2020-10-27 14:24:14,666 epoch 90 - iter 220/220 - loss 0.74678889 - samples/sec: 153.75 - lr: 0.000220
2020-10-27 14:24:14,667 ----------------------------------------------------------------------------------------------------
2020-10-27 14:24:14,667 EPOCH 90 done: loss 0.7468 - lr 0.0002197
2020-10-27 14:24:17,398 DEV : loss 2.557696580886841 - score 0.8478
2020-10-27 14:24:17,488 BAD EPOCHS (no improvement): 4
2020-10-27 14:24:17,494 ----------------------------------------------------------------------------------------------------
2020-10-27 14:24:27,416 epoch 91 - iter 22/220 - loss 0.86042206 - samples/sec: 70.97 - lr: 0.000110
2020-10-27 14:24:38,922 epoch 91 - iter 44/220 - loss 0.77584162 - samples/sec: 61.20 - lr: 0.000110
2020-10-27 14:24:49,723 epoch 91 - iter 66/220 - loss 0.74210005 - samples/sec: 65.20 - lr: 0.000110
2020-10-27 14:25:01,700 epoch 91 - iter 88/220 - loss 0.73426524 - samples/sec: 58.80 - lr: 0.000110
2020-10-27 14:25:12,793 epoch 91 - iter 110/220 - loss 0.71543400 - samples/sec: 63.48 - lr: 0.000110
2020-10-27 14:25:25,045 epoch 91 - iter 132/220 - loss 0.71872560 - samples/sec: 57.48 - lr: 0.000110
2020-10-27 14:25:34,767 epoch 91 - iter 154/220 - loss 0.73297979 - samples/sec: 72.44 - lr: 0.000110
2020-10-27 14:25:39,747 epoch 91 - iter 176/220 - loss 0.73363777 - samples/sec: 141.48 - lr: 0.000110
2020-10-27 14:25:44,606 epoch 91 - iter 198/220 - loss 0.73548185 - samples/sec: 144.99 - lr: 0.000110
2020-10-27 14:25:50,236 epoch 91 - iter 220/220 - loss 0.72994632 - samples/sec: 125.13 - lr: 0.000110
2020-10-27 14:25:50,236 ----------------------------------------------------------------------------------------------------
2020-10-27 14:25:50,236 EPOCH 91 done: loss 0.7299 - lr 0.0001099
2020-10-27 14:26:00,590 DEV : loss 2.5578420162200928 - score 0.8484
2020-10-27 14:26:00,682 BAD EPOCHS (no improvement): 1
2020-10-27 14:26:00,686 ----------------------------------------------------------------------------------------------------
2020-10-27 14:26:15,596 epoch 92 - iter 22/220 - loss 0.85105419 - samples/sec: 47.23 - lr: 0.000110
2020-10-27 14:26:27,387 epoch 92 - iter 44/220 - loss 0.77365538 - samples/sec: 59.73 - lr: 0.000110
2020-10-27 14:26:34,765 epoch 92 - iter 66/220 - loss 0.77224963 - samples/sec: 95.46 - lr: 0.000110
2020-10-27 14:26:39,337 epoch 92 - iter 88/220 - loss 0.76220623 - samples/sec: 154.08 - lr: 0.000110
2020-10-27 14:26:43,884 epoch 92 - iter 110/220 - loss 0.73888238 - samples/sec: 154.98 - lr: 0.000110
2020-10-27 14:26:49,300 epoch 92 - iter 132/220 - loss 0.72626679 - samples/sec: 130.07 - lr: 0.000110
2020-10-27 14:26:54,417 epoch 92 - iter 154/220 - loss 0.73191986 - samples/sec: 137.71 - lr: 0.000110
2020-10-27 14:27:04,405 epoch 92 - iter 176/220 - loss 0.73247956 - samples/sec: 70.51 - lr: 0.000110
2020-10-27 14:27:19,083 epoch 92 - iter 198/220 - loss 0.74796851 - samples/sec: 47.98 - lr: 0.000110
2020-10-27 14:27:30,689 epoch 92 - iter 220/220 - loss 0.74481248 - samples/sec: 60.68 - lr: 0.000110
2020-10-27 14:27:30,690 ----------------------------------------------------------------------------------------------------
2020-10-27 14:27:30,690 EPOCH 92 done: loss 0.7448 - lr 0.0001099
2020-10-27 14:27:37,751 DEV : loss 2.5578646659851074 - score 0.8484
2020-10-27 14:27:37,841 BAD EPOCHS (no improvement): 2
2020-10-27 14:27:37,844 ----------------------------------------------------------------------------------------------------
2020-10-27 14:27:43,597 epoch 93 - iter 22/220 - loss 0.87659550 - samples/sec: 122.44 - lr: 0.000110
2020-10-27 14:27:47,959 epoch 93 - iter 44/220 - loss 0.76826346 - samples/sec: 161.52 - lr: 0.000110
2020-10-27 14:27:53,983 epoch 93 - iter 66/220 - loss 0.77528441 - samples/sec: 116.92 - lr: 0.000110
2020-10-27 14:27:59,155 epoch 93 - iter 88/220 - loss 0.76685278 - samples/sec: 136.20 - lr: 0.000110
2020-10-27 14:28:05,348 epoch 93 - iter 110/220 - loss 0.76660071 - samples/sec: 113.75 - lr: 0.000110
2020-10-27 14:28:14,741 epoch 93 - iter 132/220 - loss 0.77676646 - samples/sec: 74.98 - lr: 0.000110
2020-10-27 14:28:26,438 epoch 93 - iter 154/220 - loss 0.76695129 - samples/sec: 60.20 - lr: 0.000110
2020-10-27 14:28:37,915 epoch 93 - iter 176/220 - loss 0.76790132 - samples/sec: 61.36 - lr: 0.000110
2020-10-27 14:28:49,709 epoch 93 - iter 198/220 - loss 0.76019560 - samples/sec: 59.71 - lr: 0.000110
2020-10-27 14:28:54,599 epoch 93 - iter 220/220 - loss 0.75967987 - samples/sec: 144.11 - lr: 0.000110
2020-10-27 14:28:54,599 ----------------------------------------------------------------------------------------------------
2020-10-27 14:28:54,599 EPOCH 93 done: loss 0.7597 - lr 0.0001099
2020-10-27 14:28:57,346 DEV : loss 2.557996988296509 - score 0.8478
2020-10-27 14:28:57,437 BAD EPOCHS (no improvement): 3
2020-10-27 14:28:57,440 ----------------------------------------------------------------------------------------------------
2020-10-27 14:29:01,884 epoch 94 - iter 22/220 - loss 0.63816564 - samples/sec: 158.51 - lr: 0.000110
2020-10-27 14:29:06,597 epoch 94 - iter 44/220 - loss 0.70447299 - samples/sec: 149.49 - lr: 0.000110
2020-10-27 14:29:11,280 epoch 94 - iter 66/220 - loss 0.69919519 - samples/sec: 150.44 - lr: 0.000110
2020-10-27 14:29:17,657 epoch 94 - iter 88/220 - loss 0.72588973 - samples/sec: 110.46 - lr: 0.000110
2020-10-27 14:29:22,615 epoch 94 - iter 110/220 - loss 0.72368908 - samples/sec: 142.10 - lr: 0.000110
2020-10-27 14:29:28,631 epoch 94 - iter 132/220 - loss 0.71917527 - samples/sec: 117.09 - lr: 0.000110
2020-10-27 14:29:36,189 epoch 94 - iter 154/220 - loss 0.72228340 - samples/sec: 93.20 - lr: 0.000110
2020-10-27 14:29:51,721 epoch 94 - iter 176/220 - loss 0.74026461 - samples/sec: 45.34 - lr: 0.000110
2020-10-27 14:30:04,037 epoch 94 - iter 198/220 - loss 0.73771857 - samples/sec: 57.18 - lr: 0.000110
2020-10-27 14:30:12,784 epoch 94 - iter 220/220 - loss 0.72802575 - samples/sec: 80.52 - lr: 0.000110
2020-10-27 14:30:12,784 ----------------------------------------------------------------------------------------------------
2020-10-27 14:30:12,784 EPOCH 94 done: loss 0.7280 - lr 0.0001099
2020-10-27 14:30:15,520 DEV : loss 2.558229446411133 - score 0.8478
2020-10-27 14:30:15,610 BAD EPOCHS (no improvement): 4
2020-10-27 14:30:15,613 ----------------------------------------------------------------------------------------------------
2020-10-27 14:30:15,613 ----------------------------------------------------------------------------------------------------
2020-10-27 14:30:15,613 learning rate too small - quitting training!
2020-10-27 14:30:15,613 ----------------------------------------------------------------------------------------------------
2020-10-27 14:30:22,474 ----------------------------------------------------------------------------------------------------
2020-10-27 14:30:22,474 Testing using best model ...
2020-10-27 14:30:22,475 loading file /vol/fob-vol4/nebenf17/megahedm/PycharmProjects/thesis/standalone_scripts/resources/taggersg10/multi-ner-aqmar-aner-consistent0.22499999999999998/best-model.pt
2020-10-27 14:30:33,955 0.8820	0.8518	0.8666
2020-10-27 14:30:33,955 
Results:
- F1-score (micro) 0.8666
- F1-score (macro) 0.8488

By class:
LOC        tp: 539 - fp: 51 - fn: 68 - precision: 0.9136 - recall: 0.8880 - f1-score: 0.9006
MISC       tp: 408 - fp: 57 - fn: 89 - precision: 0.8774 - recall: 0.8209 - f1-score: 0.8482
ORG        tp: 167 - fp: 43 - fn: 64 - precision: 0.7952 - recall: 0.7229 - f1-score: 0.7574
PER        tp: 501 - fp: 65 - fn: 60 - precision: 0.8852 - recall: 0.8930 - f1-score: 0.8891
2020-10-27 14:30:33,955 ----------------------------------------------------------------------------------------------------
2020-10-27 14:30:33,955 ----------------------------------------------------------------------------------------------------
2020-10-27 14:30:37,044 ----------------------------------------------------------------------------------------------------