2023-10-13 15:16:58,271 ----------------------------------------------------------------------------------------------------
2023-10-13 15:16:58,272 Model: "SequenceTagger(
  (embeddings): TransformerWordEmbeddings(
    (model): BertModel(
      (embeddings): BertEmbeddings(
        (word_embeddings): Embedding(32001, 768)
        (position_embeddings): Embedding(512, 768)
        (token_type_embeddings): Embedding(2, 768)
        (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)
        (dropout): Dropout(p=0.1, inplace=False)
      )
      (encoder): BertEncoder(
        (layer): ModuleList(
          (0-11): 12 x BertLayer(
            (attention): BertAttention(
              (self): BertSelfAttention(
                (query): Linear(in_features=768, out_features=768, bias=True)
                (key): Linear(in_features=768, out_features=768, bias=True)
                (value): Linear(in_features=768, out_features=768, bias=True)
                (dropout): Dropout(p=0.1, inplace=False)
              )
              (output): BertSelfOutput(
                (dense): Linear(in_features=768, out_features=768, bias=True)
                (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)
                (dropout): Dropout(p=0.1, inplace=False)
              )
            )
            (intermediate): BertIntermediate(
              (dense): Linear(in_features=768, out_features=3072, bias=True)
              (intermediate_act_fn): GELUActivation()
            )
            (output): BertOutput(
              (dense): Linear(in_features=3072, out_features=768, bias=True)
              (LayerNorm): LayerNorm((768,), eps=1e-12, elementwise_affine=True)
              (dropout): Dropout(p=0.1, inplace=False)
            )
          )
        )
      )
      (pooler): BertPooler(
        (dense): Linear(in_features=768, out_features=768, bias=True)
        (activation): Tanh()
      )
    )
  )
  (locked_dropout): LockedDropout(p=0.5)
  (linear): Linear(in_features=768, out_features=21, bias=True)
  (loss_function): CrossEntropyLoss()
)"
2023-10-13 15:16:58,272 ----------------------------------------------------------------------------------------------------
2023-10-13 15:16:58,272 MultiCorpus: 5901 train + 1287 dev + 1505 test sentences
 - NER_HIPE_2022 Corpus: 5901 train + 1287 dev + 1505 test sentences - /root/.flair/datasets/ner_hipe_2022/v2.1/hipe2020/fr/with_doc_seperator
2023-10-13 15:16:58,272 ----------------------------------------------------------------------------------------------------
2023-10-13 15:16:58,272 Train:  5901 sentences
2023-10-13 15:16:58,272         (train_with_dev=False, train_with_test=False)
2023-10-13 15:16:58,272 ----------------------------------------------------------------------------------------------------
2023-10-13 15:16:58,272 Training Params:
2023-10-13 15:16:58,272  - learning_rate: "5e-05" 
2023-10-13 15:16:58,272  - mini_batch_size: "8"
2023-10-13 15:16:58,272  - max_epochs: "10"
2023-10-13 15:16:58,272  - shuffle: "True"
2023-10-13 15:16:58,272 ----------------------------------------------------------------------------------------------------
2023-10-13 15:16:58,272 Plugins:
2023-10-13 15:16:58,272  - LinearScheduler | warmup_fraction: '0.1'
2023-10-13 15:16:58,272 ----------------------------------------------------------------------------------------------------
2023-10-13 15:16:58,273 Final evaluation on model from best epoch (best-model.pt)
2023-10-13 15:16:58,273  - metric: "('micro avg', 'f1-score')"
2023-10-13 15:16:58,273 ----------------------------------------------------------------------------------------------------
2023-10-13 15:16:58,273 Computation:
2023-10-13 15:16:58,273  - compute on device: cuda:0
2023-10-13 15:16:58,273  - embedding storage: none
2023-10-13 15:16:58,273 ----------------------------------------------------------------------------------------------------
2023-10-13 15:16:58,273 Model training base path: "hmbench-hipe2020/fr-dbmdz/bert-base-historic-multilingual-cased-bs8-wsFalse-e10-lr5e-05-poolingfirst-layers-1-crfFalse-1"
2023-10-13 15:16:58,273 ----------------------------------------------------------------------------------------------------
2023-10-13 15:16:58,273 ----------------------------------------------------------------------------------------------------
2023-10-13 15:17:03,084 epoch 1 - iter 73/738 - loss 2.74602808 - time (sec): 4.81 - samples/sec: 3466.71 - lr: 0.000005 - momentum: 0.000000
2023-10-13 15:17:07,826 epoch 1 - iter 146/738 - loss 1.71361771 - time (sec): 9.55 - samples/sec: 3449.67 - lr: 0.000010 - momentum: 0.000000
2023-10-13 15:17:13,391 epoch 1 - iter 219/738 - loss 1.24565664 - time (sec): 15.12 - samples/sec: 3430.28 - lr: 0.000015 - momentum: 0.000000
2023-10-13 15:17:17,821 epoch 1 - iter 292/738 - loss 1.03626899 - time (sec): 19.55 - samples/sec: 3433.30 - lr: 0.000020 - momentum: 0.000000
2023-10-13 15:17:22,517 epoch 1 - iter 365/738 - loss 0.89538384 - time (sec): 24.24 - samples/sec: 3426.05 - lr: 0.000025 - momentum: 0.000000
2023-10-13 15:17:27,166 epoch 1 - iter 438/738 - loss 0.79251444 - time (sec): 28.89 - samples/sec: 3409.99 - lr: 0.000030 - momentum: 0.000000
2023-10-13 15:17:31,550 epoch 1 - iter 511/738 - loss 0.71725793 - time (sec): 33.28 - samples/sec: 3417.41 - lr: 0.000035 - momentum: 0.000000
2023-10-13 15:17:36,209 epoch 1 - iter 584/738 - loss 0.65519603 - time (sec): 37.94 - samples/sec: 3398.73 - lr: 0.000039 - momentum: 0.000000
2023-10-13 15:17:41,869 epoch 1 - iter 657/738 - loss 0.59427688 - time (sec): 43.60 - samples/sec: 3399.96 - lr: 0.000044 - momentum: 0.000000
2023-10-13 15:17:46,971 epoch 1 - iter 730/738 - loss 0.55319814 - time (sec): 48.70 - samples/sec: 3385.84 - lr: 0.000049 - momentum: 0.000000
2023-10-13 15:17:47,413 ----------------------------------------------------------------------------------------------------
2023-10-13 15:17:47,413 EPOCH 1 done: loss 0.5489 - lr: 0.000049
2023-10-13 15:17:53,443 DEV : loss 0.14253994822502136 - f1-score (micro avg)  0.7035
2023-10-13 15:17:53,476 saving best model
2023-10-13 15:17:53,841 ----------------------------------------------------------------------------------------------------
2023-10-13 15:17:58,952 epoch 2 - iter 73/738 - loss 0.15502447 - time (sec): 5.11 - samples/sec: 3311.80 - lr: 0.000049 - momentum: 0.000000
2023-10-13 15:18:03,246 epoch 2 - iter 146/738 - loss 0.14085048 - time (sec): 9.40 - samples/sec: 3306.19 - lr: 0.000049 - momentum: 0.000000
2023-10-13 15:18:08,012 epoch 2 - iter 219/738 - loss 0.13869781 - time (sec): 14.17 - samples/sec: 3275.65 - lr: 0.000048 - momentum: 0.000000
2023-10-13 15:18:12,900 epoch 2 - iter 292/738 - loss 0.13704243 - time (sec): 19.06 - samples/sec: 3288.19 - lr: 0.000048 - momentum: 0.000000
2023-10-13 15:18:17,212 epoch 2 - iter 365/738 - loss 0.13342204 - time (sec): 23.37 - samples/sec: 3336.73 - lr: 0.000047 - momentum: 0.000000
2023-10-13 15:18:23,427 epoch 2 - iter 438/738 - loss 0.13259264 - time (sec): 29.58 - samples/sec: 3372.56 - lr: 0.000047 - momentum: 0.000000
2023-10-13 15:18:28,287 epoch 2 - iter 511/738 - loss 0.13044756 - time (sec): 34.44 - samples/sec: 3369.54 - lr: 0.000046 - momentum: 0.000000
2023-10-13 15:18:33,290 epoch 2 - iter 584/738 - loss 0.12937219 - time (sec): 39.45 - samples/sec: 3358.12 - lr: 0.000046 - momentum: 0.000000
2023-10-13 15:18:38,093 epoch 2 - iter 657/738 - loss 0.12659105 - time (sec): 44.25 - samples/sec: 3367.71 - lr: 0.000045 - momentum: 0.000000
2023-10-13 15:18:42,598 epoch 2 - iter 730/738 - loss 0.12317234 - time (sec): 48.76 - samples/sec: 3378.72 - lr: 0.000045 - momentum: 0.000000
2023-10-13 15:18:43,094 ----------------------------------------------------------------------------------------------------
2023-10-13 15:18:43,095 EPOCH 2 done: loss 0.1229 - lr: 0.000045
2023-10-13 15:18:54,371 DEV : loss 0.11215972900390625 - f1-score (micro avg)  0.7691
2023-10-13 15:18:54,406 saving best model
2023-10-13 15:18:54,884 ----------------------------------------------------------------------------------------------------
2023-10-13 15:18:59,693 epoch 3 - iter 73/738 - loss 0.07421766 - time (sec): 4.81 - samples/sec: 3162.11 - lr: 0.000044 - momentum: 0.000000
2023-10-13 15:19:04,307 epoch 3 - iter 146/738 - loss 0.06446355 - time (sec): 9.42 - samples/sec: 3312.82 - lr: 0.000043 - momentum: 0.000000
2023-10-13 15:19:09,071 epoch 3 - iter 219/738 - loss 0.07063195 - time (sec): 14.18 - samples/sec: 3406.91 - lr: 0.000043 - momentum: 0.000000
2023-10-13 15:19:14,191 epoch 3 - iter 292/738 - loss 0.07392124 - time (sec): 19.30 - samples/sec: 3389.06 - lr: 0.000042 - momentum: 0.000000
2023-10-13 15:19:19,271 epoch 3 - iter 365/738 - loss 0.07638465 - time (sec): 24.38 - samples/sec: 3400.77 - lr: 0.000042 - momentum: 0.000000
2023-10-13 15:19:23,948 epoch 3 - iter 438/738 - loss 0.07585899 - time (sec): 29.06 - samples/sec: 3367.56 - lr: 0.000041 - momentum: 0.000000
2023-10-13 15:19:29,191 epoch 3 - iter 511/738 - loss 0.07494694 - time (sec): 34.30 - samples/sec: 3332.95 - lr: 0.000041 - momentum: 0.000000
2023-10-13 15:19:34,643 epoch 3 - iter 584/738 - loss 0.07368203 - time (sec): 39.76 - samples/sec: 3303.06 - lr: 0.000040 - momentum: 0.000000
2023-10-13 15:19:39,452 epoch 3 - iter 657/738 - loss 0.07370863 - time (sec): 44.57 - samples/sec: 3315.19 - lr: 0.000040 - momentum: 0.000000
2023-10-13 15:19:44,937 epoch 3 - iter 730/738 - loss 0.07293039 - time (sec): 50.05 - samples/sec: 3293.55 - lr: 0.000039 - momentum: 0.000000
2023-10-13 15:19:45,384 ----------------------------------------------------------------------------------------------------
2023-10-13 15:19:45,385 EPOCH 3 done: loss 0.0725 - lr: 0.000039
2023-10-13 15:19:56,548 DEV : loss 0.12536022067070007 - f1-score (micro avg)  0.7764
2023-10-13 15:19:56,576 saving best model
2023-10-13 15:19:57,053 ----------------------------------------------------------------------------------------------------
2023-10-13 15:20:01,765 epoch 4 - iter 73/738 - loss 0.04276265 - time (sec): 4.70 - samples/sec: 3350.13 - lr: 0.000038 - momentum: 0.000000
2023-10-13 15:20:06,911 epoch 4 - iter 146/738 - loss 0.05179007 - time (sec): 9.85 - samples/sec: 3393.82 - lr: 0.000038 - momentum: 0.000000
2023-10-13 15:20:12,365 epoch 4 - iter 219/738 - loss 0.04965902 - time (sec): 15.30 - samples/sec: 3402.43 - lr: 0.000037 - momentum: 0.000000
2023-10-13 15:20:17,046 epoch 4 - iter 292/738 - loss 0.04941122 - time (sec): 19.98 - samples/sec: 3373.66 - lr: 0.000037 - momentum: 0.000000
2023-10-13 15:20:21,696 epoch 4 - iter 365/738 - loss 0.04819576 - time (sec): 24.63 - samples/sec: 3367.59 - lr: 0.000036 - momentum: 0.000000
2023-10-13 15:20:26,064 epoch 4 - iter 438/738 - loss 0.04826942 - time (sec): 29.00 - samples/sec: 3362.01 - lr: 0.000036 - momentum: 0.000000
2023-10-13 15:20:31,211 epoch 4 - iter 511/738 - loss 0.04765206 - time (sec): 34.15 - samples/sec: 3370.67 - lr: 0.000035 - momentum: 0.000000
2023-10-13 15:20:35,872 epoch 4 - iter 584/738 - loss 0.04844213 - time (sec): 38.81 - samples/sec: 3360.11 - lr: 0.000035 - momentum: 0.000000
2023-10-13 15:20:41,280 epoch 4 - iter 657/738 - loss 0.04959664 - time (sec): 44.22 - samples/sec: 3353.98 - lr: 0.000034 - momentum: 0.000000
2023-10-13 15:20:46,071 epoch 4 - iter 730/738 - loss 0.04971863 - time (sec): 49.01 - samples/sec: 3365.56 - lr: 0.000033 - momentum: 0.000000
2023-10-13 15:20:46,528 ----------------------------------------------------------------------------------------------------
2023-10-13 15:20:46,528 EPOCH 4 done: loss 0.0497 - lr: 0.000033
2023-10-13 15:20:57,722 DEV : loss 0.1647169589996338 - f1-score (micro avg)  0.8109
2023-10-13 15:20:57,752 saving best model
2023-10-13 15:20:58,245 ----------------------------------------------------------------------------------------------------
2023-10-13 15:21:02,849 epoch 5 - iter 73/738 - loss 0.03178351 - time (sec): 4.59 - samples/sec: 3344.00 - lr: 0.000033 - momentum: 0.000000
2023-10-13 15:21:07,618 epoch 5 - iter 146/738 - loss 0.03011420 - time (sec): 9.36 - samples/sec: 3338.50 - lr: 0.000032 - momentum: 0.000000
2023-10-13 15:21:12,677 epoch 5 - iter 219/738 - loss 0.03759577 - time (sec): 14.42 - samples/sec: 3368.79 - lr: 0.000032 - momentum: 0.000000
2023-10-13 15:21:17,375 epoch 5 - iter 292/738 - loss 0.03522125 - time (sec): 19.12 - samples/sec: 3345.28 - lr: 0.000031 - momentum: 0.000000
2023-10-13 15:21:22,615 epoch 5 - iter 365/738 - loss 0.03386361 - time (sec): 24.36 - samples/sec: 3343.37 - lr: 0.000031 - momentum: 0.000000
2023-10-13 15:21:27,708 epoch 5 - iter 438/738 - loss 0.03481830 - time (sec): 29.45 - samples/sec: 3340.69 - lr: 0.000030 - momentum: 0.000000
2023-10-13 15:21:32,309 epoch 5 - iter 511/738 - loss 0.03493902 - time (sec): 34.05 - samples/sec: 3343.79 - lr: 0.000030 - momentum: 0.000000
2023-10-13 15:21:37,167 epoch 5 - iter 584/738 - loss 0.03490208 - time (sec): 38.91 - samples/sec: 3339.05 - lr: 0.000029 - momentum: 0.000000
2023-10-13 15:21:42,940 epoch 5 - iter 657/738 - loss 0.03505144 - time (sec): 44.68 - samples/sec: 3320.83 - lr: 0.000028 - momentum: 0.000000
2023-10-13 15:21:47,947 epoch 5 - iter 730/738 - loss 0.03538729 - time (sec): 49.69 - samples/sec: 3320.50 - lr: 0.000028 - momentum: 0.000000
2023-10-13 15:21:48,393 ----------------------------------------------------------------------------------------------------
2023-10-13 15:21:48,393 EPOCH 5 done: loss 0.0353 - lr: 0.000028
2023-10-13 15:21:59,731 DEV : loss 0.16715505719184875 - f1-score (micro avg)  0.8129
2023-10-13 15:21:59,762 saving best model
2023-10-13 15:22:00,272 ----------------------------------------------------------------------------------------------------
2023-10-13 15:22:05,043 epoch 6 - iter 73/738 - loss 0.03487724 - time (sec): 4.76 - samples/sec: 3137.17 - lr: 0.000027 - momentum: 0.000000
2023-10-13 15:22:09,824 epoch 6 - iter 146/738 - loss 0.02962974 - time (sec): 9.54 - samples/sec: 3178.81 - lr: 0.000027 - momentum: 0.000000
2023-10-13 15:22:15,490 epoch 6 - iter 219/738 - loss 0.02757779 - time (sec): 15.21 - samples/sec: 3232.17 - lr: 0.000026 - momentum: 0.000000
2023-10-13 15:22:20,455 epoch 6 - iter 292/738 - loss 0.02874868 - time (sec): 20.17 - samples/sec: 3225.44 - lr: 0.000026 - momentum: 0.000000
2023-10-13 15:22:25,165 epoch 6 - iter 365/738 - loss 0.02763650 - time (sec): 24.88 - samples/sec: 3254.83 - lr: 0.000025 - momentum: 0.000000
2023-10-13 15:22:30,551 epoch 6 - iter 438/738 - loss 0.02686535 - time (sec): 30.27 - samples/sec: 3271.81 - lr: 0.000025 - momentum: 0.000000
2023-10-13 15:22:35,096 epoch 6 - iter 511/738 - loss 0.02587544 - time (sec): 34.82 - samples/sec: 3279.27 - lr: 0.000024 - momentum: 0.000000
2023-10-13 15:22:39,857 epoch 6 - iter 584/738 - loss 0.02553302 - time (sec): 39.58 - samples/sec: 3288.34 - lr: 0.000023 - momentum: 0.000000
2023-10-13 15:22:45,402 epoch 6 - iter 657/738 - loss 0.02568474 - time (sec): 45.12 - samples/sec: 3304.11 - lr: 0.000023 - momentum: 0.000000
2023-10-13 15:22:50,134 epoch 6 - iter 730/738 - loss 0.02547133 - time (sec): 49.85 - samples/sec: 3306.39 - lr: 0.000022 - momentum: 0.000000
2023-10-13 15:22:50,602 ----------------------------------------------------------------------------------------------------
2023-10-13 15:22:50,602 EPOCH 6 done: loss 0.0254 - lr: 0.000022
2023-10-13 15:23:03,139 DEV : loss 0.19820576906204224 - f1-score (micro avg)  0.8153
2023-10-13 15:23:03,177 saving best model
2023-10-13 15:23:03,721 ----------------------------------------------------------------------------------------------------
2023-10-13 15:23:08,470 epoch 7 - iter 73/738 - loss 0.01207347 - time (sec): 4.75 - samples/sec: 3203.00 - lr: 0.000022 - momentum: 0.000000
2023-10-13 15:23:14,759 epoch 7 - iter 146/738 - loss 0.01791847 - time (sec): 11.04 - samples/sec: 3047.72 - lr: 0.000021 - momentum: 0.000000
2023-10-13 15:23:19,307 epoch 7 - iter 219/738 - loss 0.01769644 - time (sec): 15.58 - samples/sec: 3125.38 - lr: 0.000021 - momentum: 0.000000
2023-10-13 15:23:24,645 epoch 7 - iter 292/738 - loss 0.01842221 - time (sec): 20.92 - samples/sec: 3096.35 - lr: 0.000020 - momentum: 0.000000
2023-10-13 15:23:29,789 epoch 7 - iter 365/738 - loss 0.01783206 - time (sec): 26.07 - samples/sec: 3137.84 - lr: 0.000020 - momentum: 0.000000
2023-10-13 15:23:34,922 epoch 7 - iter 438/738 - loss 0.01767386 - time (sec): 31.20 - samples/sec: 3200.09 - lr: 0.000019 - momentum: 0.000000
2023-10-13 15:23:40,128 epoch 7 - iter 511/738 - loss 0.01695655 - time (sec): 36.40 - samples/sec: 3224.08 - lr: 0.000018 - momentum: 0.000000
2023-10-13 15:23:45,371 epoch 7 - iter 584/738 - loss 0.01651792 - time (sec): 41.65 - samples/sec: 3222.34 - lr: 0.000018 - momentum: 0.000000
2023-10-13 15:23:49,934 epoch 7 - iter 657/738 - loss 0.01655195 - time (sec): 46.21 - samples/sec: 3223.49 - lr: 0.000017 - momentum: 0.000000
2023-10-13 15:23:54,626 epoch 7 - iter 730/738 - loss 0.01607427 - time (sec): 50.90 - samples/sec: 3232.49 - lr: 0.000017 - momentum: 0.000000
2023-10-13 15:23:55,106 ----------------------------------------------------------------------------------------------------
2023-10-13 15:23:55,106 EPOCH 7 done: loss 0.0162 - lr: 0.000017
2023-10-13 15:24:06,529 DEV : loss 0.20719152688980103 - f1-score (micro avg)  0.8166
2023-10-13 15:24:06,573 saving best model
2023-10-13 15:24:07,354 ----------------------------------------------------------------------------------------------------
2023-10-13 15:24:12,377 epoch 8 - iter 73/738 - loss 0.00864185 - time (sec): 5.02 - samples/sec: 3218.84 - lr: 0.000016 - momentum: 0.000000
2023-10-13 15:24:17,396 epoch 8 - iter 146/738 - loss 0.01007836 - time (sec): 10.04 - samples/sec: 3180.73 - lr: 0.000016 - momentum: 0.000000
2023-10-13 15:24:22,749 epoch 8 - iter 219/738 - loss 0.01079097 - time (sec): 15.39 - samples/sec: 3223.12 - lr: 0.000015 - momentum: 0.000000
2023-10-13 15:24:27,812 epoch 8 - iter 292/738 - loss 0.01209528 - time (sec): 20.46 - samples/sec: 3195.75 - lr: 0.000015 - momentum: 0.000000
2023-10-13 15:24:32,510 epoch 8 - iter 365/738 - loss 0.01368334 - time (sec): 25.15 - samples/sec: 3219.63 - lr: 0.000014 - momentum: 0.000000
2023-10-13 15:24:37,678 epoch 8 - iter 438/738 - loss 0.01409645 - time (sec): 30.32 - samples/sec: 3206.98 - lr: 0.000013 - momentum: 0.000000
2023-10-13 15:24:42,309 epoch 8 - iter 511/738 - loss 0.01413601 - time (sec): 34.95 - samples/sec: 3220.08 - lr: 0.000013 - momentum: 0.000000
2023-10-13 15:24:47,889 epoch 8 - iter 584/738 - loss 0.01464820 - time (sec): 40.53 - samples/sec: 3230.23 - lr: 0.000012 - momentum: 0.000000
2023-10-13 15:24:52,581 epoch 8 - iter 657/738 - loss 0.01388140 - time (sec): 45.22 - samples/sec: 3247.02 - lr: 0.000012 - momentum: 0.000000
2023-10-13 15:24:57,881 epoch 8 - iter 730/738 - loss 0.01314649 - time (sec): 50.52 - samples/sec: 3263.37 - lr: 0.000011 - momentum: 0.000000
2023-10-13 15:24:58,335 ----------------------------------------------------------------------------------------------------
2023-10-13 15:24:58,335 EPOCH 8 done: loss 0.0131 - lr: 0.000011
2023-10-13 15:25:09,552 DEV : loss 0.22207467257976532 - f1-score (micro avg)  0.8239
2023-10-13 15:25:09,587 saving best model
2023-10-13 15:25:10,122 ----------------------------------------------------------------------------------------------------
2023-10-13 15:25:15,072 epoch 9 - iter 73/738 - loss 0.00622634 - time (sec): 4.95 - samples/sec: 3500.95 - lr: 0.000011 - momentum: 0.000000
2023-10-13 15:25:19,870 epoch 9 - iter 146/738 - loss 0.00678073 - time (sec): 9.75 - samples/sec: 3451.45 - lr: 0.000010 - momentum: 0.000000
2023-10-13 15:25:24,740 epoch 9 - iter 219/738 - loss 0.00883955 - time (sec): 14.62 - samples/sec: 3378.38 - lr: 0.000010 - momentum: 0.000000
2023-10-13 15:25:29,740 epoch 9 - iter 292/738 - loss 0.00808768 - time (sec): 19.62 - samples/sec: 3336.72 - lr: 0.000009 - momentum: 0.000000
2023-10-13 15:25:34,678 epoch 9 - iter 365/738 - loss 0.00752856 - time (sec): 24.55 - samples/sec: 3321.98 - lr: 0.000008 - momentum: 0.000000
2023-10-13 15:25:39,270 epoch 9 - iter 438/738 - loss 0.00836252 - time (sec): 29.15 - samples/sec: 3326.86 - lr: 0.000008 - momentum: 0.000000
2023-10-13 15:25:44,160 epoch 9 - iter 511/738 - loss 0.00810242 - time (sec): 34.04 - samples/sec: 3354.34 - lr: 0.000007 - momentum: 0.000000
2023-10-13 15:25:49,564 epoch 9 - iter 584/738 - loss 0.00765179 - time (sec): 39.44 - samples/sec: 3330.39 - lr: 0.000007 - momentum: 0.000000
2023-10-13 15:25:54,489 epoch 9 - iter 657/738 - loss 0.00751168 - time (sec): 44.36 - samples/sec: 3334.19 - lr: 0.000006 - momentum: 0.000000
2023-10-13 15:25:59,344 epoch 9 - iter 730/738 - loss 0.00780373 - time (sec): 49.22 - samples/sec: 3338.80 - lr: 0.000006 - momentum: 0.000000
2023-10-13 15:25:59,980 ----------------------------------------------------------------------------------------------------
2023-10-13 15:25:59,980 EPOCH 9 done: loss 0.0077 - lr: 0.000006
2023-10-13 15:26:11,819 DEV : loss 0.215680792927742 - f1-score (micro avg)  0.8301
2023-10-13 15:26:11,859 saving best model
2023-10-13 15:26:12,442 ----------------------------------------------------------------------------------------------------
2023-10-13 15:26:17,570 epoch 10 - iter 73/738 - loss 0.00455941 - time (sec): 5.12 - samples/sec: 3146.40 - lr: 0.000005 - momentum: 0.000000
2023-10-13 15:26:23,698 epoch 10 - iter 146/738 - loss 0.00464036 - time (sec): 11.25 - samples/sec: 3147.77 - lr: 0.000004 - momentum: 0.000000
2023-10-13 15:26:28,944 epoch 10 - iter 219/738 - loss 0.00476684 - time (sec): 16.50 - samples/sec: 3115.40 - lr: 0.000004 - momentum: 0.000000
2023-10-13 15:26:33,584 epoch 10 - iter 292/738 - loss 0.00428671 - time (sec): 21.14 - samples/sec: 3160.08 - lr: 0.000003 - momentum: 0.000000
2023-10-13 15:26:38,315 epoch 10 - iter 365/738 - loss 0.00478654 - time (sec): 25.87 - samples/sec: 3178.75 - lr: 0.000003 - momentum: 0.000000
2023-10-13 15:26:43,078 epoch 10 - iter 438/738 - loss 0.00517556 - time (sec): 30.63 - samples/sec: 3179.66 - lr: 0.000002 - momentum: 0.000000
2023-10-13 15:26:48,428 epoch 10 - iter 511/738 - loss 0.00501566 - time (sec): 35.98 - samples/sec: 3193.01 - lr: 0.000002 - momentum: 0.000000
2023-10-13 15:26:54,233 epoch 10 - iter 584/738 - loss 0.00534061 - time (sec): 41.79 - samples/sec: 3134.82 - lr: 0.000001 - momentum: 0.000000
2023-10-13 15:26:59,099 epoch 10 - iter 657/738 - loss 0.00508094 - time (sec): 46.65 - samples/sec: 3150.16 - lr: 0.000001 - momentum: 0.000000
2023-10-13 15:27:04,541 epoch 10 - iter 730/738 - loss 0.00505925 - time (sec): 52.10 - samples/sec: 3167.31 - lr: 0.000000 - momentum: 0.000000
2023-10-13 15:27:04,973 ----------------------------------------------------------------------------------------------------
2023-10-13 15:27:04,974 EPOCH 10 done: loss 0.0050 - lr: 0.000000
2023-10-13 15:27:16,194 DEV : loss 0.22398900985717773 - f1-score (micro avg)  0.8267
2023-10-13 15:27:16,617 ----------------------------------------------------------------------------------------------------
2023-10-13 15:27:16,619 Loading model from best epoch ...
2023-10-13 15:27:18,212 SequenceTagger predicts: Dictionary with 21 tags: O, S-loc, B-loc, E-loc, I-loc, S-pers, B-pers, E-pers, I-pers, S-org, B-org, E-org, I-org, S-time, B-time, E-time, I-time, S-prod, B-prod, E-prod, I-prod
2023-10-13 15:27:24,197 
Results:
- F-score (micro) 0.7931
- F-score (macro) 0.6926
- Accuracy 0.6833

By class:
              precision    recall  f1-score   support

         loc     0.8555    0.8765    0.8659       858
        pers     0.7491    0.8007    0.7741       537
         org     0.5294    0.6136    0.5684       132
        time     0.4789    0.6296    0.5440        54
        prod     0.7167    0.7049    0.7107        61

   micro avg     0.7714    0.8161    0.7931      1642
   macro avg     0.6659    0.7251    0.6926      1642
weighted avg     0.7770    0.8161    0.7956      1642

2023-10-13 15:27:24,197 ----------------------------------------------------------------------------------------------------