| 2023-10-11 14:05:30,951 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 14:05:30,953 Model: "SequenceTagger( | |
| (embeddings): ByT5Embeddings( | |
| (model): T5EncoderModel( | |
| (shared): Embedding(384, 1472) | |
| (encoder): T5Stack( | |
| (embed_tokens): Embedding(384, 1472) | |
| (block): ModuleList( | |
| (0): T5Block( | |
| (layer): ModuleList( | |
| (0): T5LayerSelfAttention( | |
| (SelfAttention): T5Attention( | |
| (q): Linear(in_features=1472, out_features=384, bias=False) | |
| (k): Linear(in_features=1472, out_features=384, bias=False) | |
| (v): Linear(in_features=1472, out_features=384, bias=False) | |
| (o): Linear(in_features=384, out_features=1472, bias=False) | |
| (relative_attention_bias): Embedding(32, 6) | |
| ) | |
| (layer_norm): FusedRMSNorm(torch.Size([1472]), eps=1e-06, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| (1): T5LayerFF( | |
| (DenseReluDense): T5DenseGatedActDense( | |
| (wi_0): Linear(in_features=1472, out_features=3584, bias=False) | |
| (wi_1): Linear(in_features=1472, out_features=3584, bias=False) | |
| (wo): Linear(in_features=3584, out_features=1472, bias=False) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| (act): NewGELUActivation() | |
| ) | |
| (layer_norm): FusedRMSNorm(torch.Size([1472]), eps=1e-06, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| ) | |
| (1-11): 11 x T5Block( | |
| (layer): ModuleList( | |
| (0): T5LayerSelfAttention( | |
| (SelfAttention): T5Attention( | |
| (q): Linear(in_features=1472, out_features=384, bias=False) | |
| (k): Linear(in_features=1472, out_features=384, bias=False) | |
| (v): Linear(in_features=1472, out_features=384, bias=False) | |
| (o): Linear(in_features=384, out_features=1472, bias=False) | |
| ) | |
| (layer_norm): FusedRMSNorm(torch.Size([1472]), eps=1e-06, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| (1): T5LayerFF( | |
| (DenseReluDense): T5DenseGatedActDense( | |
| (wi_0): Linear(in_features=1472, out_features=3584, bias=False) | |
| (wi_1): Linear(in_features=1472, out_features=3584, bias=False) | |
| (wo): Linear(in_features=3584, out_features=1472, bias=False) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| (act): NewGELUActivation() | |
| ) | |
| (layer_norm): FusedRMSNorm(torch.Size([1472]), eps=1e-06, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| ) | |
| ) | |
| (final_layer_norm): FusedRMSNorm(torch.Size([1472]), eps=1e-06, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| ) | |
| (locked_dropout): LockedDropout(p=0.5) | |
| (linear): Linear(in_features=1472, out_features=13, bias=True) | |
| (loss_function): CrossEntropyLoss() | |
| )" | |
| 2023-10-11 14:05:30,953 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 14:05:30,954 MultiCorpus: 5777 train + 722 dev + 723 test sentences | |
| - NER_ICDAR_EUROPEANA Corpus: 5777 train + 722 dev + 723 test sentences - /root/.flair/datasets/ner_icdar_europeana/nl | |
| 2023-10-11 14:05:30,954 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 14:05:30,954 Train: 5777 sentences | |
| 2023-10-11 14:05:30,954 (train_with_dev=False, train_with_test=False) | |
| 2023-10-11 14:05:30,954 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 14:05:30,954 Training Params: | |
| 2023-10-11 14:05:30,954 - learning_rate: "0.00015" | |
| 2023-10-11 14:05:30,954 - mini_batch_size: "8" | |
| 2023-10-11 14:05:30,954 - max_epochs: "10" | |
| 2023-10-11 14:05:30,954 - shuffle: "True" | |
| 2023-10-11 14:05:30,954 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 14:05:30,954 Plugins: | |
| 2023-10-11 14:05:30,954 - TensorboardLogger | |
| 2023-10-11 14:05:30,954 - LinearScheduler | warmup_fraction: '0.1' | |
| 2023-10-11 14:05:30,955 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 14:05:30,955 Final evaluation on model from best epoch (best-model.pt) | |
| 2023-10-11 14:05:30,955 - metric: "('micro avg', 'f1-score')" | |
| 2023-10-11 14:05:30,955 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 14:05:30,955 Computation: | |
| 2023-10-11 14:05:30,955 - compute on device: cuda:0 | |
| 2023-10-11 14:05:30,955 - embedding storage: none | |
| 2023-10-11 14:05:30,955 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 14:05:30,955 Model training base path: "hmbench-icdar/nl-hmbyt5-preliminary/byt5-small-historic-multilingual-span20-flax-bs8-wsFalse-e10-lr0.00015-poolingfirst-layers-1-crfFalse-1" | |
| 2023-10-11 14:05:30,955 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 14:05:30,955 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 14:05:30,956 Logging anything other than scalars to TensorBoard is currently not supported. | |
| 2023-10-11 14:06:12,814 epoch 1 - iter 72/723 - loss 2.58705621 - time (sec): 41.86 - samples/sec: 420.87 - lr: 0.000015 - momentum: 0.000000 | |
| 2023-10-11 14:06:55,356 epoch 1 - iter 144/723 - loss 2.55125919 - time (sec): 84.40 - samples/sec: 440.37 - lr: 0.000030 - momentum: 0.000000 | |
| 2023-10-11 14:07:32,736 epoch 1 - iter 216/723 - loss 2.42208641 - time (sec): 121.78 - samples/sec: 439.68 - lr: 0.000045 - momentum: 0.000000 | |
| 2023-10-11 14:08:11,674 epoch 1 - iter 288/723 - loss 2.21128263 - time (sec): 160.72 - samples/sec: 445.55 - lr: 0.000060 - momentum: 0.000000 | |
| 2023-10-11 14:08:52,057 epoch 1 - iter 360/723 - loss 1.96849538 - time (sec): 201.10 - samples/sec: 453.32 - lr: 0.000074 - momentum: 0.000000 | |
| 2023-10-11 14:09:30,023 epoch 1 - iter 432/723 - loss 1.75669262 - time (sec): 239.07 - samples/sec: 452.37 - lr: 0.000089 - momentum: 0.000000 | |
| 2023-10-11 14:10:08,540 epoch 1 - iter 504/723 - loss 1.56586690 - time (sec): 277.58 - samples/sec: 452.47 - lr: 0.000104 - momentum: 0.000000 | |
| 2023-10-11 14:10:46,586 epoch 1 - iter 576/723 - loss 1.41230121 - time (sec): 315.63 - samples/sec: 451.25 - lr: 0.000119 - momentum: 0.000000 | |
| 2023-10-11 14:11:23,583 epoch 1 - iter 648/723 - loss 1.29317716 - time (sec): 352.63 - samples/sec: 448.46 - lr: 0.000134 - momentum: 0.000000 | |
| 2023-10-11 14:12:02,646 epoch 1 - iter 720/723 - loss 1.18252757 - time (sec): 391.69 - samples/sec: 448.88 - lr: 0.000149 - momentum: 0.000000 | |
| 2023-10-11 14:12:03,721 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 14:12:03,721 EPOCH 1 done: loss 1.1808 - lr: 0.000149 | |
| 2023-10-11 14:12:23,449 DEV : loss 0.2481938898563385 - f1-score (micro avg) 0.0 | |
| 2023-10-11 14:12:23,483 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 14:13:02,418 epoch 2 - iter 72/723 - loss 0.19665532 - time (sec): 38.93 - samples/sec: 463.18 - lr: 0.000148 - momentum: 0.000000 | |
| 2023-10-11 14:13:43,718 epoch 2 - iter 144/723 - loss 0.17259289 - time (sec): 80.23 - samples/sec: 442.69 - lr: 0.000147 - momentum: 0.000000 | |
| 2023-10-11 14:14:22,701 epoch 2 - iter 216/723 - loss 0.17115371 - time (sec): 119.22 - samples/sec: 433.56 - lr: 0.000145 - momentum: 0.000000 | |
| 2023-10-11 14:15:03,146 epoch 2 - iter 288/723 - loss 0.16331197 - time (sec): 159.66 - samples/sec: 434.40 - lr: 0.000143 - momentum: 0.000000 | |
| 2023-10-11 14:15:43,402 epoch 2 - iter 360/723 - loss 0.16009303 - time (sec): 199.92 - samples/sec: 437.18 - lr: 0.000142 - momentum: 0.000000 | |
| 2023-10-11 14:16:23,005 epoch 2 - iter 432/723 - loss 0.15669479 - time (sec): 239.52 - samples/sec: 437.77 - lr: 0.000140 - momentum: 0.000000 | |
| 2023-10-11 14:17:02,620 epoch 2 - iter 504/723 - loss 0.14903751 - time (sec): 279.14 - samples/sec: 441.76 - lr: 0.000138 - momentum: 0.000000 | |
| 2023-10-11 14:17:43,533 epoch 2 - iter 576/723 - loss 0.14173836 - time (sec): 320.05 - samples/sec: 446.76 - lr: 0.000137 - momentum: 0.000000 | |
| 2023-10-11 14:18:21,648 epoch 2 - iter 648/723 - loss 0.13875105 - time (sec): 358.16 - samples/sec: 444.18 - lr: 0.000135 - momentum: 0.000000 | |
| 2023-10-11 14:19:03,265 epoch 2 - iter 720/723 - loss 0.13671767 - time (sec): 399.78 - samples/sec: 438.93 - lr: 0.000133 - momentum: 0.000000 | |
| 2023-10-11 14:19:04,918 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 14:19:04,919 EPOCH 2 done: loss 0.1366 - lr: 0.000133 | |
| 2023-10-11 14:19:26,427 DEV : loss 0.11942420899868011 - f1-score (micro avg) 0.7416 | |
| 2023-10-11 14:19:26,458 saving best model | |
| 2023-10-11 14:19:27,827 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 14:20:12,005 epoch 3 - iter 72/723 - loss 0.08259658 - time (sec): 44.18 - samples/sec: 390.95 - lr: 0.000132 - momentum: 0.000000 | |
| 2023-10-11 14:20:53,017 epoch 3 - iter 144/723 - loss 0.09033580 - time (sec): 85.19 - samples/sec: 404.11 - lr: 0.000130 - momentum: 0.000000 | |
| 2023-10-11 14:21:34,442 epoch 3 - iter 216/723 - loss 0.08477045 - time (sec): 126.61 - samples/sec: 410.89 - lr: 0.000128 - momentum: 0.000000 | |
| 2023-10-11 14:22:14,549 epoch 3 - iter 288/723 - loss 0.09192864 - time (sec): 166.72 - samples/sec: 411.77 - lr: 0.000127 - momentum: 0.000000 | |
| 2023-10-11 14:22:55,726 epoch 3 - iter 360/723 - loss 0.08964205 - time (sec): 207.90 - samples/sec: 419.60 - lr: 0.000125 - momentum: 0.000000 | |
| 2023-10-11 14:23:36,234 epoch 3 - iter 432/723 - loss 0.08993680 - time (sec): 248.40 - samples/sec: 418.75 - lr: 0.000123 - momentum: 0.000000 | |
| 2023-10-11 14:24:14,710 epoch 3 - iter 504/723 - loss 0.08843282 - time (sec): 286.88 - samples/sec: 423.56 - lr: 0.000122 - momentum: 0.000000 | |
| 2023-10-11 14:24:54,374 epoch 3 - iter 576/723 - loss 0.08469597 - time (sec): 326.55 - samples/sec: 427.94 - lr: 0.000120 - momentum: 0.000000 | |
| 2023-10-11 14:25:33,840 epoch 3 - iter 648/723 - loss 0.08177926 - time (sec): 366.01 - samples/sec: 431.84 - lr: 0.000118 - momentum: 0.000000 | |
| 2023-10-11 14:26:15,057 epoch 3 - iter 720/723 - loss 0.08098319 - time (sec): 407.23 - samples/sec: 431.32 - lr: 0.000117 - momentum: 0.000000 | |
| 2023-10-11 14:26:16,272 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 14:26:16,272 EPOCH 3 done: loss 0.0810 - lr: 0.000117 | |
| 2023-10-11 14:26:39,318 DEV : loss 0.0933394655585289 - f1-score (micro avg) 0.7843 | |
| 2023-10-11 14:26:39,365 saving best model | |
| 2023-10-11 14:26:42,488 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 14:27:23,951 epoch 4 - iter 72/723 - loss 0.06794431 - time (sec): 41.46 - samples/sec: 436.19 - lr: 0.000115 - momentum: 0.000000 | |
| 2023-10-11 14:28:04,485 epoch 4 - iter 144/723 - loss 0.05806820 - time (sec): 81.99 - samples/sec: 427.75 - lr: 0.000113 - momentum: 0.000000 | |
| 2023-10-11 14:28:44,946 epoch 4 - iter 216/723 - loss 0.05532765 - time (sec): 122.45 - samples/sec: 431.87 - lr: 0.000112 - momentum: 0.000000 | |
| 2023-10-11 14:29:25,877 epoch 4 - iter 288/723 - loss 0.05495337 - time (sec): 163.38 - samples/sec: 430.00 - lr: 0.000110 - momentum: 0.000000 | |
| 2023-10-11 14:30:06,043 epoch 4 - iter 360/723 - loss 0.05464785 - time (sec): 203.55 - samples/sec: 428.59 - lr: 0.000108 - momentum: 0.000000 | |
| 2023-10-11 14:30:43,057 epoch 4 - iter 432/723 - loss 0.05467701 - time (sec): 240.56 - samples/sec: 431.40 - lr: 0.000107 - momentum: 0.000000 | |
| 2023-10-11 14:31:22,681 epoch 4 - iter 504/723 - loss 0.05477446 - time (sec): 280.19 - samples/sec: 431.78 - lr: 0.000105 - momentum: 0.000000 | |
| 2023-10-11 14:32:04,286 epoch 4 - iter 576/723 - loss 0.05566990 - time (sec): 321.79 - samples/sec: 432.98 - lr: 0.000103 - momentum: 0.000000 | |
| 2023-10-11 14:32:42,989 epoch 4 - iter 648/723 - loss 0.05417209 - time (sec): 360.49 - samples/sec: 436.05 - lr: 0.000102 - momentum: 0.000000 | |
| 2023-10-11 14:33:21,891 epoch 4 - iter 720/723 - loss 0.05222244 - time (sec): 399.40 - samples/sec: 440.11 - lr: 0.000100 - momentum: 0.000000 | |
| 2023-10-11 14:33:22,951 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 14:33:22,952 EPOCH 4 done: loss 0.0522 - lr: 0.000100 | |
| 2023-10-11 14:33:43,757 DEV : loss 0.0753728598356247 - f1-score (micro avg) 0.8404 | |
| 2023-10-11 14:33:43,792 saving best model | |
| 2023-10-11 14:33:46,481 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 14:34:26,467 epoch 5 - iter 72/723 - loss 0.02836811 - time (sec): 39.98 - samples/sec: 446.76 - lr: 0.000098 - momentum: 0.000000 | |
| 2023-10-11 14:35:04,451 epoch 5 - iter 144/723 - loss 0.03014743 - time (sec): 77.96 - samples/sec: 443.42 - lr: 0.000097 - momentum: 0.000000 | |
| 2023-10-11 14:35:43,263 epoch 5 - iter 216/723 - loss 0.03649224 - time (sec): 116.77 - samples/sec: 439.91 - lr: 0.000095 - momentum: 0.000000 | |
| 2023-10-11 14:36:24,885 epoch 5 - iter 288/723 - loss 0.03442032 - time (sec): 158.40 - samples/sec: 436.97 - lr: 0.000093 - momentum: 0.000000 | |
| 2023-10-11 14:37:11,469 epoch 5 - iter 360/723 - loss 0.03751789 - time (sec): 204.98 - samples/sec: 428.52 - lr: 0.000092 - momentum: 0.000000 | |
| 2023-10-11 14:37:56,871 epoch 5 - iter 432/723 - loss 0.03539090 - time (sec): 250.38 - samples/sec: 416.37 - lr: 0.000090 - momentum: 0.000000 | |
| 2023-10-11 14:38:39,139 epoch 5 - iter 504/723 - loss 0.03487207 - time (sec): 292.65 - samples/sec: 416.32 - lr: 0.000088 - momentum: 0.000000 | |
| 2023-10-11 14:39:21,228 epoch 5 - iter 576/723 - loss 0.03534212 - time (sec): 334.74 - samples/sec: 420.39 - lr: 0.000087 - momentum: 0.000000 | |
| 2023-10-11 14:40:01,428 epoch 5 - iter 648/723 - loss 0.03542313 - time (sec): 374.94 - samples/sec: 420.10 - lr: 0.000085 - momentum: 0.000000 | |
| 2023-10-11 14:40:41,071 epoch 5 - iter 720/723 - loss 0.03559847 - time (sec): 414.58 - samples/sec: 423.82 - lr: 0.000083 - momentum: 0.000000 | |
| 2023-10-11 14:40:42,254 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 14:40:42,254 EPOCH 5 done: loss 0.0356 - lr: 0.000083 | |
| 2023-10-11 14:41:04,297 DEV : loss 0.08206792920827866 - f1-score (micro avg) 0.8407 | |
| 2023-10-11 14:41:04,332 saving best model | |
| 2023-10-11 14:41:06,999 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 14:41:44,849 epoch 6 - iter 72/723 - loss 0.02906877 - time (sec): 37.84 - samples/sec: 444.50 - lr: 0.000082 - momentum: 0.000000 | |
| 2023-10-11 14:42:25,331 epoch 6 - iter 144/723 - loss 0.02818642 - time (sec): 78.32 - samples/sec: 434.40 - lr: 0.000080 - momentum: 0.000000 | |
| 2023-10-11 14:43:06,681 epoch 6 - iter 216/723 - loss 0.02990584 - time (sec): 119.67 - samples/sec: 433.58 - lr: 0.000078 - momentum: 0.000000 | |
| 2023-10-11 14:43:47,544 epoch 6 - iter 288/723 - loss 0.02714357 - time (sec): 160.53 - samples/sec: 436.14 - lr: 0.000077 - momentum: 0.000000 | |
| 2023-10-11 14:44:29,330 epoch 6 - iter 360/723 - loss 0.02747624 - time (sec): 202.32 - samples/sec: 436.90 - lr: 0.000075 - momentum: 0.000000 | |
| 2023-10-11 14:45:10,018 epoch 6 - iter 432/723 - loss 0.02687441 - time (sec): 243.01 - samples/sec: 433.75 - lr: 0.000073 - momentum: 0.000000 | |
| 2023-10-11 14:45:52,721 epoch 6 - iter 504/723 - loss 0.02594408 - time (sec): 285.71 - samples/sec: 427.66 - lr: 0.000072 - momentum: 0.000000 | |
| 2023-10-11 14:46:37,946 epoch 6 - iter 576/723 - loss 0.02542891 - time (sec): 330.94 - samples/sec: 422.42 - lr: 0.000070 - momentum: 0.000000 | |
| 2023-10-11 14:47:23,370 epoch 6 - iter 648/723 - loss 0.02627547 - time (sec): 376.36 - samples/sec: 423.51 - lr: 0.000068 - momentum: 0.000000 | |
| 2023-10-11 14:48:05,278 epoch 6 - iter 720/723 - loss 0.02645835 - time (sec): 418.27 - samples/sec: 420.22 - lr: 0.000067 - momentum: 0.000000 | |
| 2023-10-11 14:48:06,364 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 14:48:06,364 EPOCH 6 done: loss 0.0266 - lr: 0.000067 | |
| 2023-10-11 14:48:26,664 DEV : loss 0.08414550870656967 - f1-score (micro avg) 0.871 | |
| 2023-10-11 14:48:26,696 saving best model | |
| 2023-10-11 14:48:29,329 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 14:49:10,549 epoch 7 - iter 72/723 - loss 0.02559871 - time (sec): 41.22 - samples/sec: 434.37 - lr: 0.000065 - momentum: 0.000000 | |
| 2023-10-11 14:49:50,528 epoch 7 - iter 144/723 - loss 0.02202443 - time (sec): 81.19 - samples/sec: 429.79 - lr: 0.000063 - momentum: 0.000000 | |
| 2023-10-11 14:50:33,114 epoch 7 - iter 216/723 - loss 0.01970189 - time (sec): 123.78 - samples/sec: 418.63 - lr: 0.000062 - momentum: 0.000000 | |
| 2023-10-11 14:51:15,905 epoch 7 - iter 288/723 - loss 0.02107156 - time (sec): 166.57 - samples/sec: 413.39 - lr: 0.000060 - momentum: 0.000000 | |
| 2023-10-11 14:51:59,500 epoch 7 - iter 360/723 - loss 0.02138550 - time (sec): 210.17 - samples/sec: 411.59 - lr: 0.000058 - momentum: 0.000000 | |
| 2023-10-11 14:52:41,711 epoch 7 - iter 432/723 - loss 0.02195180 - time (sec): 252.38 - samples/sec: 413.71 - lr: 0.000057 - momentum: 0.000000 | |
| 2023-10-11 14:53:22,689 epoch 7 - iter 504/723 - loss 0.02270591 - time (sec): 293.36 - samples/sec: 417.57 - lr: 0.000055 - momentum: 0.000000 | |
| 2023-10-11 14:54:02,112 epoch 7 - iter 576/723 - loss 0.02192802 - time (sec): 332.78 - samples/sec: 420.35 - lr: 0.000053 - momentum: 0.000000 | |
| 2023-10-11 14:54:41,762 epoch 7 - iter 648/723 - loss 0.02326251 - time (sec): 372.43 - samples/sec: 422.01 - lr: 0.000052 - momentum: 0.000000 | |
| 2023-10-11 14:55:21,919 epoch 7 - iter 720/723 - loss 0.02251924 - time (sec): 412.59 - samples/sec: 425.38 - lr: 0.000050 - momentum: 0.000000 | |
| 2023-10-11 14:55:23,238 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 14:55:23,239 EPOCH 7 done: loss 0.0225 - lr: 0.000050 | |
| 2023-10-11 14:55:45,123 DEV : loss 0.09741368144750595 - f1-score (micro avg) 0.86 | |
| 2023-10-11 14:55:45,161 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 14:56:25,043 epoch 8 - iter 72/723 - loss 0.01566425 - time (sec): 39.88 - samples/sec: 470.64 - lr: 0.000048 - momentum: 0.000000 | |
| 2023-10-11 14:57:03,296 epoch 8 - iter 144/723 - loss 0.01425224 - time (sec): 78.13 - samples/sec: 460.33 - lr: 0.000047 - momentum: 0.000000 | |
| 2023-10-11 14:57:41,996 epoch 8 - iter 216/723 - loss 0.01421036 - time (sec): 116.83 - samples/sec: 454.02 - lr: 0.000045 - momentum: 0.000000 | |
| 2023-10-11 14:58:20,720 epoch 8 - iter 288/723 - loss 0.01334895 - time (sec): 155.56 - samples/sec: 449.16 - lr: 0.000043 - momentum: 0.000000 | |
| 2023-10-11 14:59:01,048 epoch 8 - iter 360/723 - loss 0.01534408 - time (sec): 195.89 - samples/sec: 448.40 - lr: 0.000042 - momentum: 0.000000 | |
| 2023-10-11 14:59:42,233 epoch 8 - iter 432/723 - loss 0.01520775 - time (sec): 237.07 - samples/sec: 447.96 - lr: 0.000040 - momentum: 0.000000 | |
| 2023-10-11 15:00:22,379 epoch 8 - iter 504/723 - loss 0.01628644 - time (sec): 277.22 - samples/sec: 447.92 - lr: 0.000038 - momentum: 0.000000 | |
| 2023-10-11 15:01:03,684 epoch 8 - iter 576/723 - loss 0.01780027 - time (sec): 318.52 - samples/sec: 447.22 - lr: 0.000037 - momentum: 0.000000 | |
| 2023-10-11 15:01:46,996 epoch 8 - iter 648/723 - loss 0.01751548 - time (sec): 361.83 - samples/sec: 437.74 - lr: 0.000035 - momentum: 0.000000 | |
| 2023-10-11 15:02:30,881 epoch 8 - iter 720/723 - loss 0.01788380 - time (sec): 405.72 - samples/sec: 432.99 - lr: 0.000033 - momentum: 0.000000 | |
| 2023-10-11 15:02:32,251 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 15:02:32,251 EPOCH 8 done: loss 0.0179 - lr: 0.000033 | |
| 2023-10-11 15:02:54,685 DEV : loss 0.11365482956171036 - f1-score (micro avg) 0.8415 | |
| 2023-10-11 15:02:54,716 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 15:03:41,064 epoch 9 - iter 72/723 - loss 0.02258103 - time (sec): 46.35 - samples/sec: 404.98 - lr: 0.000032 - momentum: 0.000000 | |
| 2023-10-11 15:04:22,261 epoch 9 - iter 144/723 - loss 0.01587706 - time (sec): 87.54 - samples/sec: 402.96 - lr: 0.000030 - momentum: 0.000000 | |
| 2023-10-11 15:05:06,366 epoch 9 - iter 216/723 - loss 0.01536952 - time (sec): 131.65 - samples/sec: 409.42 - lr: 0.000028 - momentum: 0.000000 | |
| 2023-10-11 15:05:51,100 epoch 9 - iter 288/723 - loss 0.01464115 - time (sec): 176.38 - samples/sec: 404.84 - lr: 0.000027 - momentum: 0.000000 | |
| 2023-10-11 15:06:36,197 epoch 9 - iter 360/723 - loss 0.01451980 - time (sec): 221.48 - samples/sec: 400.55 - lr: 0.000025 - momentum: 0.000000 | |
| 2023-10-11 15:07:21,999 epoch 9 - iter 432/723 - loss 0.01468506 - time (sec): 267.28 - samples/sec: 397.94 - lr: 0.000023 - momentum: 0.000000 | |
| 2023-10-11 15:08:04,206 epoch 9 - iter 504/723 - loss 0.01473622 - time (sec): 309.49 - samples/sec: 403.27 - lr: 0.000022 - momentum: 0.000000 | |
| 2023-10-11 15:08:45,094 epoch 9 - iter 576/723 - loss 0.01522224 - time (sec): 350.38 - samples/sec: 403.83 - lr: 0.000020 - momentum: 0.000000 | |
| 2023-10-11 15:09:24,875 epoch 9 - iter 648/723 - loss 0.01442489 - time (sec): 390.16 - samples/sec: 406.21 - lr: 0.000018 - momentum: 0.000000 | |
| 2023-10-11 15:10:04,792 epoch 9 - iter 720/723 - loss 0.01450651 - time (sec): 430.07 - samples/sec: 408.82 - lr: 0.000017 - momentum: 0.000000 | |
| 2023-10-11 15:10:05,942 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 15:10:05,942 EPOCH 9 done: loss 0.0145 - lr: 0.000017 | |
| 2023-10-11 15:10:26,729 DEV : loss 0.11227083206176758 - f1-score (micro avg) 0.8546 | |
| 2023-10-11 15:10:26,766 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 15:11:05,747 epoch 10 - iter 72/723 - loss 0.00745596 - time (sec): 38.98 - samples/sec: 430.39 - lr: 0.000015 - momentum: 0.000000 | |
| 2023-10-11 15:11:47,734 epoch 10 - iter 144/723 - loss 0.01171360 - time (sec): 80.96 - samples/sec: 435.46 - lr: 0.000013 - momentum: 0.000000 | |
| 2023-10-11 15:12:31,352 epoch 10 - iter 216/723 - loss 0.01187809 - time (sec): 124.58 - samples/sec: 420.80 - lr: 0.000012 - momentum: 0.000000 | |
| 2023-10-11 15:13:13,766 epoch 10 - iter 288/723 - loss 0.01086224 - time (sec): 167.00 - samples/sec: 414.49 - lr: 0.000010 - momentum: 0.000000 | |
| 2023-10-11 15:13:58,505 epoch 10 - iter 360/723 - loss 0.01143704 - time (sec): 211.74 - samples/sec: 414.27 - lr: 0.000008 - momentum: 0.000000 | |
| 2023-10-11 15:14:39,915 epoch 10 - iter 432/723 - loss 0.01105902 - time (sec): 253.15 - samples/sec: 418.84 - lr: 0.000007 - momentum: 0.000000 | |
| 2023-10-11 15:15:20,796 epoch 10 - iter 504/723 - loss 0.01259970 - time (sec): 294.03 - samples/sec: 422.08 - lr: 0.000005 - momentum: 0.000000 | |
| 2023-10-11 15:16:00,222 epoch 10 - iter 576/723 - loss 0.01185845 - time (sec): 333.45 - samples/sec: 422.00 - lr: 0.000003 - momentum: 0.000000 | |
| 2023-10-11 15:16:40,161 epoch 10 - iter 648/723 - loss 0.01209669 - time (sec): 373.39 - samples/sec: 424.20 - lr: 0.000002 - momentum: 0.000000 | |
| 2023-10-11 15:17:19,030 epoch 10 - iter 720/723 - loss 0.01209148 - time (sec): 412.26 - samples/sec: 425.91 - lr: 0.000000 - momentum: 0.000000 | |
| 2023-10-11 15:17:20,270 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 15:17:20,270 EPOCH 10 done: loss 0.0121 - lr: 0.000000 | |
| 2023-10-11 15:17:41,620 DEV : loss 0.12011167407035828 - f1-score (micro avg) 0.8502 | |
| 2023-10-11 15:17:42,629 ---------------------------------------------------------------------------------------------------- | |
| 2023-10-11 15:17:42,632 Loading model from best epoch ... | |
| 2023-10-11 15:17:48,592 SequenceTagger predicts: Dictionary with 13 tags: O, S-LOC, B-LOC, E-LOC, I-LOC, S-PER, B-PER, E-PER, I-PER, S-ORG, B-ORG, E-ORG, I-ORG | |
| 2023-10-11 15:18:08,765 | |
| Results: | |
| - F-score (micro) 0.8516 | |
| - F-score (macro) 0.7648 | |
| - Accuracy 0.7513 | |
| By class: | |
| precision recall f1-score support | |
| PER 0.8173 0.8817 0.8483 482 | |
| LOC 0.9240 0.8755 0.8991 458 | |
| ORG 0.5932 0.5072 0.5469 69 | |
| micro avg 0.8500 0.8533 0.8516 1009 | |
| macro avg 0.7782 0.7548 0.7648 1009 | |
| weighted avg 0.8504 0.8533 0.8507 1009 | |
| 2023-10-11 15:18:08,765 ---------------------------------------------------------------------------------------------------- | |