Hugging Face's logo

apwic
/
nerui-unipelt-1

TensorBoard
Indonesian
Generated from Trainer
Model card Files Metrics Community
apwic commited on
Commit
870bf0d
•
1 Parent(s): 82f35e2

Model save

Browse files
Files changed (6) hide show
  1. README.md +172 -0
  2. nerui-unipelt/adapter_config.json +77 -0
  3. nerui-unipelt/head_config.json +19 -0
  4. nerui-unipelt/pytorch_adapter.bin +3 -0
  5. nerui-unipelt/pytorch_model_head.bin +3 -0
  6. runs/Jun04_05-28-40_a358b85c7679/events.out.tfevents.1717478930.a358b85c7679.508198.0 +2 -2
README.md ADDED
@@ -0,0 +1,172 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ base_model: indolem/indobert-base-uncased
4
+ tags:
5
+ - generated_from_trainer
6
+ model-index:
7
+ - name: nerui-unipelt-1
8
+ results: []
9
+ ---
10
+
11
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
+ should probably proofread and complete it, then remove this comment. -->
13
+
14
+ # nerui-unipelt-1
15
+
16
+ This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co/indolem/indobert-base-uncased) on an unknown dataset.
17
+ It achieves the following results on the evaluation set:
18
+ - Loss: 0.0617
19
+ - Location Precision: 0.9244
20
+ - Location Recall: 0.9483
21
+ - Location F1: 0.9362
22
+ - Location Number: 116
23
+ - Organization Precision: 0.9419
24
+ - Organization Recall: 0.9241
25
+ - Organization F1: 0.9329
26
+ - Organization Number: 158
27
+ - Person Precision: 0.984
28
+ - Person Recall: 0.9919
29
+ - Person F1: 0.9880
30
+ - Person Number: 124
31
+ - Overall Precision: 0.9499
32
+ - Overall Recall: 0.9523
33
+ - Overall F1: 0.9511
34
+ - Overall Accuracy: 0.9898
35
+
36
+ ## Model description
37
+
38
+ More information needed
39
+
40
+ ## Intended uses & limitations
41
+
42
+ More information needed
43
+
44
+ ## Training and evaluation data
45
+
46
+ More information needed
47
+
48
+ ## Training procedure
49
+
50
+ ### Training hyperparameters
51
+
52
+ The following hyperparameters were used during training:
53
+ - learning_rate: 5e-05
54
+ - train_batch_size: 16
55
+ - eval_batch_size: 64
56
+ - seed: 42
57
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
58
+ - lr_scheduler_type: linear
59
+ - num_epochs: 100.0
60
+
61
+ ### Training results
62
+
63
+ | Training Loss | Epoch | Step | Validation Loss | Location Precision | Location Recall | Location F1 | Location Number | Organization Precision | Organization Recall | Organization F1 | Organization Number | Person Precision | Person Recall | Person F1 | Person Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
64
+ |:-------------:|:-----:|:----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:-------------:|:---------:|:-------------:|:-----------------:|:--------------:|:----------:|:----------------:|
65
+ | 0.8594 | 1.0 | 96 | 0.4997 | 0.0 | 0.0 | 0.0 | 116 | 0.3333 | 0.0063 | 0.0124 | 158 | 0.0 | 0.0 | 0.0 | 124 | 0.2 | 0.0025 | 0.0050 | 0.8397 |
66
+ | 0.3949 | 2.0 | 192 | 0.2252 | 0.4180 | 0.4397 | 0.4286 | 116 | 0.5604 | 0.6456 | 0.6 | 158 | 0.5562 | 0.7581 | 0.6416 | 124 | 0.5222 | 0.6206 | 0.5672 | 0.9330 |
67
+ | 0.1905 | 3.0 | 288 | 0.1096 | 0.7565 | 0.75 | 0.7532 | 116 | 0.6915 | 0.8228 | 0.7514 | 158 | 0.8978 | 0.9919 | 0.9425 | 124 | 0.7727 | 0.8543 | 0.8115 | 0.9654 |
68
+ | 0.1245 | 4.0 | 384 | 0.0806 | 0.7481 | 0.8707 | 0.8048 | 116 | 0.7640 | 0.8608 | 0.8095 | 158 | 0.9318 | 0.9919 | 0.9609 | 124 | 0.8090 | 0.9045 | 0.8541 | 0.9726 |
69
+ | 0.1021 | 5.0 | 480 | 0.0540 | 0.8957 | 0.8879 | 0.8918 | 116 | 0.8373 | 0.8797 | 0.8580 | 158 | 0.9685 | 0.9919 | 0.9801 | 124 | 0.8946 | 0.9171 | 0.9057 | 0.9822 |
70
+ | 0.087 | 6.0 | 576 | 0.0530 | 0.7970 | 0.9138 | 0.8514 | 116 | 0.9021 | 0.8165 | 0.8571 | 158 | 0.9535 | 0.9919 | 0.9723 | 124 | 0.8840 | 0.8995 | 0.8917 | 0.9811 |
71
+ | 0.0748 | 7.0 | 672 | 0.0469 | 0.9035 | 0.8879 | 0.8957 | 116 | 0.8402 | 0.8987 | 0.8685 | 158 | 0.9762 | 0.9919 | 0.9840 | 124 | 0.8998 | 0.9246 | 0.9120 | 0.9833 |
72
+ | 0.0685 | 8.0 | 768 | 0.0424 | 0.9076 | 0.9310 | 0.9191 | 116 | 0.9182 | 0.9241 | 0.9211 | 158 | 0.9762 | 0.9919 | 0.9840 | 124 | 0.9332 | 0.9472 | 0.9401 | 0.9863 |
73
+ | 0.0611 | 9.0 | 864 | 0.0377 | 0.8934 | 0.9397 | 0.9160 | 116 | 0.8957 | 0.9241 | 0.9097 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9220 | 0.9497 | 0.9356 | 0.9879 |
74
+ | 0.0573 | 10.0 | 960 | 0.0421 | 0.8594 | 0.9483 | 0.9016 | 116 | 0.9221 | 0.8987 | 0.9103 | 158 | 0.9762 | 0.9919 | 0.9840 | 124 | 0.9191 | 0.9422 | 0.9305 | 0.9855 |
75
+ | 0.054 | 11.0 | 1056 | 0.0359 | 0.9008 | 0.9397 | 0.9198 | 116 | 0.9477 | 0.9177 | 0.9325 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9449 | 0.9472 | 0.9460 | 0.9885 |
76
+ | 0.0454 | 12.0 | 1152 | 0.0335 | 0.9231 | 0.9310 | 0.9270 | 116 | 0.9484 | 0.9304 | 0.9393 | 158 | 0.9762 | 0.9919 | 0.9840 | 124 | 0.9497 | 0.9497 | 0.9497 | 0.9898 |
77
+ | 0.0426 | 13.0 | 1248 | 0.0333 | 0.9322 | 0.9483 | 0.9402 | 116 | 0.9367 | 0.9367 | 0.9367 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9501 | 0.9573 | 0.9537 | 0.9909 |
78
+ | 0.0392 | 14.0 | 1344 | 0.0348 | 0.9256 | 0.9655 | 0.9451 | 116 | 0.9359 | 0.9241 | 0.9299 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9478 | 0.9573 | 0.9525 | 0.9896 |
79
+ | 0.0371 | 15.0 | 1440 | 0.0349 | 0.9098 | 0.9569 | 0.9328 | 116 | 0.9367 | 0.9367 | 0.9367 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9432 | 0.9598 | 0.9514 | 0.9898 |
80
+ | 0.0339 | 16.0 | 1536 | 0.0343 | 0.9113 | 0.9741 | 0.9417 | 116 | 0.9412 | 0.9114 | 0.9260 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9453 | 0.9548 | 0.95 | 0.9896 |
81
+ | 0.0331 | 17.0 | 1632 | 0.0359 | 0.9237 | 0.9397 | 0.9316 | 116 | 0.9136 | 0.9367 | 0.9250 | 158 | 0.9762 | 0.9919 | 0.9840 | 124 | 0.9360 | 0.9548 | 0.9453 | 0.9896 |
82
+ | 0.031 | 18.0 | 1728 | 0.0358 | 0.9016 | 0.9483 | 0.9244 | 116 | 0.9487 | 0.9367 | 0.9427 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9454 | 0.9573 | 0.9513 | 0.9898 |
83
+ | 0.0295 | 19.0 | 1824 | 0.0303 | 0.9322 | 0.9483 | 0.9402 | 116 | 0.925 | 0.9367 | 0.9308 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9454 | 0.9573 | 0.9513 | 0.9912 |
84
+ | 0.0273 | 20.0 | 1920 | 0.0342 | 0.9180 | 0.9655 | 0.9412 | 116 | 0.9299 | 0.9241 | 0.9270 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9431 | 0.9573 | 0.9501 | 0.9907 |
85
+ | 0.0258 | 21.0 | 2016 | 0.0384 | 0.8889 | 0.9655 | 0.9256 | 116 | 0.9363 | 0.9304 | 0.9333 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9363 | 0.9598 | 0.9479 | 0.9890 |
86
+ | 0.0225 | 22.0 | 2112 | 0.0322 | 0.9237 | 0.9397 | 0.9316 | 116 | 0.9255 | 0.9430 | 0.9342 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9431 | 0.9573 | 0.9501 | 0.9901 |
87
+ | 0.0211 | 23.0 | 2208 | 0.0353 | 0.9244 | 0.9483 | 0.9362 | 116 | 0.9484 | 0.9304 | 0.9393 | 158 | 0.9762 | 0.9919 | 0.9840 | 124 | 0.95 | 0.9548 | 0.9524 | 0.9904 |
88
+ | 0.0213 | 24.0 | 2304 | 0.0355 | 0.9402 | 0.9483 | 0.9442 | 116 | 0.9416 | 0.9177 | 0.9295 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9545 | 0.9497 | 0.9521 | 0.9898 |
89
+ | 0.0197 | 25.0 | 2400 | 0.0342 | 0.9174 | 0.9569 | 0.9367 | 116 | 0.9545 | 0.9304 | 0.9423 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9525 | 0.9573 | 0.9549 | 0.9909 |
90
+ | 0.022 | 26.0 | 2496 | 0.0349 | 0.9316 | 0.9397 | 0.9356 | 116 | 0.9481 | 0.9241 | 0.9359 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9545 | 0.9497 | 0.9521 | 0.9904 |
91
+ | 0.019 | 27.0 | 2592 | 0.0320 | 0.9402 | 0.9483 | 0.9442 | 116 | 0.9430 | 0.9430 | 0.9430 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.955 | 0.9598 | 0.9574 | 0.9912 |
92
+ | 0.0174 | 28.0 | 2688 | 0.0415 | 0.9492 | 0.9655 | 0.9573 | 116 | 0.9484 | 0.9304 | 0.9393 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9598 | 0.9598 | 0.9598 | 0.9898 |
93
+ | 0.0164 | 29.0 | 2784 | 0.0383 | 0.925 | 0.9569 | 0.9407 | 116 | 0.9308 | 0.9367 | 0.9338 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9455 | 0.9598 | 0.9526 | 0.9901 |
94
+ | 0.0166 | 30.0 | 2880 | 0.0414 | 0.9322 | 0.9483 | 0.9402 | 116 | 0.8869 | 0.9430 | 0.9141 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9294 | 0.9598 | 0.9444 | 0.9890 |
95
+ | 0.0162 | 31.0 | 2976 | 0.0371 | 0.925 | 0.9569 | 0.9407 | 116 | 0.9363 | 0.9304 | 0.9333 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9478 | 0.9573 | 0.9525 | 0.9907 |
96
+ | 0.0157 | 32.0 | 3072 | 0.0402 | 0.925 | 0.9569 | 0.9407 | 116 | 0.9419 | 0.9241 | 0.9329 | 158 | 0.9762 | 0.9919 | 0.9840 | 124 | 0.9476 | 0.9548 | 0.9512 | 0.9893 |
97
+ | 0.0137 | 33.0 | 3168 | 0.0428 | 0.925 | 0.9569 | 0.9407 | 116 | 0.9539 | 0.9177 | 0.9355 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9547 | 0.9523 | 0.9535 | 0.9893 |
98
+ | 0.0146 | 34.0 | 3264 | 0.0422 | 0.9333 | 0.9655 | 0.9492 | 116 | 0.9363 | 0.9304 | 0.9333 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9502 | 0.9598 | 0.9550 | 0.9896 |
99
+ | 0.0139 | 35.0 | 3360 | 0.0435 | 0.9333 | 0.9655 | 0.9492 | 116 | 0.9299 | 0.9241 | 0.9270 | 158 | 0.976 | 0.9839 | 0.9799 | 124 | 0.9453 | 0.9548 | 0.95 | 0.9898 |
100
+ | 0.0126 | 36.0 | 3456 | 0.0428 | 0.9328 | 0.9569 | 0.9447 | 116 | 0.9669 | 0.9241 | 0.9450 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9620 | 0.9548 | 0.9584 | 0.9898 |
101
+ | 0.0112 | 37.0 | 3552 | 0.0404 | 0.9339 | 0.9741 | 0.9536 | 116 | 0.9545 | 0.9304 | 0.9423 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9575 | 0.9623 | 0.9599 | 0.9912 |
102
+ | 0.0121 | 38.0 | 3648 | 0.0483 | 0.9328 | 0.9569 | 0.9447 | 116 | 0.9732 | 0.9177 | 0.9446 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9644 | 0.9523 | 0.9583 | 0.9898 |
103
+ | 0.0101 | 39.0 | 3744 | 0.0465 | 0.925 | 0.9569 | 0.9407 | 116 | 0.9667 | 0.9177 | 0.9416 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9595 | 0.9523 | 0.9559 | 0.9901 |
104
+ | 0.0106 | 40.0 | 3840 | 0.0437 | 0.9244 | 0.9483 | 0.9362 | 116 | 0.9667 | 0.9177 | 0.9416 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9594 | 0.9497 | 0.9545 | 0.9896 |
105
+ | 0.0113 | 41.0 | 3936 | 0.0478 | 0.925 | 0.9569 | 0.9407 | 116 | 0.9299 | 0.9241 | 0.9270 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9453 | 0.9548 | 0.95 | 0.9898 |
106
+ | 0.0088 | 42.0 | 4032 | 0.0529 | 0.9098 | 0.9569 | 0.9328 | 116 | 0.9542 | 0.9241 | 0.9389 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.95 | 0.9548 | 0.9524 | 0.9887 |
107
+ | 0.0092 | 43.0 | 4128 | 0.0494 | 0.925 | 0.9569 | 0.9407 | 116 | 0.9664 | 0.9114 | 0.9381 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9594 | 0.9497 | 0.9545 | 0.9901 |
108
+ | 0.0083 | 44.0 | 4224 | 0.0481 | 0.925 | 0.9569 | 0.9407 | 116 | 0.9735 | 0.9304 | 0.9515 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9621 | 0.9573 | 0.9597 | 0.9901 |
109
+ | 0.0104 | 45.0 | 4320 | 0.0548 | 0.9174 | 0.9569 | 0.9367 | 116 | 0.9664 | 0.9114 | 0.9381 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9570 | 0.9497 | 0.9533 | 0.9890 |
110
+ | 0.0085 | 46.0 | 4416 | 0.0535 | 0.9098 | 0.9569 | 0.9328 | 116 | 0.9610 | 0.9367 | 0.9487 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9526 | 0.9598 | 0.9562 | 0.9896 |
111
+ | 0.0075 | 47.0 | 4512 | 0.0533 | 0.9091 | 0.9483 | 0.9283 | 116 | 0.9605 | 0.9241 | 0.9419 | 158 | 0.976 | 0.9839 | 0.9799 | 124 | 0.9497 | 0.9497 | 0.9497 | 0.9887 |
112
+ | 0.0084 | 48.0 | 4608 | 0.0462 | 0.9333 | 0.9655 | 0.9492 | 116 | 0.9548 | 0.9367 | 0.9457 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9575 | 0.9623 | 0.9599 | 0.9901 |
113
+ | 0.007 | 49.0 | 4704 | 0.0518 | 0.9328 | 0.9569 | 0.9447 | 116 | 0.9735 | 0.9304 | 0.9515 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9646 | 0.9573 | 0.9609 | 0.9907 |
114
+ | 0.0073 | 50.0 | 4800 | 0.0465 | 0.9333 | 0.9655 | 0.9492 | 116 | 0.9610 | 0.9367 | 0.9487 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9599 | 0.9623 | 0.9611 | 0.9901 |
115
+ | 0.0072 | 51.0 | 4896 | 0.0535 | 0.9256 | 0.9655 | 0.9451 | 116 | 0.9673 | 0.9367 | 0.9518 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9599 | 0.9623 | 0.9611 | 0.9901 |
116
+ | 0.0066 | 52.0 | 4992 | 0.0524 | 0.9098 | 0.9569 | 0.9328 | 116 | 0.9367 | 0.9367 | 0.9367 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9432 | 0.9598 | 0.9514 | 0.9898 |
117
+ | 0.0075 | 53.0 | 5088 | 0.0535 | 0.9256 | 0.9655 | 0.9451 | 116 | 0.9671 | 0.9304 | 0.9484 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9598 | 0.9598 | 0.9598 | 0.9898 |
118
+ | 0.0068 | 54.0 | 5184 | 0.0589 | 0.9174 | 0.9569 | 0.9367 | 116 | 0.9548 | 0.9367 | 0.9457 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9526 | 0.9598 | 0.9562 | 0.9896 |
119
+ | 0.007 | 55.0 | 5280 | 0.0497 | 0.925 | 0.9569 | 0.9407 | 116 | 0.9548 | 0.9367 | 0.9457 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.955 | 0.9598 | 0.9574 | 0.9909 |
120
+ | 0.0063 | 56.0 | 5376 | 0.0514 | 0.9256 | 0.9655 | 0.9451 | 116 | 0.9313 | 0.9430 | 0.9371 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9458 | 0.9648 | 0.9552 | 0.9901 |
121
+ | 0.0051 | 57.0 | 5472 | 0.0527 | 0.9328 | 0.9569 | 0.9447 | 116 | 0.9548 | 0.9367 | 0.9457 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9574 | 0.9598 | 0.9586 | 0.9909 |
122
+ | 0.0064 | 58.0 | 5568 | 0.0566 | 0.925 | 0.9569 | 0.9407 | 116 | 0.9548 | 0.9367 | 0.9457 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.955 | 0.9598 | 0.9574 | 0.9907 |
123
+ | 0.0049 | 59.0 | 5664 | 0.0573 | 0.9174 | 0.9569 | 0.9367 | 116 | 0.9304 | 0.9304 | 0.9304 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9431 | 0.9573 | 0.9501 | 0.9890 |
124
+ | 0.0046 | 60.0 | 5760 | 0.0577 | 0.925 | 0.9569 | 0.9407 | 116 | 0.9487 | 0.9367 | 0.9427 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9526 | 0.9598 | 0.9562 | 0.9901 |
125
+ | 0.0049 | 61.0 | 5856 | 0.0581 | 0.925 | 0.9569 | 0.9407 | 116 | 0.9542 | 0.9241 | 0.9389 | 158 | 0.976 | 0.9839 | 0.9799 | 124 | 0.9523 | 0.9523 | 0.9523 | 0.9898 |
126
+ | 0.0043 | 62.0 | 5952 | 0.0570 | 0.9328 | 0.9569 | 0.9447 | 116 | 0.9548 | 0.9367 | 0.9457 | 158 | 0.976 | 0.9839 | 0.9799 | 124 | 0.9549 | 0.9573 | 0.9561 | 0.9904 |
127
+ | 0.0048 | 63.0 | 6048 | 0.0572 | 0.9167 | 0.9483 | 0.9322 | 116 | 0.9548 | 0.9367 | 0.9457 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9525 | 0.9573 | 0.9549 | 0.9898 |
128
+ | 0.0055 | 64.0 | 6144 | 0.0586 | 0.925 | 0.9569 | 0.9407 | 116 | 0.9484 | 0.9304 | 0.9393 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9525 | 0.9573 | 0.9549 | 0.9898 |
129
+ | 0.0052 | 65.0 | 6240 | 0.0592 | 0.9167 | 0.9483 | 0.9322 | 116 | 0.9487 | 0.9367 | 0.9427 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9501 | 0.9573 | 0.9537 | 0.9904 |
130
+ | 0.0041 | 66.0 | 6336 | 0.0551 | 0.925 | 0.9569 | 0.9407 | 116 | 0.9423 | 0.9304 | 0.9363 | 158 | 0.976 | 0.9839 | 0.9799 | 124 | 0.9476 | 0.9548 | 0.9512 | 0.9898 |
131
+ | 0.0048 | 67.0 | 6432 | 0.0619 | 0.9174 | 0.9569 | 0.9367 | 116 | 0.9603 | 0.9177 | 0.9385 | 158 | 0.976 | 0.9839 | 0.9799 | 124 | 0.9521 | 0.9497 | 0.9509 | 0.9890 |
132
+ | 0.0033 | 68.0 | 6528 | 0.0590 | 0.9167 | 0.9483 | 0.9322 | 116 | 0.9427 | 0.9367 | 0.9397 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9478 | 0.9573 | 0.9525 | 0.9901 |
133
+ | 0.0038 | 69.0 | 6624 | 0.0588 | 0.925 | 0.9569 | 0.9407 | 116 | 0.9608 | 0.9304 | 0.9453 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9573 | 0.9573 | 0.9573 | 0.9901 |
134
+ | 0.0043 | 70.0 | 6720 | 0.0531 | 0.925 | 0.9569 | 0.9407 | 116 | 0.925 | 0.9367 | 0.9308 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9432 | 0.9598 | 0.9514 | 0.9896 |
135
+ | 0.0051 | 71.0 | 6816 | 0.0577 | 0.9083 | 0.9397 | 0.9237 | 116 | 0.9304 | 0.9304 | 0.9304 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9404 | 0.9523 | 0.9463 | 0.9893 |
136
+ | 0.0035 | 72.0 | 6912 | 0.0587 | 0.9167 | 0.9483 | 0.9322 | 116 | 0.9299 | 0.9241 | 0.9270 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9428 | 0.9523 | 0.9475 | 0.9898 |
137
+ | 0.0041 | 73.0 | 7008 | 0.0580 | 0.9167 | 0.9483 | 0.9322 | 116 | 0.9359 | 0.9241 | 0.9299 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9451 | 0.9523 | 0.9487 | 0.9898 |
138
+ | 0.0039 | 74.0 | 7104 | 0.0560 | 0.9244 | 0.9483 | 0.9362 | 116 | 0.9605 | 0.9241 | 0.9419 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9571 | 0.9523 | 0.9547 | 0.9896 |
139
+ | 0.0037 | 75.0 | 7200 | 0.0577 | 0.9167 | 0.9483 | 0.9322 | 116 | 0.9304 | 0.9304 | 0.9304 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9429 | 0.9548 | 0.9488 | 0.9898 |
140
+ | 0.0035 | 76.0 | 7296 | 0.0574 | 0.9167 | 0.9483 | 0.9322 | 116 | 0.9304 | 0.9304 | 0.9304 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9429 | 0.9548 | 0.9488 | 0.9901 |
141
+ | 0.0036 | 77.0 | 7392 | 0.0572 | 0.925 | 0.9569 | 0.9407 | 116 | 0.9304 | 0.9304 | 0.9304 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9454 | 0.9573 | 0.9513 | 0.9904 |
142
+ | 0.0038 | 78.0 | 7488 | 0.0574 | 0.925 | 0.9569 | 0.9407 | 116 | 0.9304 | 0.9304 | 0.9304 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9454 | 0.9573 | 0.9513 | 0.9904 |
143
+ | 0.0028 | 79.0 | 7584 | 0.0595 | 0.925 | 0.9569 | 0.9407 | 116 | 0.9419 | 0.9241 | 0.9329 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.95 | 0.9548 | 0.9524 | 0.9901 |
144
+ | 0.0035 | 80.0 | 7680 | 0.0618 | 0.925 | 0.9569 | 0.9407 | 116 | 0.9542 | 0.9241 | 0.9389 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9548 | 0.9548 | 0.9548 | 0.9896 |
145
+ | 0.0038 | 81.0 | 7776 | 0.0599 | 0.9160 | 0.9397 | 0.9277 | 116 | 0.9545 | 0.9304 | 0.9423 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9523 | 0.9523 | 0.9523 | 0.9893 |
146
+ | 0.0029 | 82.0 | 7872 | 0.0584 | 0.9160 | 0.9397 | 0.9277 | 116 | 0.9304 | 0.9304 | 0.9304 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9428 | 0.9523 | 0.9475 | 0.9893 |
147
+ | 0.0037 | 83.0 | 7968 | 0.0632 | 0.9160 | 0.9397 | 0.9277 | 116 | 0.9419 | 0.9241 | 0.9329 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9474 | 0.9497 | 0.9486 | 0.9893 |
148
+ | 0.003 | 84.0 | 8064 | 0.0565 | 0.9244 | 0.9483 | 0.9362 | 116 | 0.9419 | 0.9241 | 0.9329 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9499 | 0.9523 | 0.9511 | 0.9898 |
149
+ | 0.0022 | 85.0 | 8160 | 0.0610 | 0.9244 | 0.9483 | 0.9362 | 116 | 0.9419 | 0.9241 | 0.9329 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9499 | 0.9523 | 0.9511 | 0.9898 |
150
+ | 0.0033 | 86.0 | 8256 | 0.0600 | 0.925 | 0.9569 | 0.9407 | 116 | 0.9419 | 0.9241 | 0.9329 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.95 | 0.9548 | 0.9524 | 0.9898 |
151
+ | 0.0023 | 87.0 | 8352 | 0.0624 | 0.9328 | 0.9569 | 0.9447 | 116 | 0.9359 | 0.9241 | 0.9299 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.95 | 0.9548 | 0.9524 | 0.9893 |
152
+ | 0.002 | 88.0 | 8448 | 0.0611 | 0.9244 | 0.9483 | 0.9362 | 116 | 0.9542 | 0.9241 | 0.9389 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9547 | 0.9523 | 0.9535 | 0.9893 |
153
+ | 0.0027 | 89.0 | 8544 | 0.0612 | 0.9244 | 0.9483 | 0.9362 | 116 | 0.9481 | 0.9241 | 0.9359 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9523 | 0.9523 | 0.9523 | 0.9901 |
154
+ | 0.0029 | 90.0 | 8640 | 0.0617 | 0.9244 | 0.9483 | 0.9362 | 116 | 0.9419 | 0.9241 | 0.9329 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9499 | 0.9523 | 0.9511 | 0.9896 |
155
+ | 0.0028 | 91.0 | 8736 | 0.0596 | 0.9244 | 0.9483 | 0.9362 | 116 | 0.9419 | 0.9241 | 0.9329 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9499 | 0.9523 | 0.9511 | 0.9898 |
156
+ | 0.003 | 92.0 | 8832 | 0.0622 | 0.9328 | 0.9569 | 0.9447 | 116 | 0.9481 | 0.9241 | 0.9359 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9548 | 0.9548 | 0.9548 | 0.9898 |
157
+ | 0.0027 | 93.0 | 8928 | 0.0620 | 0.9328 | 0.9569 | 0.9447 | 116 | 0.9419 | 0.9241 | 0.9329 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9524 | 0.9548 | 0.9536 | 0.9901 |
158
+ | 0.0026 | 94.0 | 9024 | 0.0602 | 0.9244 | 0.9483 | 0.9362 | 116 | 0.9542 | 0.9241 | 0.9389 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9547 | 0.9523 | 0.9535 | 0.9898 |
159
+ | 0.0021 | 95.0 | 9120 | 0.0612 | 0.9328 | 0.9569 | 0.9447 | 116 | 0.9545 | 0.9304 | 0.9423 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9573 | 0.9573 | 0.9573 | 0.9904 |
160
+ | 0.0024 | 96.0 | 9216 | 0.0618 | 0.9244 | 0.9483 | 0.9362 | 116 | 0.9545 | 0.9304 | 0.9423 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9548 | 0.9548 | 0.9548 | 0.9901 |
161
+ | 0.0029 | 97.0 | 9312 | 0.0613 | 0.9244 | 0.9483 | 0.9362 | 116 | 0.9419 | 0.9241 | 0.9329 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9499 | 0.9523 | 0.9511 | 0.9898 |
162
+ | 0.0023 | 98.0 | 9408 | 0.0611 | 0.9244 | 0.9483 | 0.9362 | 116 | 0.9419 | 0.9241 | 0.9329 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9499 | 0.9523 | 0.9511 | 0.9898 |
163
+ | 0.0025 | 99.0 | 9504 | 0.0616 | 0.9244 | 0.9483 | 0.9362 | 116 | 0.9419 | 0.9241 | 0.9329 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9499 | 0.9523 | 0.9511 | 0.9898 |
164
+ | 0.0024 | 100.0 | 9600 | 0.0617 | 0.9244 | 0.9483 | 0.9362 | 116 | 0.9419 | 0.9241 | 0.9329 | 158 | 0.984 | 0.9919 | 0.9880 | 124 | 0.9499 | 0.9523 | 0.9511 | 0.9898 |
165
+
166
+
167
+ ### Framework versions
168
+
169
+ - Transformers 4.39.3
170
+ - Pytorch 2.3.0+cu121
171
+ - Datasets 2.19.1
172
+ - Tokenizers 0.15.2
nerui-unipelt/adapter_config.json ADDED
@@ -0,0 +1,77 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "config": {
3
+ "architecture": "union",
4
+ "configs": [
5
+ {
6
+ "architecture": "prefix_tuning",
7
+ "bottleneck_size": 512,
8
+ "cross_prefix": true,
9
+ "dropout": 0.0,
10
+ "encoder_prefix": true,
11
+ "flat": false,
12
+ "leave_out": [],
13
+ "non_linearity": "tanh",
14
+ "prefix_length": 10,
15
+ "shared_gating": true,
16
+ "use_gating": true
17
+ },
18
+ {
19
+ "adapter_residual_before_ln": false,
20
+ "cross_adapter": false,
21
+ "dropout": 0.0,
22
+ "factorized_phm_W": true,
23
+ "factorized_phm_rule": false,
24
+ "hypercomplex_nonlinearity": "glorot-uniform",
25
+ "init_weights": "bert",
26
+ "inv_adapter": null,
27
+ "inv_adapter_reduction_factor": null,
28
+ "is_parallel": false,
29
+ "learn_phm": true,
30
+ "leave_out": [],
31
+ "ln_after": false,
32
+ "ln_before": false,
33
+ "mh_adapter": false,
34
+ "non_linearity": "relu",
35
+ "original_ln_after": true,
36
+ "original_ln_before": true,
37
+ "output_adapter": true,
38
+ "phm_bias": true,
39
+ "phm_c_init": "normal",
40
+ "phm_dim": 4,
41
+ "phm_init_range": 0.0001,
42
+ "phm_layer": false,
43
+ "phm_rank": 1,
44
+ "reduction_factor": 16,
45
+ "residual_before_ln": true,
46
+ "scaling": 1.0,
47
+ "shared_W_phm": false,
48
+ "shared_phm_rule": true,
49
+ "use_gating": true
50
+ },
51
+ {
52
+ "alpha": 2,
53
+ "architecture": "lora",
54
+ "attn_matrices": [
55
+ "q",
56
+ "v"
57
+ ],
58
+ "composition_mode": "add",
59
+ "dropout": 0.0,
60
+ "init_weights": "lora",
61
+ "intermediate_lora": false,
62
+ "leave_out": [],
63
+ "output_lora": false,
64
+ "r": 8,
65
+ "selfattn_lora": true,
66
+ "use_gating": true
67
+ }
68
+ ]
69
+ },
70
+ "config_id": "67ac4937c601ad56",
71
+ "hidden_size": 768,
72
+ "model_class": "BertForTokenClassification",
73
+ "model_name": "indolem/indobert-base-uncased",
74
+ "model_type": "bert",
75
+ "name": "nerui-unipelt",
76
+ "version": "0.2.0"
77
+ }
nerui-unipelt/head_config.json ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "config": null,
3
+ "hidden_size": 768,
4
+ "label2id": {
5
+ "B-LOCATION": 0,
6
+ "B-ORGANIZATION": 1,
7
+ "B-PERSON": 2,
8
+ "I-LOCATION": 3,
9
+ "I-ORGANIZATION": 4,
10
+ "I-PERSON": 5,
11
+ "O": 6
12
+ },
13
+ "model_class": "BertForTokenClassification",
14
+ "model_name": "indolem/indobert-base-uncased",
15
+ "model_type": "bert",
16
+ "name": null,
17
+ "num_labels": 7,
18
+ "version": "0.2.0"
19
+ }
nerui-unipelt/pytorch_adapter.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:983481be85df531828b4d9659a607325ff00b61c80a0d5afd30859ee21b15d47
3
+ size 44418352
nerui-unipelt/pytorch_model_head.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:49f154205434498845612901b6fa8314552bb0b845c80994e5cf44ff97c69999
3
+ size 23066
runs/Jun04_05-28-40_a358b85c7679/events.out.tfevents.1717478930.a358b85c7679.508198.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:40fbf36bba349a8e91e96d679a166006bba0aaa9964e63452697fa1bcb648b17
3
- size 146435
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:19dbd5c3e346cb2b66a4e873fd44a1f7ed568110ee5d522c3ea01f9f5474beff
3
+ size 148217