Hugging Face's logo

khalidrajan
/
roberta-base_legal_ner_finetuned

TensorBoard
Safetensors
roberta
Generated from Trainer
Model card Files Metrics Community
khalidrajan commited on
Commit
89330c7
·
verified ·
1 Parent(s): b60d6ec

End of training

Browse files
Files changed (6) hide show
  1. README.md +27 -27
  2. config.json +12 -12
  3. model.safetensors +1 -1
  4. runs/Sep06_16-21-16_Khalids-MBP/events.out.tfevents.1725654078.Khalids-MBP.23384.14 +3 -0
  5. runs/Sep06_16-21-16_Khalids-MBP/events.out.tfevents.1725656762.Khalids-MBP.23384.15 +3 -0
  6. training_args.bin +1 -1
README.md CHANGED
@@ -15,27 +15,27 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [FacebookAI/roberta-base](https://huggingface.co/FacebookAI/roberta-base) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 0.2625
19
- - Law Precision: 0.8649
20
- - Law Recall: 0.8972
21
- - Law F1: 0.8807
22
  - Law Number: 107
23
- - Violated by Precision: 0.7778
24
- - Violated by Recall: 0.7887
25
- - Violated by F1: 0.7832
26
  - Violated by Number: 71
27
- - Violated on Precision: 0.4857
28
- - Violated on Recall: 0.5312
29
- - Violated on F1: 0.5075
30
  - Violated on Number: 64
31
- - Violation Precision: 0.6547
32
- - Violation Recall: 0.6845
33
- - Violation F1: 0.6693
34
  - Violation Number: 374
35
- - Overall Precision: 0.6863
36
- - Overall Recall: 0.7175
37
- - Overall F1: 0.7016
38
- - Overall Accuracy: 0.9529
39
 
40
  ## Model description
41
 
@@ -67,16 +67,16 @@ The following hyperparameters were used during training:
67
 
68
  | Training Loss | Epoch | Step | Validation Loss | Law Precision | Law Recall | Law F1 | Law Number | Violated by Precision | Violated by Recall | Violated by F1 | Violated by Number | Violated on Precision | Violated on Recall | Violated on F1 | Violated on Number | Violation Precision | Violation Recall | Violation F1 | Violation Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
69
  |:-------------:|:-----:|:----:|:---------------:|:-------------:|:----------:|:------:|:----------:|:---------------------:|:------------------:|:--------------:|:------------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:-------------------:|:----------------:|:------------:|:----------------:|:-----------------:|:--------------:|:----------:|:----------------:|
70
- | No log | 1.0 | 85 | 0.7083 | 0.0 | 0.0 | 0.0 | 107 | 0.0 | 0.0 | 0.0 | 71 | 0.0 | 0.0 | 0.0 | 64 | 0.0 | 0.0 | 0.0 | 374 | 0.0 | 0.0 | 0.0 | 0.7707 |
71
- | No log | 2.0 | 170 | 0.3822 | 0.0 | 0.0 | 0.0 | 107 | 0.0 | 0.0 | 0.0 | 71 | 0.0 | 0.0 | 0.0 | 64 | 0.2366 | 0.2941 | 0.2622 | 374 | 0.2366 | 0.1786 | 0.2035 | 0.8881 |
72
- | No log | 3.0 | 255 | 0.2716 | 0.2308 | 0.1121 | 0.1509 | 107 | 0.0 | 0.0 | 0.0 | 71 | 0.0 | 0.0 | 0.0 | 64 | 0.4296 | 0.4733 | 0.4504 | 374 | 0.4073 | 0.3068 | 0.35 | 0.9174 |
73
- | No log | 4.0 | 340 | 0.2157 | 0.7706 | 0.7850 | 0.7778 | 107 | 0.5741 | 0.4366 | 0.4960 | 71 | 0.3696 | 0.2656 | 0.3091 | 64 | 0.4967 | 0.5963 | 0.5419 | 374 | 0.5395 | 0.5763 | 0.5573 | 0.9352 |
74
- | No log | 5.0 | 425 | 0.1917 | 0.7739 | 0.8318 | 0.8018 | 107 | 0.6875 | 0.6197 | 0.6519 | 71 | 0.4211 | 0.375 | 0.3967 | 64 | 0.5129 | 0.5829 | 0.5457 | 374 | 0.5673 | 0.6088 | 0.5873 | 0.9404 |
75
- | 0.4731 | 6.0 | 510 | 0.2572 | 0.75 | 0.8411 | 0.7930 | 107 | 0.6316 | 0.6761 | 0.6531 | 71 | 0.5 | 0.4219 | 0.4576 | 64 | 0.5184 | 0.6765 | 0.5870 | 374 | 0.5664 | 0.6786 | 0.6174 | 0.9354 |
76
- | 0.4731 | 7.0 | 595 | 0.2530 | 0.7759 | 0.8411 | 0.8072 | 107 | 0.7344 | 0.6620 | 0.6963 | 71 | 0.4848 | 0.5 | 0.4923 | 64 | 0.6039 | 0.6684 | 0.6345 | 374 | 0.6348 | 0.6802 | 0.6567 | 0.9466 |
77
- | 0.4731 | 8.0 | 680 | 0.2294 | 0.8716 | 0.8879 | 0.8796 | 107 | 0.7308 | 0.8028 | 0.7651 | 71 | 0.4247 | 0.4844 | 0.4526 | 64 | 0.6573 | 0.6872 | 0.6719 | 374 | 0.6759 | 0.7143 | 0.6946 | 0.9511 |
78
- | 0.4731 | 9.0 | 765 | 0.2841 | 0.8482 | 0.8879 | 0.8676 | 107 | 0.7105 | 0.7606 | 0.7347 | 71 | 0.4918 | 0.4688 | 0.48 | 64 | 0.6422 | 0.7005 | 0.6701 | 374 | 0.6712 | 0.7159 | 0.6929 | 0.9482 |
79
- | 0.4731 | 10.0 | 850 | 0.2625 | 0.8649 | 0.8972 | 0.8807 | 107 | 0.7778 | 0.7887 | 0.7832 | 71 | 0.4857 | 0.5312 | 0.5075 | 64 | 0.6547 | 0.6845 | 0.6693 | 374 | 0.6863 | 0.7175 | 0.7016 | 0.9529 |
80
 
81
 
82
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [FacebookAI/roberta-base](https://huggingface.co/FacebookAI/roberta-base) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 0.2416
19
+ - Law Precision: 0.8319
20
+ - Law Recall: 0.8785
21
+ - Law F1: 0.8545
22
  - Law Number: 107
23
+ - Violated by Precision: 0.8361
24
+ - Violated by Recall: 0.7183
25
+ - Violated by F1: 0.7727
26
  - Violated by Number: 71
27
+ - Violated on Precision: 0.5
28
+ - Violated on Recall: 0.5
29
+ - Violated on F1: 0.5
30
  - Violated on Number: 64
31
+ - Violation Precision: 0.6494
32
+ - Violation Recall: 0.7032
33
+ - Violation F1: 0.6752
34
  - Violation Number: 374
35
+ - Overall Precision: 0.6843
36
+ - Overall Recall: 0.7143
37
+ - Overall F1: 0.6990
38
+ - Overall Accuracy: 0.9553
39
 
40
  ## Model description
41
 
 
67
 
68
  | Training Loss | Epoch | Step | Validation Loss | Law Precision | Law Recall | Law F1 | Law Number | Violated by Precision | Violated by Recall | Violated by F1 | Violated by Number | Violated on Precision | Violated on Recall | Violated on F1 | Violated on Number | Violation Precision | Violation Recall | Violation F1 | Violation Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
69
  |:-------------:|:-----:|:----:|:---------------:|:-------------:|:----------:|:------:|:----------:|:---------------------:|:------------------:|:--------------:|:------------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:-------------------:|:----------------:|:------------:|:----------------:|:-----------------:|:--------------:|:----------:|:----------------:|
70
+ | No log | 1.0 | 85 | 0.7386 | 0.0 | 0.0 | 0.0 | 107 | 0.0 | 0.0 | 0.0 | 71 | 0.0 | 0.0 | 0.0 | 64 | 0.0 | 0.0 | 0.0 | 374 | 0.0 | 0.0 | 0.0 | 0.7707 |
71
+ | No log | 2.0 | 170 | 0.3510 | 0.0 | 0.0 | 0.0 | 107 | 0.0 | 0.0 | 0.0 | 71 | 0.0 | 0.0 | 0.0 | 64 | 0.2072 | 0.2781 | 0.2374 | 374 | 0.2072 | 0.1688 | 0.1860 | 0.8901 |
72
+ | No log | 3.0 | 255 | 0.2471 | 0.4265 | 0.2710 | 0.3314 | 107 | 0.0 | 0.0 | 0.0 | 71 | 0.3810 | 0.125 | 0.1882 | 64 | 0.3965 | 0.4813 | 0.4348 | 374 | 0.3996 | 0.3523 | 0.3745 | 0.9199 |
73
+ | No log | 4.0 | 340 | 0.1996 | 0.7596 | 0.7383 | 0.7488 | 107 | 0.5128 | 0.5634 | 0.5369 | 71 | 0.3827 | 0.4844 | 0.4276 | 64 | 0.5101 | 0.6096 | 0.5554 | 374 | 0.5324 | 0.6136 | 0.5701 | 0.9385 |
74
+ | No log | 5.0 | 425 | 0.1984 | 0.7946 | 0.8318 | 0.8128 | 107 | 0.64 | 0.6761 | 0.6575 | 71 | 0.5091 | 0.4375 | 0.4706 | 64 | 0.5102 | 0.6684 | 0.5787 | 374 | 0.5669 | 0.6737 | 0.6157 | 0.9449 |
75
+ | 0.5018 | 6.0 | 510 | 0.2447 | 0.7456 | 0.7944 | 0.7692 | 107 | 0.75 | 0.6761 | 0.7111 | 71 | 0.4068 | 0.375 | 0.3902 | 64 | 0.6110 | 0.6845 | 0.6456 | 374 | 0.6296 | 0.6705 | 0.6494 | 0.9465 |
76
+ | 0.5018 | 7.0 | 595 | 0.2264 | 0.8125 | 0.8505 | 0.8311 | 107 | 0.7736 | 0.5775 | 0.6613 | 71 | 0.4754 | 0.4531 | 0.4640 | 64 | 0.6276 | 0.7166 | 0.6692 | 374 | 0.6570 | 0.6964 | 0.6761 | 0.9511 |
77
+ | 0.5018 | 8.0 | 680 | 0.2243 | 0.8598 | 0.8598 | 0.8598 | 107 | 0.7812 | 0.7042 | 0.7407 | 71 | 0.4912 | 0.4375 | 0.4628 | 64 | 0.6209 | 0.7139 | 0.6642 | 374 | 0.6641 | 0.7094 | 0.6860 | 0.9541 |
78
+ | 0.5018 | 9.0 | 765 | 0.2327 | 0.7934 | 0.8972 | 0.8421 | 107 | 0.7808 | 0.8028 | 0.7917 | 71 | 0.4231 | 0.5156 | 0.4648 | 64 | 0.6037 | 0.7005 | 0.6485 | 374 | 0.6346 | 0.7273 | 0.6778 | 0.9547 |
79
+ | 0.5018 | 10.0 | 850 | 0.2416 | 0.8319 | 0.8785 | 0.8545 | 107 | 0.8361 | 0.7183 | 0.7727 | 71 | 0.5 | 0.5 | 0.5 | 64 | 0.6494 | 0.7032 | 0.6752 | 374 | 0.6843 | 0.7143 | 0.6990 | 0.9553 |
80
 
81
 
82
  ### Framework versions
config.json CHANGED
@@ -11,28 +11,28 @@
11
  "hidden_dropout_prob": 0.1,
12
  "hidden_size": 768,
13
  "id2label": {
14
- "0": "I-VIOLATION",
15
  "1": "I-VIOLATED ON",
16
- "2": "B-VIOLATED ON",
17
- "3": "I-LAW",
18
- "4": "B-LAW",
19
  "5": "I-VIOLATED BY",
20
- "6": "O",
21
  "7": "B-VIOLATION",
22
- "8": "B-VIOLATED BY"
23
  },
24
  "initializer_range": 0.02,
25
  "intermediate_size": 3072,
26
  "label2id": {
27
- "B-LAW": 4,
28
- "B-VIOLATED BY": 8,
29
- "B-VIOLATED ON": 2,
30
  "B-VIOLATION": 7,
31
- "I-LAW": 3,
32
  "I-VIOLATED BY": 5,
33
  "I-VIOLATED ON": 1,
34
- "I-VIOLATION": 0,
35
- "O": 6
36
  },
37
  "layer_norm_eps": 1e-05,
38
  "max_position_embeddings": 514,
 
11
  "hidden_dropout_prob": 0.1,
12
  "hidden_size": 768,
13
  "id2label": {
14
+ "0": "O",
15
  "1": "I-VIOLATED ON",
16
+ "2": "B-VIOLATED BY",
17
+ "3": "B-LAW",
18
+ "4": "I-LAW",
19
  "5": "I-VIOLATED BY",
20
+ "6": "B-VIOLATED ON",
21
  "7": "B-VIOLATION",
22
+ "8": "I-VIOLATION"
23
  },
24
  "initializer_range": 0.02,
25
  "intermediate_size": 3072,
26
  "label2id": {
27
+ "B-LAW": 3,
28
+ "B-VIOLATED BY": 2,
29
+ "B-VIOLATED ON": 6,
30
  "B-VIOLATION": 7,
31
+ "I-LAW": 4,
32
  "I-VIOLATED BY": 5,
33
  "I-VIOLATED ON": 1,
34
+ "I-VIOLATION": 8,
35
+ "O": 0
36
  },
37
  "layer_norm_eps": 1e-05,
38
  "max_position_embeddings": 514,
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:25cdd39e94370f6c344ac607a2ca66c79443e406e1ddf60302cf281d894beee5
3
  size 496271772
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:57fafa85f17ea024418607ec7aa18f8775942a21e10f81a9dd9c9aeab03a0874
3
  size 496271772
runs/Sep06_16-21-16_Khalids-MBP/events.out.tfevents.1725654078.Khalids-MBP.23384.14 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:09b56ac3e5d8b2fc8a54b1a7d3ecbb225ad51708ea290048b1f16b723404bfdd
3
+ size 20484
runs/Sep06_16-21-16_Khalids-MBP/events.out.tfevents.1725656762.Khalids-MBP.23384.15 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ecbe17551258b5d8838dafeaaf6f8d7388cf6853f9f610f9e421da09e208a1ca
3
+ size 1540
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9fea69bddad21607a7b31a6b7db1524c30a55525c3fa749db38415163c437c2c
3
  size 5240
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cda5432380c90b9c1d984695ca5765ad3885b206706e849215a6e746cb708276
3
  size 5240