rollerhafeezh-amikom commited on
Commit
4489466
1 Parent(s): 154a930

Training in progress, epoch 1

Browse files
README.md CHANGED
@@ -3,6 +3,8 @@ license: mit
3
  base_model: xlm-roberta-base
4
  tags:
5
  - generated_from_trainer
 
 
6
  metrics:
7
  - precision
8
  - recall
@@ -10,7 +12,29 @@ metrics:
10
  - accuracy
11
  model-index:
12
  - name: xlm-roberta-base-ner-silvanus
13
- results: []
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
14
  ---
15
 
16
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -18,13 +42,13 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  # xlm-roberta-base-ner-silvanus
20
 
21
- This model is a fine-tuned version of [xlm-roberta-base](https://huggingface.co/xlm-roberta-base) on the None dataset.
22
  It achieves the following results on the evaluation set:
23
- - Loss: 0.0885
24
- - Precision: 0.9374
25
- - Recall: 0.9485
26
- - F1: 0.9429
27
- - Accuracy: 0.9756
28
 
29
  ## Model description
30
 
@@ -44,11 +68,9 @@ More information needed
44
 
45
  The following hyperparameters were used during training:
46
  - learning_rate: 2e-05
47
- - train_batch_size: 6
48
  - eval_batch_size: 8
49
  - seed: 42
50
- - gradient_accumulation_steps: 4
51
- - total_train_batch_size: 24
52
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
53
  - lr_scheduler_type: linear
54
  - num_epochs: 3
@@ -57,9 +79,9 @@ The following hyperparameters were used during training:
57
 
58
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
59
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
60
- | 0.1123 | 1.0 | 1560 | 0.0853 | 0.9090 | 0.9388 | 0.9237 | 0.9705 |
61
- | 0.0734 | 2.0 | 3121 | 0.0914 | 0.9303 | 0.9440 | 0.9371 | 0.9741 |
62
- | 0.0494 | 3.0 | 4680 | 0.0885 | 0.9374 | 0.9485 | 0.9429 | 0.9756 |
63
 
64
 
65
  ### Framework versions
 
3
  base_model: xlm-roberta-base
4
  tags:
5
  - generated_from_trainer
6
+ datasets:
7
+ - id_nergrit_corpus
8
  metrics:
9
  - precision
10
  - recall
 
12
  - accuracy
13
  model-index:
14
  - name: xlm-roberta-base-ner-silvanus
15
+ results:
16
+ - task:
17
+ name: Token Classification
18
+ type: token-classification
19
+ dataset:
20
+ name: id_nergrit_corpus
21
+ type: id_nergrit_corpus
22
+ config: ner
23
+ split: validation
24
+ args: ner
25
+ metrics:
26
+ - name: Precision
27
+ type: precision
28
+ value: 0.8954509177972865
29
+ - name: Recall
30
+ type: recall
31
+ value: 0.8834645669291339
32
+ - name: F1
33
+ type: f1
34
+ value: 0.8894173602853745
35
+ - name: Accuracy
36
+ type: accuracy
37
+ value: 0.9820464165815209
38
  ---
39
 
40
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
42
 
43
  # xlm-roberta-base-ner-silvanus
44
 
45
+ This model is a fine-tuned version of [xlm-roberta-base](https://huggingface.co/xlm-roberta-base) on the id_nergrit_corpus dataset.
46
  It achieves the following results on the evaluation set:
47
+ - Loss: 0.0942
48
+ - Precision: 0.8955
49
+ - Recall: 0.8835
50
+ - F1: 0.8894
51
+ - Accuracy: 0.9820
52
 
53
  ## Model description
54
 
 
68
 
69
  The following hyperparameters were used during training:
70
  - learning_rate: 2e-05
71
+ - train_batch_size: 2
72
  - eval_batch_size: 8
73
  - seed: 42
 
 
74
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
75
  - lr_scheduler_type: linear
76
  - num_epochs: 3
 
79
 
80
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
81
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
82
+ | 0.0955 | 1.0 | 2285 | 0.0766 | 0.8528 | 0.8669 | 0.8598 | 0.9813 |
83
+ | 0.0558 | 2.0 | 4570 | 0.0860 | 0.8867 | 0.8693 | 0.8779 | 0.9811 |
84
+ | 0.0368 | 3.0 | 6855 | 0.0942 | 0.8955 | 0.8835 | 0.8894 | 0.9820 |
85
 
86
 
87
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:54c5cf1fabdcdd1ecccca607577299682cc4dcdad2a5555af800aeac78c1af71
3
  size 1109857804
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:12f328acaadceb5927eff58213bf7d4a771f238658fc9e86104b1e21f85a3de4
3
  size 1109857804
runs/Nov13_05-44-02_server-cvis/events.out.tfevents.1699854244.server-cvis.550379.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:faed4facbf02f601834f9e8f4042e6d3b4ad99195785b8fd6dfaf03da44665ff
3
- size 5604
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c8cf8e8c9be48902fca6b68f19f05f9e46deb08faee4af6889e733a0c6715eed
3
+ size 8315
runs/Nov14_13-33-29_server-cvis/events.out.tfevents.1699968828.server-cvis.769965.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d7d0bc559c7658fafc1b63c8f800c8acac8dd828aba553a8eb44d0b96dfd602a
3
+ size 4503
runs/Nov14_13-34-59_server-cvis/events.out.tfevents.1699968921.server-cvis.770111.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:90b08cf29054c4ae470bca45482a17c95fc43a9bd21b06ee505a47a8d1b452d1
3
+ size 4661
runs/Nov14_13-36-43_server-cvis/events.out.tfevents.1699969010.server-cvis.770268.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d7e0d03070e763efd6f32586d8d7db7264bd11ea4d20a8b982b39c2e8fc7d10a
3
+ size 4504
runs/Nov14_13-38-00_server-cvis/events.out.tfevents.1699969093.server-cvis.770401.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e14d449f0ff2fde552722e50af82ead619569d8a4a0383dbeec54b78742edc0d
3
+ size 5447
tokenizer.json CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:003498ab0695fbf35aedc8bbbae1e20a6033a1b3914e49c6d2fbe1d54d7d93b9
3
- size 17082786
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:19232daba569c004c5fbe45f373ccaf2ee505055da00969f78a99e5754db8f25
3
+ size 17082688
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f4600edbd32c9c0a76f5eea48f25a0b17be45ac671129e834059a0725d5cf5b4
3
  size 4600
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eaf13d219eb94085addac7060089757237249e584b4b32e5ac844dcfacb49f6f
3
  size 4600