dthoek commited on
Commit
269009d
1 Parent(s): 894c031

End of training

Browse files
README.md ADDED
@@ -0,0 +1,82 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: zwaarcontrast/lilt-xlm-roberta-base
3
+ tags:
4
+ - generated_from_trainer
5
+ metrics:
6
+ - precision
7
+ - recall
8
+ - f1
9
+ - accuracy
10
+ model-index:
11
+ - name: lilt-xlm-roberta-base-finetuned-DocLayNet-base_paragraphs_ml512-v1
12
+ results: []
13
+ ---
14
+
15
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
16
+ should probably proofread and complete it, then remove this comment. -->
17
+
18
+ # lilt-xlm-roberta-base-finetuned-DocLayNet-base_paragraphs_ml512-v1
19
+
20
+ This model is a fine-tuned version of [zwaarcontrast/lilt-xlm-roberta-base](https://huggingface.co/zwaarcontrast/lilt-xlm-roberta-base) on an unknown dataset.
21
+ It achieves the following results on the evaluation set:
22
+ - Loss: 0.0645
23
+ - Precision: 0.8277
24
+ - Recall: 0.8277
25
+ - F1: 0.8277
26
+ - Accuracy: 0.8277
27
+
28
+ ## Model description
29
+
30
+ More information needed
31
+
32
+ ## Intended uses & limitations
33
+
34
+ More information needed
35
+
36
+ ## Training and evaluation data
37
+
38
+ More information needed
39
+
40
+ ## Training procedure
41
+
42
+ ### Training hyperparameters
43
+
44
+ The following hyperparameters were used during training:
45
+ - learning_rate: 2e-05
46
+ - train_batch_size: 8
47
+ - eval_batch_size: 16
48
+ - seed: 42
49
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
50
+ - lr_scheduler_type: linear
51
+ - num_epochs: 1
52
+
53
+ ### Training results
54
+
55
+ | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
56
+ |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
57
+ | No log | 0.05 | 100 | 0.1162 | 0.6875 | 0.6875 | 0.6875 | 0.6875 |
58
+ | No log | 0.11 | 200 | 0.1097 | 0.6755 | 0.6755 | 0.6755 | 0.6755 |
59
+ | No log | 0.16 | 300 | 0.0866 | 0.7781 | 0.7781 | 0.7781 | 0.7781 |
60
+ | No log | 0.21 | 400 | 0.1018 | 0.7478 | 0.7478 | 0.7478 | 0.7478 |
61
+ | 0.0975 | 0.27 | 500 | 0.0645 | 0.8277 | 0.8277 | 0.8277 | 0.8277 |
62
+ | 0.0975 | 0.32 | 600 | 0.0767 | 0.7985 | 0.7985 | 0.7985 | 0.7985 |
63
+ | 0.0975 | 0.37 | 700 | 0.0758 | 0.7903 | 0.7903 | 0.7903 | 0.7903 |
64
+ | 0.0975 | 0.43 | 800 | 0.0862 | 0.7865 | 0.7865 | 0.7865 | 0.7865 |
65
+ | 0.0975 | 0.48 | 900 | 0.1243 | 0.6892 | 0.6892 | 0.6892 | 0.6892 |
66
+ | 0.1389 | 0.53 | 1000 | 0.0795 | 0.8256 | 0.8256 | 0.8256 | 0.8256 |
67
+ | 0.1389 | 0.59 | 1100 | 0.1683 | 0.4702 | 0.4702 | 0.4702 | 0.4702 |
68
+ | 0.1389 | 0.64 | 1200 | 0.1253 | 0.6636 | 0.6636 | 0.6636 | 0.6636 |
69
+ | 0.1389 | 0.69 | 1300 | 0.1044 | 0.7295 | 0.7295 | 0.7295 | 0.7295 |
70
+ | 0.1389 | 0.75 | 1400 | 0.1235 | 0.6477 | 0.6477 | 0.6477 | 0.6477 |
71
+ | 0.1018 | 0.8 | 1500 | 0.1113 | 0.7276 | 0.7276 | 0.7276 | 0.7276 |
72
+ | 0.1018 | 0.85 | 1600 | 0.1014 | 0.7317 | 0.7317 | 0.7317 | 0.7317 |
73
+ | 0.1018 | 0.91 | 1700 | 0.0963 | 0.7293 | 0.7293 | 0.7293 | 0.7293 |
74
+ | 0.1018 | 0.96 | 1800 | 0.1012 | 0.7323 | 0.7323 | 0.7323 | 0.7323 |
75
+
76
+
77
+ ### Framework versions
78
+
79
+ - Transformers 4.35.0
80
+ - Pytorch 2.1.0
81
+ - Datasets 2.14.6
82
+ - Tokenizers 0.14.1
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7518377c084f3b7f8a65e2ba596eda4e380e212293d7f91040e9ed5ca5477ec9
3
  size 1134332228
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1f2d64be8115c16e5f0aa9d478cda07d477f5357ce6c5a2b8b65bbe35c504f8d
3
  size 1134332228
runs/Nov13_21-25-17_Dannys-MacBook-Pro.local/events.out.tfevents.1699907124.Dannys-MacBook-Pro.local.63038.2 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b3437fb92afbf77a7d08c94bca26a7c1bbfdcadced72243342d1b33c375456bb
3
- size 14048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4fe0a5a68cea8e68ab190ce4db27f921833d9213a2d96b7315be81bfa7b7e8a2
3
+ size 14402
runs/Nov13_21-25-17_Dannys-MacBook-Pro.local/events.out.tfevents.1699916887.Dannys-MacBook-Pro.local.63038.3 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:75c2952123df12d96f9505a0921e212d3bae13aa3edefe5be23a8f2ef687047a
3
+ size 560