theCuiCoders commited on
Commit
e3d6e26
1 Parent(s): 8d5e777

End of training

Browse files
README.md ADDED
@@ -0,0 +1,78 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - nl
4
+ license: apache-2.0
5
+ base_model: bert-base-uncased
6
+ tags:
7
+ - abc
8
+ - generated_from_trainer
9
+ datasets:
10
+ - stsb_multi_mt
11
+ metrics:
12
+ - accuracy
13
+ model-index:
14
+ - name: bert-base-uncased-FinedTuned
15
+ results: []
16
+ ---
17
+
18
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
19
+ should probably proofread and complete it, then remove this comment. -->
20
+
21
+ # bert-base-uncased-FinedTuned
22
+
23
+ This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on the stsb_multi_mt dataset.
24
+ It achieves the following results on the evaluation set:
25
+ - Loss: 2.3210
26
+ - Accuracy: 0.1762
27
+
28
+ ## Model description
29
+
30
+ More information needed
31
+
32
+ ## Intended uses & limitations
33
+
34
+ More information needed
35
+
36
+ ## Training and evaluation data
37
+
38
+ More information needed
39
+
40
+ ## Training procedure
41
+
42
+ ### Training hyperparameters
43
+
44
+ The following hyperparameters were used during training:
45
+ - learning_rate: 1e-05
46
+ - train_batch_size: 16
47
+ - eval_batch_size: 16
48
+ - seed: 42
49
+ - gradient_accumulation_steps: 2
50
+ - total_train_batch_size: 32
51
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
52
+ - lr_scheduler_type: linear
53
+ - lr_scheduler_warmup_steps: 100
54
+ - training_steps: 100
55
+ - mixed_precision_training: Native AMP
56
+
57
+ ### Training results
58
+
59
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy |
60
+ |:-------------:|:------:|:----:|:---------------:|:--------:|
61
+ | No log | 0.0556 | 10 | 7.6479 | 0.1762 |
62
+ | No log | 0.1111 | 20 | 6.9937 | 0.1762 |
63
+ | 8.2277 | 0.1667 | 30 | 6.2531 | 0.1762 |
64
+ | 8.2277 | 0.2222 | 40 | 5.6151 | 0.1762 |
65
+ | 6.019 | 0.2778 | 50 | 4.8978 | 0.1762 |
66
+ | 6.019 | 0.3333 | 60 | 3.6924 | 0.1762 |
67
+ | 6.019 | 0.3889 | 70 | 2.9463 | 0.1762 |
68
+ | 3.6301 | 0.4444 | 80 | 2.5056 | 0.1762 |
69
+ | 3.6301 | 0.5 | 90 | 2.3194 | 0.1762 |
70
+ | 2.2789 | 0.5556 | 100 | 2.3210 | 0.1762 |
71
+
72
+
73
+ ### Framework versions
74
+
75
+ - Transformers 4.41.2
76
+ - Pytorch 2.3.1+cu121
77
+ - Datasets 2.19.2
78
+ - Tokenizers 0.19.1
events.out.tfevents.1717677665.51affbd53701.3502.3 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5fde191d73a1aacdf73c30472b9c5d186f2444bbdd24253801f7727147f6d3ca
3
- size 8899
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c98439ac4bab4bf0db29b399f77faf39555c83d32cc1b14f9a8514a3149140e
3
+ size 9247
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:92ba5dd03253a3b69cd8d1f3aa2f30ebdcba5c55a0b2a76656f542113b7cacea
3
  size 437955572
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ca122036b6dcbf6f4428de798ca67e7607264af3a648f2f6c87833b172604029
3
  size 437955572