rurupang commited on
Commit
a08044e
1 Parent(s): a3b3162

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +75 -0
README.md ADDED
@@ -0,0 +1,75 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - generated_from_trainer
4
+ datasets:
5
+ - klue
6
+ metrics:
7
+ - pearsonr
8
+ model-index:
9
+ - name: bert-base-finetuned-sts
10
+ results:
11
+ - task:
12
+ name: Text Classification
13
+ type: text-classification
14
+ dataset:
15
+ name: klue
16
+ type: klue
17
+ args: sts
18
+ metrics:
19
+ - name: Pearsonr
20
+ type: pearsonr
21
+ value: 0.8722017849942011
22
+ ---
23
+
24
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
25
+ should probably proofread and complete it, then remove this comment. -->
26
+
27
+ # bert-base-finetuned-sts
28
+
29
+ This model is a fine-tuned version of [klue/bert-base](https://huggingface.co/klue/bert-base) on the klue dataset.
30
+ It achieves the following results on the evaluation set:
31
+ - Loss: 0.4274
32
+ - Pearsonr: 0.8722
33
+
34
+ ## Model description
35
+
36
+ More information needed
37
+
38
+ ## Intended uses & limitations
39
+
40
+ More information needed
41
+
42
+ ## Training and evaluation data
43
+
44
+ More information needed
45
+
46
+ ## Training procedure
47
+
48
+ ### Training hyperparameters
49
+
50
+ The following hyperparameters were used during training:
51
+ - learning_rate: 2e-05
52
+ - train_batch_size: 32
53
+ - eval_batch_size: 32
54
+ - seed: 42
55
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
56
+ - lr_scheduler_type: linear
57
+ - num_epochs: 5
58
+
59
+ ### Training results
60
+
61
+ | Training Loss | Epoch | Step | Validation Loss | Pearsonr |
62
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|
63
+ | No log | 1.0 | 365 | 0.5106 | 0.8429 |
64
+ | 0.1092 | 2.0 | 730 | 0.5466 | 0.8497 |
65
+ | 0.0958 | 3.0 | 1095 | 0.4123 | 0.8680 |
66
+ | 0.0958 | 4.0 | 1460 | 0.4336 | 0.8719 |
67
+ | 0.0661 | 5.0 | 1825 | 0.4274 | 0.8722 |
68
+
69
+
70
+ ### Framework versions
71
+
72
+ - Transformers 4.17.0
73
+ - Pytorch 1.10.0+cu111
74
+ - Datasets 2.0.0
75
+ - Tokenizers 0.11.6