gokulsrinivasagan commited on
Commit
76a8aa4
·
verified ·
1 Parent(s): 1f7003b

Model save

Browse files
README.md CHANGED
@@ -1,32 +1,14 @@
1
  ---
2
  library_name: transformers
3
- language:
4
- - en
5
  base_model: gokulsrinivasagan/bert_tiny_lda_20_v1
6
  tags:
7
  - generated_from_trainer
8
- datasets:
9
- - glue
10
  metrics:
11
  - accuracy
12
  - f1
13
  model-index:
14
  - name: bert_tiny_lda_20_v1_qqp
15
- results:
16
- - task:
17
- name: Text Classification
18
- type: text-classification
19
- dataset:
20
- name: GLUE QQP
21
- type: glue
22
- args: qqp
23
- metrics:
24
- - name: Accuracy
25
- type: accuracy
26
- value: 0.6318327974276527
27
- - name: F1
28
- type: f1
29
- value: 0.0
30
  ---
31
 
32
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -34,12 +16,12 @@ should probably proofread and complete it, then remove this comment. -->
34
 
35
  # bert_tiny_lda_20_v1_qqp
36
 
37
- This model is a fine-tuned version of [gokulsrinivasagan/bert_tiny_lda_20_v1](https://huggingface.co/gokulsrinivasagan/bert_tiny_lda_20_v1) on the GLUE QQP dataset.
38
  It achieves the following results on the evaluation set:
39
- - Loss: 0.6569
40
- - Accuracy: 0.6318
41
- - F1: 0.0
42
- - Combined Score: 0.3159
43
 
44
  ## Model description
45
 
@@ -58,7 +40,7 @@ More information needed
58
  ### Training hyperparameters
59
 
60
  The following hyperparameters were used during training:
61
- - learning_rate: 0.001
62
  - train_batch_size: 256
63
  - eval_batch_size: 256
64
  - seed: 10
@@ -68,16 +50,16 @@ The following hyperparameters were used during training:
68
 
69
  ### Training results
70
 
71
- | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Combined Score |
72
- |:-------------:|:-----:|:-----:|:---------------:|:--------:|:---:|:--------------:|
73
- | 0.6612 | 1.0 | 1422 | 0.6582 | 0.6318 | 0.0 | 0.3159 |
74
- | 0.659 | 2.0 | 2844 | 0.6576 | 0.6318 | 0.0 | 0.3159 |
75
- | 0.6587 | 3.0 | 4266 | 0.6569 | 0.6318 | 0.0 | 0.3159 |
76
- | 0.6585 | 4.0 | 5688 | 0.6574 | 0.6318 | 0.0 | 0.3159 |
77
- | 0.6585 | 5.0 | 7110 | 0.6574 | 0.6318 | 0.0 | 0.3159 |
78
- | 0.6585 | 6.0 | 8532 | 0.6582 | 0.6318 | 0.0 | 0.3159 |
79
- | 0.6585 | 7.0 | 9954 | 0.6573 | 0.6318 | 0.0 | 0.3159 |
80
- | 0.6585 | 8.0 | 11376 | 0.6573 | 0.6318 | 0.0 | 0.3159 |
81
 
82
 
83
  ### Framework versions
 
1
  ---
2
  library_name: transformers
 
 
3
  base_model: gokulsrinivasagan/bert_tiny_lda_20_v1
4
  tags:
5
  - generated_from_trainer
 
 
6
  metrics:
7
  - accuracy
8
  - f1
9
  model-index:
10
  - name: bert_tiny_lda_20_v1_qqp
11
+ results: []
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12
  ---
13
 
14
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
16
 
17
  # bert_tiny_lda_20_v1_qqp
18
 
19
+ This model is a fine-tuned version of [gokulsrinivasagan/bert_tiny_lda_20_v1](https://huggingface.co/gokulsrinivasagan/bert_tiny_lda_20_v1) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.4276
22
+ - Accuracy: 0.8535
23
+ - F1: 0.7964
24
+ - Combined Score: 0.8249
25
 
26
  ## Model description
27
 
 
40
  ### Training hyperparameters
41
 
42
  The following hyperparameters were used during training:
43
+ - learning_rate: 5e-05
44
  - train_batch_size: 256
45
  - eval_batch_size: 256
46
  - seed: 10
 
50
 
51
  ### Training results
52
 
53
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Combined Score |
54
+ |:-------------:|:-----:|:-----:|:---------------:|:--------:|:------:|:--------------:|
55
+ | 0.4896 | 1.0 | 1422 | 0.4397 | 0.7902 | 0.6817 | 0.7359 |
56
+ | 0.3891 | 2.0 | 2844 | 0.3806 | 0.8247 | 0.7674 | 0.7960 |
57
+ | 0.3332 | 3.0 | 4266 | 0.3641 | 0.8355 | 0.7821 | 0.8088 |
58
+ | 0.29 | 4.0 | 5688 | 0.3666 | 0.8448 | 0.7868 | 0.8158 |
59
+ | 0.2535 | 5.0 | 7110 | 0.3724 | 0.8485 | 0.7977 | 0.8231 |
60
+ | 0.2212 | 6.0 | 8532 | 0.3716 | 0.8517 | 0.8042 | 0.8280 |
61
+ | 0.1947 | 7.0 | 9954 | 0.4039 | 0.8528 | 0.8050 | 0.8289 |
62
+ | 0.1711 | 8.0 | 11376 | 0.4276 | 0.8535 | 0.7964 | 0.8249 |
63
 
64
 
65
  ### Framework versions
logs/events.out.tfevents.1733323974.ki-g0008.1207389.24 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cc8b9ebeca2e61cf0ac1a47f068c4dd663ed4151c2c437d4ae4b4e23c0c4ec33
3
- size 9544
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1bf8ec01ff1a5e7dc17a1d26dc8db1888888ac8beb8ab09d885f000b627e6339
3
+ size 10536
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d2772faa910820bf2f6a7c0eb012b1114f9443803dab9a16a5fa7549e5980cd1
3
  size 131856744
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3a0bf24ee3d1eda040885b446aab77cafa82e036e1fedc0d42d6d7541f4dae3e
3
  size 131856744