Hugging Face's logo

TransferGraph
/
moshew_bert-mini-sst2-distilled-finetuned-lora-tweet_eval_irony

Text Classification
PEFT
Safetensors
parquet
Eval Results
Model card Files Community
hilco commited on
Commit
6864d4c
•
1 Parent(s): 28e2169

Finished training.

Browse files
Files changed (3) hide show
  1. README.md +10 -10
  2. adapter_config.json +2 -2
  3. adapter_model.safetensors +1 -1
README.md CHANGED
@@ -22,7 +22,7 @@ model-index:
22
  args: irony
23
  metrics:
24
  - type: accuracy
25
- value: 0.6230366492146597
26
  name: accuracy
27
  ---
28
 
@@ -33,7 +33,7 @@ should probably proofread and complete it, then remove this comment. -->
33
 
34
  This model is a fine-tuned version of [moshew/bert-mini-sst2-distilled](https://huggingface.co/moshew/bert-mini-sst2-distilled) on the tweet_eval dataset.
35
  It achieves the following results on the evaluation set:
36
- - accuracy: 0.6230
37
 
38
  ## Model description
39
 
@@ -65,14 +65,14 @@ The following hyperparameters were used during training:
65
  | accuracy | train_loss | epoch |
66
  |:--------:|:----------:|:-----:|
67
  | 0.5487 | None | 0 |
68
- | 0.5738 | 0.6838 | 0 |
69
- | 0.6262 | 0.6699 | 1 |
70
- | 0.6251 | 0.6563 | 2 |
71
- | 0.6199 | 0.6446 | 3 |
72
- | 0.6188 | 0.6366 | 4 |
73
- | 0.6293 | 0.6367 | 5 |
74
- | 0.6209 | 0.6316 | 6 |
75
- | 0.6230 | 0.6324 | 7 |
76
 
77
 
78
  ### Framework versions
 
22
  args: irony
23
  metrics:
24
  - type: accuracy
25
+ value: 0.6115183246073298
26
  name: accuracy
27
  ---
28
 
 
33
 
34
  This model is a fine-tuned version of [moshew/bert-mini-sst2-distilled](https://huggingface.co/moshew/bert-mini-sst2-distilled) on the tweet_eval dataset.
35
  It achieves the following results on the evaluation set:
36
+ - accuracy: 0.6115
37
 
38
  ## Model description
39
 
 
65
  | accuracy | train_loss | epoch |
66
  |:--------:|:----------:|:-----:|
67
  | 0.5487 | None | 0 |
68
+ | 0.5707 | 0.6844 | 0 |
69
+ | 0.6199 | 0.6719 | 1 |
70
+ | 0.6272 | 0.6578 | 2 |
71
+ | 0.6251 | 0.6474 | 3 |
72
+ | 0.6073 | 0.6398 | 4 |
73
+ | 0.6199 | 0.6383 | 5 |
74
+ | 0.6115 | 0.6333 | 6 |
75
+ | 0.6115 | 0.6347 | 7 |
76
 
77
 
78
  ### Framework versions
adapter_config.json CHANGED
@@ -19,8 +19,8 @@
19
  "rank_pattern": {},
20
  "revision": null,
21
  "target_modules": [
22
- "query",
23
- "value"
24
  ],
25
  "task_type": "SEQ_CLS",
26
  "use_rslora": false
 
19
  "rank_pattern": {},
20
  "revision": null,
21
  "target_modules": [
22
+ "value",
23
+ "query"
24
  ],
25
  "task_type": "SEQ_CLS",
26
  "use_rslora": false
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:74de70c40189d7d77cd84c8fb121261e9ea50e421f37fae846dd040cfd3526e1
3
  size 20824
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:22b128bece8e074593df8b28d0db57e269a37ea9ccc10ae7984c7fff566e918d
3
  size 20824