lewtun HF staff lewtun HF staff commited on
Commit
619d056
0 Parent(s):

Duplicate from autoevaluate/binary-classification

Browse files

Co-authored-by: Lewis Tunstall <lewtun@users.noreply.huggingface.co>

.gitattributes ADDED
@@ -0,0 +1,27 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ftz filter=lfs diff=lfs merge=lfs -text
6
+ *.gz filter=lfs diff=lfs merge=lfs -text
7
+ *.h5 filter=lfs diff=lfs merge=lfs -text
8
+ *.joblib filter=lfs diff=lfs merge=lfs -text
9
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
10
+ *.model filter=lfs diff=lfs merge=lfs -text
11
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
12
+ *.onnx filter=lfs diff=lfs merge=lfs -text
13
+ *.ot filter=lfs diff=lfs merge=lfs -text
14
+ *.parquet filter=lfs diff=lfs merge=lfs -text
15
+ *.pb filter=lfs diff=lfs merge=lfs -text
16
+ *.pt filter=lfs diff=lfs merge=lfs -text
17
+ *.pth filter=lfs diff=lfs merge=lfs -text
18
+ *.rar filter=lfs diff=lfs merge=lfs -text
19
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
20
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
21
+ *.tflite filter=lfs diff=lfs merge=lfs -text
22
+ *.tgz filter=lfs diff=lfs merge=lfs -text
23
+ *.wasm filter=lfs diff=lfs merge=lfs -text
24
+ *.xz filter=lfs diff=lfs merge=lfs -text
25
+ *.zip filter=lfs diff=lfs merge=lfs -text
26
+ *.zstandard filter=lfs diff=lfs merge=lfs -text
27
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
.gitignore ADDED
@@ -0,0 +1 @@
 
1
+ checkpoint-*/
README.md ADDED
@@ -0,0 +1,124 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - generated_from_trainer
5
+ datasets:
6
+ - glue
7
+ metrics:
8
+ - accuracy
9
+ model-index:
10
+ - name: autoevaluate-binary-classification
11
+ results:
12
+ - task:
13
+ type: text-classification
14
+ name: Text Classification
15
+ dataset:
16
+ name: glue
17
+ type: glue
18
+ args: sst2
19
+ metrics:
20
+ - type: accuracy
21
+ value: 0.8967889908256881
22
+ name: Accuracy
23
+ - task:
24
+ type: text-classification
25
+ name: Text Classification
26
+ dataset:
27
+ name: glue
28
+ type: glue
29
+ config: sst2
30
+ split: validation
31
+ metrics:
32
+ - type: accuracy
33
+ value: 0.8967889908256881
34
+ name: Accuracy
35
+ verified: true
36
+ verifyToken: >-
37
+ eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYjQ3YmFiNmE0Y2FmNWUwZTQ2NDViMzEzMjk1ZWQyZTkyMDBmNzZkNzhmNWRmZDJiZjc0ZTEzODVhYTRlNmUxZSIsInZlcnNpb24iOjF9.qb-M6CZpsMnr7FGCaSL8vti0sh85bfzuwGqKM5nNW7fcbyi1SbIxDisDxVQ0SmZwl2Plif6lT3bBU9mer1NmCQ
38
+ - type: precision
39
+ value: 0.8898678414096917
40
+ name: Precision
41
+ verified: true
42
+ verifyToken: >-
43
+ eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMjE1MmVmODU2OTYwMTNlZjE5ZjlmY2Y5NTM3M2E4YjQ1MmE5Yjc1OTAwYjIwYWRjNGI5ZmZlZjI5NTYwZWJlYiIsInZlcnNpb24iOjF9.yf-1IHvGFLLBUPwWXCvlxblTTyeTU_KLqRLuCWDKO2coWWFKvGl_dYteujY1bUGqqzX2Ig6geTt0tVi5MuX9Aw
44
+ - type: recall
45
+ value: 0.9099099099099099
46
+ name: Recall
47
+ verified: true
48
+ verifyToken: >-
49
+ eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYTJlYTdlYWFkZDQzZjJjNjdhMDk1ZGYxYWUzNzczNGQ0MmRjMzdkNmQyYTI2YjA4N2RlNDEzN2Y4MDRmMWYwYyIsInZlcnNpb24iOjF9.Hw9PHkve1f8IiZTNAolCMmPpyyFiAOhZO7FhTxlQPGNJ3oUjzJi7S1wxVte0ZLOOXNa-jNfC-x6qOfHbJqbQDA
50
+ - type: auc
51
+ value: 0.9672186789593331
52
+ name: AUC
53
+ verified: true
54
+ verifyToken: >-
55
+ eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMjhiNjBjYzQzNTg2ZDI0MDU4YWIyYjhlYzNjYjg0ODdkNTE5ZmUxNzk0OWQ0ZTFiNDY2OWMxNjVjMzk5ZTg0ZCIsInZlcnNpb24iOjF9.t9A1giBHzuGtEYs4KexQNWuj4QoSQppx30xmB6Thqhs4tE8JpglMyGB2P8KDhCquA-3a2gK2LiVT90VaHUcwAw
56
+ - type: f1
57
+ value: 0.8997772828507795
58
+ name: F1
59
+ verified: true
60
+ verifyToken: >-
61
+ eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiODM4ZWZlNmNmODI5NmI1NmEzYTQ3MDI4ZDUxNjQxZTczY2VmMmY5ODg3OWM3ZjhlZTRlYmJkOTVlZmNkYWMyZiIsInZlcnNpb24iOjF9.P_w0jtDB66s20puJ_hvpad7JPGGgvDHHBhMxhfqmxGKU1oxba_OXgREKOxNzogsPsbXGlq7xtCPoSQSdR9VyCw
62
+ - type: loss
63
+ value: 0.30092036724090576
64
+ name: loss
65
+ verified: true
66
+ verifyToken: >-
67
+ eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNWVhNDQ4ZDEwNzg3NGY0MjdiNmRiZGQ2ZDM5ZTI0MzNlZGZjMTNkY2I2OWIwYjk4MmIyZDk0YjgxYTZmMWE5NSIsInZlcnNpb24iOjF9.5y2feXY4wZUF1xfADCM5JQ4SOqduuUtD_p0BZzkrV7iKoJOvYDtaIpeKcGLHuX6Ikj_Kwx_nPVqBVwK6ALdEAg
68
+ - type: matthews_correlation
69
+ value: 0.793630584795814
70
+ name: matthews_correlation
71
+ verified: true
72
+ verifyToken: >-
73
+ eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMWQxMzk2MzM2NmJiOWMwMGIwZDlkNTNiZmI0MWU1NjBjNTViZjk3YjQxYzU2NTUxMmFkNmM4NTYyOTJjZDQwZCIsInZlcnNpb24iOjF9.Vb_ZGOXUXO2pD0F1UuUczgDr2DusYAMpQF0cm8xpVtPhPIYGQba6AKiDJh12MoeNZIKVMUwi3cmYO1erGsbUAQ
74
+ duplicated_from: autoevaluate/binary-classification
75
+ ---
76
+
77
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
78
+ should probably proofread and complete it, then remove this comment. -->
79
+
80
+ # binary-classification
81
+
82
+ This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the glue dataset.
83
+ It achieves the following results on the evaluation set:
84
+ - Loss: 0.3009
85
+ - Accuracy: 0.8968
86
+
87
+ ## Model description
88
+
89
+ More information needed
90
+
91
+ ## Intended uses & limitations
92
+
93
+ More information needed
94
+
95
+ ## Training and evaluation data
96
+
97
+ More information needed
98
+
99
+ ## Training procedure
100
+
101
+ ### Training hyperparameters
102
+
103
+ The following hyperparameters were used during training:
104
+ - learning_rate: 2e-05
105
+ - train_batch_size: 16
106
+ - eval_batch_size: 16
107
+ - seed: 42
108
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
109
+ - lr_scheduler_type: linear
110
+ - num_epochs: 1
111
+
112
+ ### Training results
113
+
114
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy |
115
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|
116
+ | 0.175 | 1.0 | 4210 | 0.3009 | 0.8968 |
117
+
118
+
119
+ ### Framework versions
120
+
121
+ - Transformers 4.19.2
122
+ - Pytorch 1.11.0+cu113
123
+ - Datasets 2.2.2
124
+ - Tokenizers 0.12.1
config.json ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "autoevaluate/binary-classification",
3
+ "activation": "gelu",
4
+ "architectures": [
5
+ "DistilBertForSequenceClassification"
6
+ ],
7
+ "attention_dropout": 0.1,
8
+ "dim": 768,
9
+ "dropout": 0.1,
10
+ "hidden_dim": 3072,
11
+ "id2label": {
12
+ "0": "negative",
13
+ "1": "positive"
14
+ },
15
+ "initializer_range": 0.02,
16
+ "label2id": {
17
+ "negative": 0,
18
+ "positive": 1
19
+ },
20
+ "max_position_embeddings": 512,
21
+ "model_type": "distilbert",
22
+ "n_heads": 12,
23
+ "n_layers": 6,
24
+ "pad_token_id": 0,
25
+ "problem_type": "single_label_classification",
26
+ "qa_dropout": 0.1,
27
+ "seq_classif_dropout": 0.2,
28
+ "sinusoidal_pos_embds": false,
29
+ "tie_weights_": true,
30
+ "torch_dtype": "float32",
31
+ "transformers_version": "4.19.2",
32
+ "vocab_size": 30522
33
+ }
pytorch_model.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:963067aead7d42427a082cf1ba9c04992c734ab55a4707e1d9518c6011a6e10b
3
+ size 267854321
runs/May25_09-46-24_6bf2abbffa14/1653471998.854079/events.out.tfevents.1653471998.6bf2abbffa14.72.3 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:07e8b8ffad131b4a6e0749ef181a2b07c2e1bd246977f21579728ef92dfd4e22
3
+ size 5218
runs/May25_09-46-24_6bf2abbffa14/events.out.tfevents.1653471998.6bf2abbffa14.72.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:78a71efdecb95d064a94786931a233157cd4eb25ed51ecdaa854a50a9a689388
3
+ size 3813
runs/May25_09-48-27_6bf2abbffa14/1653472114.0545518/events.out.tfevents.1653472114.6bf2abbffa14.72.5 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:52520181277744ffc4ca22771c806209432d379c42e04029e3a7e82ea585fdc6
3
+ size 5218
runs/May25_09-48-27_6bf2abbffa14/events.out.tfevents.1653472114.6bf2abbffa14.72.4 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:86be6008cb24ccb1cfdad1758f474e2a34897e404e91644bfc27c4f13b454e2c
3
+ size 5432
runs/May25_09-48-27_6bf2abbffa14/events.out.tfevents.1653472536.6bf2abbffa14.72.6 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b5eed4f7dbe77a5d23b35dc824dc585f9ac9148609156a531e19c5c157705033
3
+ size 363
special_tokens_map.json ADDED
@@ -0,0 +1 @@
 
1
+ {"unk_token": "[UNK]", "sep_token": "[SEP]", "pad_token": "[PAD]", "cls_token": "[CLS]", "mask_token": "[MASK]"}
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
tokenizer_config.json ADDED
@@ -0,0 +1 @@
 
1
+ {"do_lower_case": true, "unk_token": "[UNK]", "sep_token": "[SEP]", "pad_token": "[PAD]", "cls_token": "[CLS]", "mask_token": "[MASK]", "tokenize_chinese_chars": true, "strip_accents": null, "model_max_length": 512, "special_tokens_map_file": null, "name_or_path": "distilbert-base-uncased", "tokenizer_class": "DistilBertTokenizer"}
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b33780b2a72efeb8dffc41dafe7bf51ae167ca18264032115544bb99b6e124f9
3
+ size 3247
vocab.txt ADDED
The diff for this file is too large to render. See raw diff