Hugging Face's logo

jacobduncan00
/
hackMIT-finetuned-sst2

Text Classification
Transformers
PyTorch
TensorBoard
bert
generated_from_trainer
Inference Endpoints
Model card Files Metrics Community
3
jacobduncan00 commited on
Commit
6870104
•
1 Parent(s): 32401af

add model

Browse files
Files changed (31) hide show
  1. .gitignore +1 -0
  2. README.md +73 -0
  3. config.json +26 -0
  4. pytorch_model.bin +3 -0
  5. runs/Aug24_03-03-08_6de0c2e91e3b/1629774365.2687044/events.out.tfevents.1629774365.6de0c2e91e3b.75.1 +3 -0
  6. runs/Aug24_03-03-08_6de0c2e91e3b/1629774794.4525955/events.out.tfevents.1629774794.6de0c2e91e3b.75.3 +3 -0
  7. runs/Aug24_03-03-08_6de0c2e91e3b/1629775083.725975/events.out.tfevents.1629775083.6de0c2e91e3b.75.5 +3 -0
  8. runs/Aug24_03-03-08_6de0c2e91e3b/1629775639.2917628/events.out.tfevents.1629775639.6de0c2e91e3b.75.7 +3 -0
  9. runs/Aug24_03-03-08_6de0c2e91e3b/1629775677.1104815/events.out.tfevents.1629775677.6de0c2e91e3b.75.9 +3 -0
  10. runs/Aug24_03-03-08_6de0c2e91e3b/1629775775.7185009/events.out.tfevents.1629775775.6de0c2e91e3b.75.11 +3 -0
  11. runs/Aug24_03-03-08_6de0c2e91e3b/1629775884.882755/events.out.tfevents.1629775884.6de0c2e91e3b.75.13 +3 -0
  12. runs/Aug24_03-03-08_6de0c2e91e3b/1629775921.4971952/events.out.tfevents.1629775921.6de0c2e91e3b.75.15 +3 -0
  13. runs/Aug24_03-03-08_6de0c2e91e3b/1629776067.3202193/events.out.tfevents.1629776067.6de0c2e91e3b.75.17 +3 -0
  14. runs/Aug24_03-03-08_6de0c2e91e3b/1629776178.929555/events.out.tfevents.1629776178.6de0c2e91e3b.75.19 +3 -0
  15. runs/Aug24_03-03-08_6de0c2e91e3b/1629777804.3835654/events.out.tfevents.1629777804.6de0c2e91e3b.75.21 +3 -0
  16. runs/Aug24_03-03-08_6de0c2e91e3b/events.out.tfevents.1629774365.6de0c2e91e3b.75.0 +3 -0
  17. runs/Aug24_03-03-08_6de0c2e91e3b/events.out.tfevents.1629774794.6de0c2e91e3b.75.2 +3 -0
  18. runs/Aug24_03-03-08_6de0c2e91e3b/events.out.tfevents.1629775083.6de0c2e91e3b.75.4 +3 -0
  19. runs/Aug24_03-03-08_6de0c2e91e3b/events.out.tfevents.1629775639.6de0c2e91e3b.75.6 +3 -0
  20. runs/Aug24_03-03-08_6de0c2e91e3b/events.out.tfevents.1629775677.6de0c2e91e3b.75.8 +3 -0
  21. runs/Aug24_03-03-08_6de0c2e91e3b/events.out.tfevents.1629775775.6de0c2e91e3b.75.10 +3 -0
  22. runs/Aug24_03-03-08_6de0c2e91e3b/events.out.tfevents.1629775884.6de0c2e91e3b.75.12 +3 -0
  23. runs/Aug24_03-03-08_6de0c2e91e3b/events.out.tfevents.1629775921.6de0c2e91e3b.75.14 +3 -0
  24. runs/Aug24_03-03-08_6de0c2e91e3b/events.out.tfevents.1629776067.6de0c2e91e3b.75.16 +3 -0
  25. runs/Aug24_03-03-08_6de0c2e91e3b/events.out.tfevents.1629776178.6de0c2e91e3b.75.18 +3 -0
  26. runs/Aug24_03-03-08_6de0c2e91e3b/events.out.tfevents.1629777804.6de0c2e91e3b.75.20 +3 -0
  27. special_tokens_map.json +1 -0
  28. tokenizer.json +0 -0
  29. tokenizer_config.json +1 -0
  30. training_args.bin +3 -0
  31. vocab.txt +0 -0
.gitignore ADDED
@@ -0,0 +1 @@
 
1
+ checkpoint-*/
README.md ADDED
@@ -0,0 +1,73 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - generated_from_trainer
4
+ datasets:
5
+ - glue
6
+ metrics:
7
+ - accuracy
8
+ model_index:
9
+ - name: hackMIT-finetuned-sst2
10
+ results:
11
+ - task:
12
+ name: Text Classification
13
+ type: text-classification
14
+ dataset:
15
+ name: glue
16
+ type: glue
17
+ args: sst2
18
+ metric:
19
+ name: Accuracy
20
+ type: accuracy
21
+ value: 0.7970183486238532
22
+ ---
23
+
24
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
25
+ should probably proofread and complete it, then remove this comment. -->
26
+
27
+ # hackMIT-finetuned-sst2
28
+
29
+ This model is a fine-tuned version of [Blaine-Mason/hackMIT-finetuned-sst2](https://huggingface.co/Blaine-Mason/hackMIT-finetuned-sst2) on the glue dataset.
30
+ It achieves the following results on the evaluation set:
31
+ - Loss: 1.0046
32
+ - Accuracy: 0.7970
33
+
34
+ ## Model description
35
+
36
+ More information needed
37
+
38
+ ## Intended uses & limitations
39
+
40
+ More information needed
41
+
42
+ ## Training and evaluation data
43
+
44
+ More information needed
45
+
46
+ ## Training procedure
47
+
48
+ ### Training hyperparameters
49
+
50
+ The following hyperparameters were used during training:
51
+ - learning_rate: 1.7339491016138283e-05
52
+ - train_batch_size: 64
53
+ - eval_batch_size: 16
54
+ - seed: 23
55
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
56
+ - lr_scheduler_type: linear
57
+ - num_epochs: 3
58
+
59
+ ### Training results
60
+
61
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy |
62
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|
63
+ | 0.0652 | 1.0 | 1053 | 0.9837 | 0.7970 |
64
+ | 0.0586 | 2.0 | 2106 | 0.9927 | 0.7959 |
65
+ | 0.0549 | 3.0 | 3159 | 1.0046 | 0.7970 |
66
+
67
+
68
+ ### Framework versions
69
+
70
+ - Transformers 4.9.2
71
+ - Pytorch 1.9.0+cu102
72
+ - Datasets 1.11.0
73
+ - Tokenizers 0.10.3
config.json ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "Blaine-Mason/hackMIT-finetuned-sst2",
3
+ "architectures": [
4
+ "BertForSequenceClassification"
5
+ ],
6
+ "attention_probs_dropout_prob": 0.1,
7
+ "gradient_checkpointing": false,
8
+ "hidden_act": "gelu",
9
+ "hidden_dropout_prob": 0.1,
10
+ "hidden_size": 128,
11
+ "initializer_range": 0.02,
12
+ "intermediate_size": 512,
13
+ "layer_norm_eps": 1e-12,
14
+ "max_position_embeddings": 512,
15
+ "model_type": "bert",
16
+ "num_attention_heads": 2,
17
+ "num_hidden_layers": 2,
18
+ "pad_token_id": 0,
19
+ "position_embedding_type": "absolute",
20
+ "problem_type": "single_label_classification",
21
+ "torch_dtype": "float32",
22
+ "transformers_version": "4.9.2",
23
+ "type_vocab_size": 2,
24
+ "use_cache": true,
25
+ "vocab_size": 30522
26
+ }
pytorch_model.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:07cbe8bf1b94a7ea6d95d174b854676d1ddf5bc870a2d36d73622923ab611dfc
3
+ size 17564583
runs/Aug24_03-03-08_6de0c2e91e3b/1629774365.2687044/events.out.tfevents.1629774365.6de0c2e91e3b.75.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:204916a73bbfbcde305bbae387eac5e07bf70e08c92f580eaa0cbe85b28ad46d
3
+ size 4193
runs/Aug24_03-03-08_6de0c2e91e3b/1629774794.4525955/events.out.tfevents.1629774794.6de0c2e91e3b.75.3 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:119fba6b3bbe6c8b3d40b183a745acd6b2725b1c7381fabd165f739665d93ef4
3
+ size 4193
runs/Aug24_03-03-08_6de0c2e91e3b/1629775083.725975/events.out.tfevents.1629775083.6de0c2e91e3b.75.5 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ca0a6f80a5198e964e849168b4f5d05cd4e40d033c14db180c5271a8126628ae
3
+ size 4193
runs/Aug24_03-03-08_6de0c2e91e3b/1629775639.2917628/events.out.tfevents.1629775639.6de0c2e91e3b.75.7 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f2ddd4050346cd94e47508854181c8b4e1f9ed55318c95c56f7ea2462427490
3
+ size 4193
runs/Aug24_03-03-08_6de0c2e91e3b/1629775677.1104815/events.out.tfevents.1629775677.6de0c2e91e3b.75.9 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e27a31e5762b25c235fdddb43fa8b3658e641c95f2d9f4a788c90de91a5990b
3
+ size 4193
runs/Aug24_03-03-08_6de0c2e91e3b/1629775775.7185009/events.out.tfevents.1629775775.6de0c2e91e3b.75.11 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b32ca0db7ea45a1c0241cec04e3930f078de1b7dcc6580c4ff68915823f26f1d
3
+ size 4193
runs/Aug24_03-03-08_6de0c2e91e3b/1629775884.882755/events.out.tfevents.1629775884.6de0c2e91e3b.75.13 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a2f3197bbd0c9e9632d139de62bfbcf23097ff06091fba1bce6b545d65d9dfcb
3
+ size 4193
runs/Aug24_03-03-08_6de0c2e91e3b/1629775921.4971952/events.out.tfevents.1629775921.6de0c2e91e3b.75.15 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cebaf538317746bfce01e05f33b51d16933659ce0955a7cc6f5d04e3e5af423c
3
+ size 4193
runs/Aug24_03-03-08_6de0c2e91e3b/1629776067.3202193/events.out.tfevents.1629776067.6de0c2e91e3b.75.17 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bf82a06f0e4c5ccf74485f4e8a98bd6eb47e5b22e6c41dd1231645857694ce2a
3
+ size 4193
runs/Aug24_03-03-08_6de0c2e91e3b/1629776178.929555/events.out.tfevents.1629776178.6de0c2e91e3b.75.19 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a25d4a45dfecbb0e65333481fad72e862f55f472f1810d6bb87491671880f88a
3
+ size 4193
runs/Aug24_03-03-08_6de0c2e91e3b/1629777804.3835654/events.out.tfevents.1629777804.6de0c2e91e3b.75.21 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bccab9c95eda29d5b68dd52a860d2162352cfc90a9900a84eb615d2bcc92d048
3
+ size 4193
runs/Aug24_03-03-08_6de0c2e91e3b/events.out.tfevents.1629774365.6de0c2e91e3b.75.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a408fc0513d5e2e7eb9eadc52e091dcb083184c709e06c363c7deadd661aebd
3
+ size 12286
runs/Aug24_03-03-08_6de0c2e91e3b/events.out.tfevents.1629774794.6de0c2e91e3b.75.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d3055d3a89b892551427e60fce17c58d464fef6a591456ff5e77a886fa26e85b
3
+ size 9238
runs/Aug24_03-03-08_6de0c2e91e3b/events.out.tfevents.1629775083.6de0c2e91e3b.75.4 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:65bb1576d925d1c292838c13ec46a389f1f6534f4ef7a6d81d2618a1497c7108
3
+ size 14684
runs/Aug24_03-03-08_6de0c2e91e3b/events.out.tfevents.1629775639.6de0c2e91e3b.75.6 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1f43f4adbc45efbc63b39dc6adddcb32221c83dbb3fdec22682fddf27f6b7f2e
3
+ size 4035
runs/Aug24_03-03-08_6de0c2e91e3b/events.out.tfevents.1629775677.6de0c2e91e3b.75.8 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b75dfbeb2b71888edbbb3fe7cc2a750ac7bf74497f586fa33310229bf0eccafd
3
+ size 5298
runs/Aug24_03-03-08_6de0c2e91e3b/events.out.tfevents.1629775775.6de0c2e91e3b.75.10 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7cd937c1a58d7b7c0403191df95638f6a438a299af0c90212b766ca0b6919b49
3
+ size 5308
runs/Aug24_03-03-08_6de0c2e91e3b/events.out.tfevents.1629775884.6de0c2e91e3b.75.12 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eacd00f413c0629408472f99f4e27d0b29a65de3b67a0a96ce7591087236c9a6
3
+ size 3680
runs/Aug24_03-03-08_6de0c2e91e3b/events.out.tfevents.1629775921.6de0c2e91e3b.75.14 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cc8a4780f4a098049bded6ee03252bc825c586f74d44c665e2fea83feef41fb1
3
+ size 5877
runs/Aug24_03-03-08_6de0c2e91e3b/events.out.tfevents.1629776067.6de0c2e91e3b.75.16 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0865401696e5f70c92acdabd370ae3288ad663350b76e854a0d8dff084a5abb0
3
+ size 5309
runs/Aug24_03-03-08_6de0c2e91e3b/events.out.tfevents.1629776178.6de0c2e91e3b.75.18 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a83555345191b5f1bb3c231bd117a21609bba9f0ae0df78002d0517edfb35354
3
+ size 3993
runs/Aug24_03-03-08_6de0c2e91e3b/events.out.tfevents.1629777804.6de0c2e91e3b.75.20 ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b6267bcf64f2e7983eb0a85260b7cd36f5a47afc59d93c171cf2fc8d65c966d
3
+ size 5309
special_tokens_map.json ADDED
@@ -0,0 +1 @@
 
1
+ {"unk_token": "[UNK]", "sep_token": "[SEP]", "pad_token": "[PAD]", "cls_token": "[CLS]", "mask_token": "[MASK]"}
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
tokenizer_config.json ADDED
@@ -0,0 +1 @@
 
1
+ {"do_lower_case": true, "unk_token": "[UNK]", "sep_token": "[SEP]", "pad_token": "[PAD]", "cls_token": "[CLS]", "mask_token": "[MASK]", "tokenize_chinese_chars": true, "strip_accents": null, "special_tokens_map_file": null, "name_or_path": "HackMIT/double-agent", "do_basic_tokenize": true, "never_split": null, "tokenizer_class": "BertTokenizer"}
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:25e0e5dba4215504877d27897632b8a641ebf03369b026dcab672496a4c4391e
3
+ size 2671
vocab.txt ADDED
The diff for this file is too large to render. See raw diff