Hugging Face's logo

autobio
/
distilbert-scam-classification-fine-tuned-elder

Text Classification
Transformers
TensorBoard
Safetensors
distilbert
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
autobio commited on
Commit
85aecfd
•
1 Parent(s): c610fe6

End of training

Browse files
Files changed (34) hide show
  1. README.md +75 -0
  2. config.json +33 -0
  3. model.safetensors +3 -0
  4. runs/Apr30_16-47-41_0a69a3a940cf/events.out.tfevents.1714495665.0a69a3a940cf.2425.0 +3 -0
  5. runs/Apr30_16-54-27_0a69a3a940cf/events.out.tfevents.1714496068.0a69a3a940cf.2425.1 +3 -0
  6. runs/Apr30_16-58-55_0a69a3a940cf/events.out.tfevents.1714496336.0a69a3a940cf.2425.2 +3 -0
  7. runs/Apr30_16-59-14_0a69a3a940cf/events.out.tfevents.1714496354.0a69a3a940cf.2425.3 +3 -0
  8. runs/Apr30_16-59-43_0a69a3a940cf/events.out.tfevents.1714496383.0a69a3a940cf.2425.4 +3 -0
  9. runs/Apr30_17-01-47_0a69a3a940cf/events.out.tfevents.1714496507.0a69a3a940cf.2425.5 +3 -0
  10. runs/Apr30_17-02-02_0a69a3a940cf/events.out.tfevents.1714496522.0a69a3a940cf.2425.6 +3 -0
  11. runs/Apr30_17-02-14_0a69a3a940cf/events.out.tfevents.1714496535.0a69a3a940cf.2425.7 +3 -0
  12. runs/Apr30_17-02-34_0a69a3a940cf/events.out.tfevents.1714496555.0a69a3a940cf.2425.8 +3 -0
  13. runs/Apr30_17-03-07_0a69a3a940cf/events.out.tfevents.1714496587.0a69a3a940cf.2425.9 +3 -0
  14. runs/Apr30_17-03-28_0a69a3a940cf/events.out.tfevents.1714496609.0a69a3a940cf.2425.10 +3 -0
  15. runs/Apr30_17-04-11_0a69a3a940cf/events.out.tfevents.1714496652.0a69a3a940cf.2425.11 +3 -0
  16. runs/Apr30_17-04-36_0a69a3a940cf/events.out.tfevents.1714496676.0a69a3a940cf.2425.12 +3 -0
  17. runs/Apr30_17-04-58_0a69a3a940cf/events.out.tfevents.1714496699.0a69a3a940cf.2425.13 +3 -0
  18. runs/Apr30_17-05-44_0a69a3a940cf/events.out.tfevents.1714496745.0a69a3a940cf.2425.14 +3 -0
  19. runs/Apr30_17-06-22_0a69a3a940cf/events.out.tfevents.1714496783.0a69a3a940cf.2425.15 +3 -0
  20. runs/Apr30_17-06-47_0a69a3a940cf/events.out.tfevents.1714496808.0a69a3a940cf.2425.16 +3 -0
  21. runs/Apr30_17-07-15_0a69a3a940cf/events.out.tfevents.1714496836.0a69a3a940cf.2425.17 +3 -0
  22. runs/Apr30_17-07-41_0a69a3a940cf/events.out.tfevents.1714496862.0a69a3a940cf.2425.18 +3 -0
  23. runs/Apr30_17-07-52_0a69a3a940cf/events.out.tfevents.1714496873.0a69a3a940cf.2425.19 +3 -0
  24. runs/Apr30_17-08-26_0a69a3a940cf/events.out.tfevents.1714496907.0a69a3a940cf.2425.20 +3 -0
  25. runs/Apr30_17-08-58_0a69a3a940cf/events.out.tfevents.1714496939.0a69a3a940cf.2425.21 +3 -0
  26. runs/Apr30_17-09-36_0a69a3a940cf/events.out.tfevents.1714496977.0a69a3a940cf.2425.22 +3 -0
  27. runs/Apr30_17-10-17_0a69a3a940cf/events.out.tfevents.1714497018.0a69a3a940cf.2425.23 +3 -0
  28. runs/Apr30_17-10-55_0a69a3a940cf/events.out.tfevents.1714497056.0a69a3a940cf.2425.24 +3 -0
  29. runs/Apr30_17-11-44_0a69a3a940cf/events.out.tfevents.1714497105.0a69a3a940cf.2425.25 +3 -0
  30. special_tokens_map.json +37 -0
  31. tokenizer.json +0 -0
  32. tokenizer_config.json +55 -0
  33. training_args.bin +3 -0
  34. vocab.txt +0 -0
README.md ADDED
@@ -0,0 +1,75 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: BothBosu/distilbert-scam-classification-v1
4
+ tags:
5
+ - generated_from_trainer
6
+ metrics:
7
+ - accuracy
8
+ - precision
9
+ - recall
10
+ - f1
11
+ model-index:
12
+ - name: distilbert-scam-classification-fine-tuned-elder
13
+ results: []
14
+ ---
15
+
16
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
17
+ should probably proofread and complete it, then remove this comment. -->
18
+
19
+ # distilbert-scam-classification-fine-tuned-elder
20
+
21
+ This model is a fine-tuned version of [BothBosu/distilbert-scam-classification-v1](https://huggingface.co/BothBosu/distilbert-scam-classification-v1) on the None dataset.
22
+ It achieves the following results on the evaluation set:
23
+ - Loss: 1.6626
24
+ - Accuracy: 0.925
25
+ - Precision: 0.8889
26
+ - Recall: 0.9412
27
+ - F1: 0.9143
28
+
29
+ ## Model description
30
+
31
+ More information needed
32
+
33
+ ## Intended uses & limitations
34
+
35
+ More information needed
36
+
37
+ ## Training and evaluation data
38
+
39
+ More information needed
40
+
41
+ ## Training procedure
42
+
43
+ ### Training hyperparameters
44
+
45
+ The following hyperparameters were used during training:
46
+ - learning_rate: 0.004
47
+ - train_batch_size: 64
48
+ - eval_batch_size: 32
49
+ - seed: 42
50
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
51
+ - lr_scheduler_type: linear
52
+ - training_steps: 200
53
+
54
+ ### Training results
55
+
56
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy | Precision | Recall | F1 |
57
+ |:-------------:|:-------:|:----:|:---------------:|:--------:|:---------:|:------:|:------:|
58
+ | 0.0 | 6.6667 | 20 | 1.8102 | 0.9 | 0.8421 | 0.9412 | 0.8889 |
59
+ | 0.0 | 13.3333 | 40 | 1.7751 | 0.9 | 0.8421 | 0.9412 | 0.8889 |
60
+ | 0.0 | 20.0 | 60 | 1.7390 | 0.9 | 0.8421 | 0.9412 | 0.8889 |
61
+ | 0.0 | 26.6667 | 80 | 1.7140 | 0.925 | 0.8889 | 0.9412 | 0.9143 |
62
+ | 0.0 | 33.3333 | 100 | 1.7016 | 0.925 | 0.8889 | 0.9412 | 0.9143 |
63
+ | 0.0 | 40.0 | 120 | 1.6990 | 0.925 | 0.8889 | 0.9412 | 0.9143 |
64
+ | 0.0 | 46.6667 | 140 | 1.6819 | 0.925 | 0.8889 | 0.9412 | 0.9143 |
65
+ | 0.0 | 53.3333 | 160 | 1.6602 | 0.925 | 0.8889 | 0.9412 | 0.9143 |
66
+ | 0.0 | 60.0 | 180 | 1.6626 | 0.925 | 0.8889 | 0.9412 | 0.9143 |
67
+ | 0.0 | 66.6667 | 200 | 1.6626 | 0.925 | 0.8889 | 0.9412 | 0.9143 |
68
+
69
+
70
+ ### Framework versions
71
+
72
+ - Transformers 4.40.0
73
+ - Pytorch 2.2.1+cu121
74
+ - Datasets 2.19.0
75
+ - Tokenizers 0.19.1
config.json ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "BothBosu/distilbert-scam-classification-v1",
3
+ "activation": "gelu",
4
+ "architectures": [
5
+ "DistilBertForSequenceClassification"
6
+ ],
7
+ "attention_dropout": 0.1,
8
+ "dim": 768,
9
+ "dropout": 0.1,
10
+ "hidden_dim": 3072,
11
+ "id2label": {
12
+ "0": "NOT_SCAM",
13
+ "1": "SCAM"
14
+ },
15
+ "initializer_range": 0.02,
16
+ "label2id": {
17
+ "NOT_SCAM": 1,
18
+ "SCAM": 0
19
+ },
20
+ "max_position_embeddings": 512,
21
+ "model_type": "distilbert",
22
+ "n_heads": 12,
23
+ "n_layers": 6,
24
+ "pad_token_id": 0,
25
+ "problem_type": "single_label_classification",
26
+ "qa_dropout": 0.1,
27
+ "seq_classif_dropout": 0.2,
28
+ "sinusoidal_pos_embds": false,
29
+ "tie_weights_": true,
30
+ "torch_dtype": "float32",
31
+ "transformers_version": "4.40.0",
32
+ "vocab_size": 30522
33
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:389700c7ddddd13bf08aa61c2d58cbd81c9d8cecbb6c0d7b9ce798aae21a4011
3
+ size 267832560
runs/Apr30_16-47-41_0a69a3a940cf/events.out.tfevents.1714495665.0a69a3a940cf.2425.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fe9298accff8a44eb26a4b57a866880aa9b8bb47f52fc82f484af8a1fd35ea91
3
+ size 4865
runs/Apr30_16-54-27_0a69a3a940cf/events.out.tfevents.1714496068.0a69a3a940cf.2425.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f98a9a630a0416200405ede1fac4a07a27edb91dd4f5aca645f46a60c18ae40c
3
+ size 5213
runs/Apr30_16-58-55_0a69a3a940cf/events.out.tfevents.1714496336.0a69a3a940cf.2425.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:579b21e30d12cf00fbccb0c3f187ce60591275b12155f2c8e4b6b35fefeb4ca1
3
+ size 11502
runs/Apr30_16-59-14_0a69a3a940cf/events.out.tfevents.1714496354.0a69a3a940cf.2425.3 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a16ef8989951c942c6ca9ea9ccdf338d7a2003e55b4f445b524c1a3201e5ded1
3
+ size 11502
runs/Apr30_16-59-43_0a69a3a940cf/events.out.tfevents.1714496383.0a69a3a940cf.2425.4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:07640555441b99d6c3b06b8f8e0b63c2e5cd187afab1117f4522ab5367ab926b
3
+ size 10451
runs/Apr30_17-01-47_0a69a3a940cf/events.out.tfevents.1714496507.0a69a3a940cf.2425.5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c5b588990c56054a2b5662ea8f7d119a6c696322975f4553ba6c67edea856dca
3
+ size 10451
runs/Apr30_17-02-02_0a69a3a940cf/events.out.tfevents.1714496522.0a69a3a940cf.2425.6 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b4c8f2c0b70a6ab0719fdead78c657a9b0cc90eb640a12c9f555d03f0063a3a
3
+ size 10451
runs/Apr30_17-02-14_0a69a3a940cf/events.out.tfevents.1714496535.0a69a3a940cf.2425.7 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e90f73723644a10c94459a08bc7a1e7f86f1a65cf7670d1f62a4712305bbf8e
3
+ size 10452
runs/Apr30_17-02-34_0a69a3a940cf/events.out.tfevents.1714496555.0a69a3a940cf.2425.8 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7216b6793ceabf396bb383d178550317daf4fea5a481ffd980df2feb32bec86b
3
+ size 57988
runs/Apr30_17-03-07_0a69a3a940cf/events.out.tfevents.1714496587.0a69a3a940cf.2425.9 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4586063c7dc31134110edcca24c120b89d1e3a0727298924e304d807ea672cbe
3
+ size 10500
runs/Apr30_17-03-28_0a69a3a940cf/events.out.tfevents.1714496609.0a69a3a940cf.2425.10 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d8164d5b6be2b427cac11e11f74e2c149e5516992db74cf0a34e4dd7985e5956
3
+ size 10501
runs/Apr30_17-04-11_0a69a3a940cf/events.out.tfevents.1714496652.0a69a3a940cf.2425.11 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1d6c12b567a4ae1478790e86a5e22bc9a92c45059bf83eeef5b267aa4814bd50
3
+ size 5074
runs/Apr30_17-04-36_0a69a3a940cf/events.out.tfevents.1714496676.0a69a3a940cf.2425.12 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:61eda52f1202cb61d62de91678d4163a3446b280a83ee574e1e7edc367e4f086
3
+ size 10501
runs/Apr30_17-04-58_0a69a3a940cf/events.out.tfevents.1714496699.0a69a3a940cf.2425.13 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9b779a5ef29f2bcb549cc84fac61b3ce645435c7f911850c04132784865cc785
3
+ size 5074
runs/Apr30_17-05-44_0a69a3a940cf/events.out.tfevents.1714496745.0a69a3a940cf.2425.14 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:60e26fa2cbb96e57e46e81be295f0f040a981ab2ac0b7d6f2defae366c9bcf58
3
+ size 5074
runs/Apr30_17-06-22_0a69a3a940cf/events.out.tfevents.1714496783.0a69a3a940cf.2425.15 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8022196934c44baf96bfc602080f8abd26031acee86c3ad2f444f86cf5a1e121
3
+ size 5074
runs/Apr30_17-06-47_0a69a3a940cf/events.out.tfevents.1714496808.0a69a3a940cf.2425.16 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e6aa75ba3ec7c338a20f5d117b1e0bbdff78224f986709ac1a61842dea5a45dd
3
+ size 11973
runs/Apr30_17-07-15_0a69a3a940cf/events.out.tfevents.1714496836.0a69a3a940cf.2425.17 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e55577464c1351ff8804a50ba3008225222888b666a9fc92be984afa0cd593d
3
+ size 18612
runs/Apr30_17-07-41_0a69a3a940cf/events.out.tfevents.1714496862.0a69a3a940cf.2425.18 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:34ab0a04b5f589569b0268e448c78b55bcba44182b1ffacdc7f0733bf4434b17
3
+ size 18612
runs/Apr30_17-07-52_0a69a3a940cf/events.out.tfevents.1714496873.0a69a3a940cf.2425.19 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:853b1c6bdcc74d5ca26451208df857ecb82b58bd4ae75966eb9ac3972ed4eb92
3
+ size 18612
runs/Apr30_17-08-26_0a69a3a940cf/events.out.tfevents.1714496907.0a69a3a940cf.2425.20 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa6a4a57a8a8fc512dc0344aa0fc9b81c179d70dbb483b991137f1add0a6d521
3
+ size 18613
runs/Apr30_17-08-58_0a69a3a940cf/events.out.tfevents.1714496939.0a69a3a940cf.2425.21 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:feecc40b64cf45441143305cb0477437b3b6eab258b756fbd81dd1d011b7598b
3
+ size 11974
runs/Apr30_17-09-36_0a69a3a940cf/events.out.tfevents.1714496977.0a69a3a940cf.2425.22 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5cd7f2c82916b9b11d08e30fe230687c9b11427ac17511c4b008d36641f0cf9a
3
+ size 11974
runs/Apr30_17-10-17_0a69a3a940cf/events.out.tfevents.1714497018.0a69a3a940cf.2425.23 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b2bb16e54549cebaa4e0dc05feee55e903af41edf6809534d8ba8505b60ee9bb
3
+ size 11975
runs/Apr30_17-10-55_0a69a3a940cf/events.out.tfevents.1714497056.0a69a3a940cf.2425.24 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fac657e3b5d219dcd691ef67d85930c153490172af6ba25df535b014ce11243d
3
+ size 11974
runs/Apr30_17-11-44_0a69a3a940cf/events.out.tfevents.1714497105.0a69a3a940cf.2425.25 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7f6955237ff779af22b39a774221abcaeb00d7298ab99fe7fded772932ec5924
3
+ size 11973
special_tokens_map.json ADDED
@@ -0,0 +1,37 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "cls_token": {
3
+ "content": "[CLS]",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "mask_token": {
10
+ "content": "[MASK]",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "pad_token": {
17
+ "content": "[PAD]",
18
+ "lstrip": false,
19
+ "normalized": false,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "sep_token": {
24
+ "content": "[SEP]",
25
+ "lstrip": false,
26
+ "normalized": false,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ },
30
+ "unk_token": {
31
+ "content": "[UNK]",
32
+ "lstrip": false,
33
+ "normalized": false,
34
+ "rstrip": false,
35
+ "single_word": false
36
+ }
37
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json ADDED
@@ -0,0 +1,55 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "added_tokens_decoder": {
3
+ "0": {
4
+ "content": "[PAD]",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false,
9
+ "special": true
10
+ },
11
+ "100": {
12
+ "content": "[UNK]",
13
+ "lstrip": false,
14
+ "normalized": false,
15
+ "rstrip": false,
16
+ "single_word": false,
17
+ "special": true
18
+ },
19
+ "101": {
20
+ "content": "[CLS]",
21
+ "lstrip": false,
22
+ "normalized": false,
23
+ "rstrip": false,
24
+ "single_word": false,
25
+ "special": true
26
+ },
27
+ "102": {
28
+ "content": "[SEP]",
29
+ "lstrip": false,
30
+ "normalized": false,
31
+ "rstrip": false,
32
+ "single_word": false,
33
+ "special": true
34
+ },
35
+ "103": {
36
+ "content": "[MASK]",
37
+ "lstrip": false,
38
+ "normalized": false,
39
+ "rstrip": false,
40
+ "single_word": false,
41
+ "special": true
42
+ }
43
+ },
44
+ "clean_up_tokenization_spaces": true,
45
+ "cls_token": "[CLS]",
46
+ "do_lower_case": true,
47
+ "mask_token": "[MASK]",
48
+ "model_max_length": 1000000000000000019884624838656,
49
+ "pad_token": "[PAD]",
50
+ "sep_token": "[SEP]",
51
+ "strip_accents": null,
52
+ "tokenize_chinese_chars": true,
53
+ "tokenizer_class": "DistilBertTokenizer",
54
+ "unk_token": "[UNK]"
55
+ }
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e48fa477fc613438445319790a39f95e093320ccfc6f9c586901ae4aaf2de3fc
3
+ size 5048
vocab.txt ADDED
The diff for this file is too large to render. See raw diff