arincon commited on
Commit
76b80db
1 Parent(s): f2dffea

arincon/ia-detection-distilbert-base-cased

Browse files
README.md ADDED
@@ -0,0 +1,94 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - generated_from_trainer
5
+ datasets:
6
+ - autextification2023
7
+ metrics:
8
+ - accuracy
9
+ - f1
10
+ - precision
11
+ - recall
12
+ model-index:
13
+ - name: ia-detection-distilbert-base-cased
14
+ results:
15
+ - task:
16
+ name: Text Classification
17
+ type: text-classification
18
+ dataset:
19
+ name: autextification2023
20
+ type: autextification2023
21
+ config: detection_en
22
+ split: train
23
+ args: detection_en
24
+ metrics:
25
+ - name: Accuracy
26
+ type: accuracy
27
+ value: 0.6757969952363503
28
+ - name: F1
29
+ type: f1
30
+ value: 0.7481855699444998
31
+ - name: Precision
32
+ type: precision
33
+ value: 0.6215273673010995
34
+ - name: Recall
35
+ type: recall
36
+ value: 0.9396782841823056
37
+ ---
38
+
39
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
40
+ should probably proofread and complete it, then remove this comment. -->
41
+
42
+ # ia-detection-distilbert-base-cased
43
+
44
+ This model is a fine-tuned version of [distilbert-base-cased](https://huggingface.co/distilbert-base-cased) on the autextification2023 dataset.
45
+ It achieves the following results on the evaluation set:
46
+ - Loss: 1.1147
47
+ - Accuracy: 0.6758
48
+ - F1: 0.7482
49
+ - Precision: 0.6215
50
+ - Recall: 0.9397
51
+
52
+ ## Model description
53
+
54
+ More information needed
55
+
56
+ ## Intended uses & limitations
57
+
58
+ More information needed
59
+
60
+ ## Training and evaluation data
61
+
62
+ More information needed
63
+
64
+ ## Training procedure
65
+
66
+ ### Training hyperparameters
67
+
68
+ The following hyperparameters were used during training:
69
+ - learning_rate: 0.0001
70
+ - train_batch_size: 8
71
+ - eval_batch_size: 8
72
+ - seed: 42
73
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
74
+ - lr_scheduler_type: linear
75
+ - lr_scheduler_warmup_steps: 500
76
+ - num_epochs: 10
77
+
78
+ ### Training results
79
+
80
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Precision | Recall |
81
+ |:-------------:|:-----:|:-----:|:---------------:|:--------:|:------:|:---------:|:------:|
82
+ | 0.4298 | 1.0 | 3808 | 0.5010 | 0.7725 | 0.8114 | 0.6964 | 0.9718 |
83
+ | 0.4464 | 2.0 | 7616 | 0.4737 | 0.8514 | 0.8531 | 0.8493 | 0.8568 |
84
+ | 0.4296 | 3.0 | 11424 | 0.4870 | 0.8402 | 0.8424 | 0.8363 | 0.8486 |
85
+ | 0.2034 | 4.0 | 15232 | 0.5404 | 0.8493 | 0.8510 | 0.8475 | 0.8545 |
86
+ | 0.0803 | 5.0 | 19040 | 0.6954 | 0.8520 | 0.8491 | 0.8724 | 0.8269 |
87
+
88
+
89
+ ### Framework versions
90
+
91
+ - Transformers 4.26.1
92
+ - Pytorch 2.1.0+cu118
93
+ - Datasets 2.14.6
94
+ - Tokenizers 0.13.3
logs/events.out.tfevents.1698511951.d166cdf16996.1077.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4926829424b3bd31ee9e1cf4f9587a2cfa22e0dffadd7589aa7443d9bd436da8
3
- size 306068
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:24095b9e3357272218479a445f44f36d0a805450c8f90e6b132cd6251160202c
3
+ size 306428
logs/events.out.tfevents.1698513621.d166cdf16996.1077.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:92782b45504ede9a2e66ac15e9c379514222cc56a516c5f651662177be92c8bf
3
+ size 569
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5b2b8feabfbec05c1ee573f8c3029728d82b68c679f9cf7f91d742e52fa33ab9
3
  size 263168106
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:39fd9f533c754eb7410e9e8c8bf69aab523f8458fac95497811ff68a8fb299bf
3
  size 263168106
special_tokens_map.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "cls_token": "[CLS]",
3
+ "mask_token": "[MASK]",
4
+ "pad_token": "[PAD]",
5
+ "sep_token": "[SEP]",
6
+ "unk_token": "[UNK]"
7
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "cls_token": "[CLS]",
3
+ "do_lower_case": false,
4
+ "mask_token": "[MASK]",
5
+ "model_max_length": 512,
6
+ "name_or_path": "distilbert-base-cased",
7
+ "pad_token": "[PAD]",
8
+ "sep_token": "[SEP]",
9
+ "special_tokens_map_file": null,
10
+ "strip_accents": null,
11
+ "tokenize_chinese_chars": true,
12
+ "tokenizer_class": "DistilBertTokenizer",
13
+ "unk_token": "[UNK]"
14
+ }
vocab.txt ADDED
The diff for this file is too large to render. See raw diff