Hugging Face's logo

nickprock
/
distilbert-base-uncased-banking77-classification

Text Classification
Transformers
PyTorch
TensorBoard
Safetensors
distilbert
generated_from_trainer
Eval Results
Inference Endpoints
Model card Files Metrics Community
7
nickprock commited on
Commit
2efdb7a
•
1 Parent(s): 4021ee0

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +92 -0
README.md ADDED
@@ -0,0 +1,92 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - generated_from_trainer
5
+ datasets:
6
+ - banking77
7
+ metrics:
8
+ - accuracy
9
+ model-index:
10
+ - name: distilbert-base-uncased-banking77-classification
11
+ results:
12
+ - task:
13
+ name: Text Classification
14
+ type: text-classification
15
+ dataset:
16
+ name: banking77
17
+ type: banking77
18
+ args: default
19
+ metrics:
20
+ - name: Accuracy
21
+ type: accuracy
22
+ value: 0.924025974025974
23
+ ---
24
+
25
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
26
+ should probably proofread and complete it, then remove this comment. -->
27
+
28
+ # distilbert-base-uncased-banking77-classification
29
+
30
+ This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the banking77 dataset.
31
+ It achieves the following results on the evaluation set:
32
+ - Loss: 0.3152
33
+ - Accuracy: 0.9240
34
+ - F1 Score: 0.9243
35
+
36
+ ## Model description
37
+
38
+ More information needed
39
+
40
+ ## Intended uses & limitations
41
+
42
+ More information needed
43
+
44
+ ## Training and evaluation data
45
+
46
+ More information needed
47
+
48
+ ## Training procedure
49
+
50
+ ### Training hyperparameters
51
+
52
+ The following hyperparameters were used during training:
53
+ - learning_rate: 2e-05
54
+ - train_batch_size: 64
55
+ - eval_batch_size: 64
56
+ - seed: 42
57
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
58
+ - lr_scheduler_type: linear
59
+ - num_epochs: 20
60
+
61
+ ### Training results
62
+
63
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 Score |
64
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|:--------:|
65
+ | 3.8732 | 1.0 | 157 | 3.1476 | 0.5370 | 0.4881 |
66
+ | 2.5598 | 2.0 | 314 | 1.9780 | 0.6916 | 0.6585 |
67
+ | 1.5863 | 3.0 | 471 | 1.2239 | 0.8042 | 0.7864 |
68
+ | 0.9829 | 4.0 | 628 | 0.8067 | 0.8565 | 0.8487 |
69
+ | 0.6274 | 5.0 | 785 | 0.5837 | 0.8799 | 0.8752 |
70
+ | 0.4304 | 6.0 | 942 | 0.4630 | 0.9042 | 0.9040 |
71
+ | 0.3106 | 7.0 | 1099 | 0.3982 | 0.9088 | 0.9087 |
72
+ | 0.2238 | 8.0 | 1256 | 0.3587 | 0.9110 | 0.9113 |
73
+ | 0.1708 | 9.0 | 1413 | 0.3351 | 0.9208 | 0.9208 |
74
+ | 0.1256 | 10.0 | 1570 | 0.3242 | 0.9179 | 0.9182 |
75
+ | 0.0981 | 11.0 | 1727 | 0.3136 | 0.9211 | 0.9214 |
76
+ | 0.0745 | 12.0 | 1884 | 0.3151 | 0.9211 | 0.9213 |
77
+ | 0.0601 | 13.0 | 2041 | 0.3089 | 0.9218 | 0.9220 |
78
+ | 0.0482 | 14.0 | 2198 | 0.3158 | 0.9214 | 0.9216 |
79
+ | 0.0402 | 15.0 | 2355 | 0.3126 | 0.9224 | 0.9226 |
80
+ | 0.0344 | 16.0 | 2512 | 0.3143 | 0.9231 | 0.9233 |
81
+ | 0.0298 | 17.0 | 2669 | 0.3156 | 0.9231 | 0.9233 |
82
+ | 0.0272 | 18.0 | 2826 | 0.3134 | 0.9244 | 0.9247 |
83
+ | 0.0237 | 19.0 | 2983 | 0.3156 | 0.9244 | 0.9246 |
84
+ | 0.0229 | 20.0 | 3140 | 0.3152 | 0.9240 | 0.9243 |
85
+
86
+
87
+ ### Framework versions
88
+
89
+ - Transformers 4.20.1
90
+ - Pytorch 1.12.0+cu113
91
+ - Datasets 2.3.2
92
+ - Tokenizers 0.12.1