Hugging Face's logo

tangminhanh
/
subcate-ts

Text Classification
Transformers
TensorBoard
Safetensors
deberta-v2
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
tangminhanh commited on
Commit
a36eaef
•
1 Parent(s): cf473f2

subcate_ts

Browse files
Files changed (11) hide show
  1. README.md +30 -1
  2. model.safetensors +1 -1
  3. runs/Jul05_04-14-41_2e505c004da4/events.out.tfevents.1720152885.2e505c004da4.615.3 +2 -2
  4. runs/Jul05_04-15-37_2e505c004da4/events.out.tfevents.1720152941.2e505c004da4.615.4 +2 -2
  5. runs/Jul05_04-37-53_d62ebf9853d6/events.out.tfevents.1720154280.d62ebf9853d6.4318.0 +3 -0
  6. runs/Jul05_04-38-33_d62ebf9853d6/events.out.tfevents.1720154318.d62ebf9853d6.4318.1 +3 -0
  7. runs/Jul05_04-38-49_d62ebf9853d6/events.out.tfevents.1720154333.d62ebf9853d6.4318.2 +3 -0
  8. runs/Jul05_04-40-12_d62ebf9853d6/events.out.tfevents.1720154416.d62ebf9853d6.4318.3 +3 -0
  9. runs/Jul05_04-41-39_d62ebf9853d6/events.out.tfevents.1720154506.d62ebf9853d6.4318.4 +3 -0
  10. runs/Jul05_04-41-39_d62ebf9853d6/events.out.tfevents.1720158163.d62ebf9853d6.4318.5 +3 -0
  11. training_args.bin +1 -1
README.md CHANGED
@@ -3,6 +3,11 @@ license: mit
3
  base_model: tangminhanh/cate-ts
4
  tags:
5
  - generated_from_trainer
 
 
 
 
 
6
  model-index:
7
  - name: subcate-ts
8
  results: []
@@ -14,6 +19,12 @@ should probably proofread and complete it, then remove this comment. -->
14
  # subcate-ts
15
 
16
  This model is a fine-tuned version of [tangminhanh/cate-ts](https://huggingface.co/tangminhanh/cate-ts) on the None dataset.
 
 
 
 
 
 
17
 
18
  ## Model description
19
 
@@ -33,14 +44,32 @@ More information needed
33
 
34
  The following hyperparameters were used during training:
35
  - learning_rate: 2e-05
36
- - train_batch_size: 32
37
  - eval_batch_size: 32
38
  - seed: 42
 
 
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
  - lr_scheduler_type: linear
41
  - lr_scheduler_warmup_steps: 500
42
  - num_epochs: 10
43
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
44
  ### Framework versions
45
 
46
  - Transformers 4.41.2
 
3
  base_model: tangminhanh/cate-ts
4
  tags:
5
  - generated_from_trainer
6
+ metrics:
7
+ - accuracy
8
+ - f1
9
+ - precision
10
+ - recall
11
  model-index:
12
  - name: subcate-ts
13
  results: []
 
19
  # subcate-ts
20
 
21
  This model is a fine-tuned version of [tangminhanh/cate-ts](https://huggingface.co/tangminhanh/cate-ts) on the None dataset.
22
+ It achieves the following results on the evaluation set:
23
+ - Loss: 0.0130
24
+ - Accuracy: 0.3377
25
+ - F1: 0.4963
26
+ - Precision: 0.9460
27
+ - Recall: 0.3364
28
 
29
  ## Model description
30
 
 
44
 
45
  The following hyperparameters were used during training:
46
  - learning_rate: 2e-05
47
+ - train_batch_size: 16
48
  - eval_batch_size: 32
49
  - seed: 42
50
+ - gradient_accumulation_steps: 4
51
+ - total_train_batch_size: 64
52
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
53
  - lr_scheduler_type: linear
54
  - lr_scheduler_warmup_steps: 500
55
  - num_epochs: 10
56
 
57
+ ### Training results
58
+
59
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Precision | Recall |
60
+ |:-------------:|:------:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
61
+ | 0.8242 | 0.9987 | 188 | 0.2821 | 0.0 | 0.0081 | 0.0046 | 0.0321 |
62
+ | 0.1451 | 1.9973 | 376 | 0.0313 | 0.0 | 0.0 | 0.0 | 0.0 |
63
+ | 0.0298 | 2.9960 | 564 | 0.0231 | 0.0 | 0.0 | 0.0 | 0.0 |
64
+ | 0.024 | 4.0 | 753 | 0.0206 | 0.0 | 0.0 | 0.0 | 0.0 |
65
+ | 0.0212 | 4.9987 | 941 | 0.0181 | 0.1261 | 0.2233 | 0.9922 | 0.1258 |
66
+ | 0.0187 | 5.9973 | 1129 | 0.0162 | 0.2292 | 0.3696 | 0.9664 | 0.2285 |
67
+ | 0.0169 | 6.9960 | 1317 | 0.0147 | 0.3081 | 0.4657 | 0.9646 | 0.3070 |
68
+ | 0.0157 | 8.0 | 1506 | 0.0137 | 0.3184 | 0.4763 | 0.9551 | 0.3172 |
69
+ | 0.0151 | 8.9987 | 1694 | 0.0132 | 0.3310 | 0.4894 | 0.9486 | 0.3298 |
70
+ | 0.0145 | 9.9867 | 1880 | 0.0130 | 0.3377 | 0.4963 | 0.9460 | 0.3364 |
71
+
72
+
73
  ### Framework versions
74
 
75
  - Transformers 4.41.2
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:75aee96ed52186bca068b1545575597637bd8cd238deb97bd5f4a10faeac4b2a
3
  size 568309124
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7efeeac3ab9eeb4ff5bc5d367ebebefe1a860e8d03d50e37ea09fac529dc261e
3
  size 568309124
runs/Jul05_04-14-41_2e505c004da4/events.out.tfevents.1720152885.2e505c004da4.615.3 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fd19fa3509725ede39e18857e44ae775f9413b2d4d182b54e07dd0310a939d62
3
- size 16472
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:27da497086f5381fd1c0368c78f35b70cac8fea32f7d1f4228f3bcfea1e0bfe9
3
+ size 19349
runs/Jul05_04-15-37_2e505c004da4/events.out.tfevents.1720152941.2e505c004da4.615.4 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4853d5a7d8087ad90ada2b4e55c8b80f6328418e42b34e3cac6f475cc0ca4b5b
3
- size 16472
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ac305535a7df4f80791af78106b0f75de9c21d7e74fb2094a0e1f157568d45cb
3
+ size 19349
runs/Jul05_04-37-53_d62ebf9853d6/events.out.tfevents.1720154280.d62ebf9853d6.4318.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af9c197b59654c8539fdcde818ec54a45700f0ef85c5d55e0098f13cfe421b38
3
+ size 19348
runs/Jul05_04-38-33_d62ebf9853d6/events.out.tfevents.1720154318.d62ebf9853d6.4318.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c38221356ccc4d51faf806b788d15518718385dcf5c2c8dff3f4e0f8a0ac3bb2
3
+ size 19349
runs/Jul05_04-38-49_d62ebf9853d6/events.out.tfevents.1720154333.d62ebf9853d6.4318.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c608cea26a7a2170ba9e6ccf1d1a62cb0179ed87994863269d909566d1f504d
3
+ size 19348
runs/Jul05_04-40-12_d62ebf9853d6/events.out.tfevents.1720154416.d62ebf9853d6.4318.3 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c2c8bac41faa5b9eaf11be3a6ea38638594e544bbd7feb025c99160f251f4a9c
3
+ size 38608
runs/Jul05_04-41-39_d62ebf9853d6/events.out.tfevents.1720154506.d62ebf9853d6.4318.4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fd4a1181d884794c49504baf43c34cff5886b2cda19c913381ff6570a7c37149
3
+ size 28220
runs/Jul05_04-41-39_d62ebf9853d6/events.out.tfevents.1720158163.d62ebf9853d6.4318.5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ad067342486b5ac636bcf03f0a5b6558542b490557662a6995c3057216a96f1a
3
+ size 560
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ae1e6e46cafed0b4ccf87006704a5b6270783789b897c32df1ff5a94cdc07e6d
3
  size 5112
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f151e6ee34936b1907d73adf41e137cd299896a81683cceb4e3fa872dfc7a361
3
  size 5112