Hugging Face's logo

Zamoranesis
/
mental_bert_classifier

Text Classification
Transformers
PyTorch
bert
Generated from Trainer
Inference Endpoints
Model card Files Community
Zamoranesis commited on
Commit
a9658f4
•
1 Parent(s): 6b117a5

Zamoranesis/mental_bert_classifier

Browse files
Files changed (4) hide show
  1. README.md +18 -18
  2. config.json +10 -10
  3. pytorch_model.bin +1 -1
  4. training_args.bin +1 -1
README.md CHANGED
@@ -17,13 +17,13 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [Zamoranesis/mental_bert](https://huggingface.co/Zamoranesis/mental_bert) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.3709
21
- - F1 Class 0: 0.8475
22
- - F1 Class 1: 0.9157
23
- - F1 Class 2: 0.7692
24
- - F1 Class 3: 0.8764
25
- - F1 Class 4: 0.8772
26
- - F1: 0.8572
27
 
28
  ## Model description
29
 
@@ -42,7 +42,7 @@ More information needed
42
  ### Training hyperparameters
43
 
44
  The following hyperparameters were used during training:
45
- - learning_rate: 0.0005
46
  - train_batch_size: 64
47
  - eval_batch_size: 64
48
  - seed: 42
@@ -56,16 +56,16 @@ The following hyperparameters were used during training:
56
 
57
  | Training Loss | Epoch | Step | Validation Loss | F1 Class 0 | F1 Class 1 | F1 Class 2 | F1 Class 3 | F1 Class 4 | F1 |
58
  |:-------------:|:-----:|:----:|:---------------:|:----------:|:----------:|:----------:|:----------:|:----------:|:------:|
59
- | 1.3938 | 6.25 | 100 | 1.0235 | 0.7458 | 0.8000 | 0.6957 | 0.8315 | 0.8197 | 0.7785 |
60
- | 0.7425 | 12.5 | 200 | 0.6302 | 0.7667 | 0.875 | 0.7755 | 0.8478 | 0.8475 | 0.8225 |
61
- | 0.5225 | 18.75 | 300 | 0.5192 | 0.8276 | 0.9268 | 0.7843 | 0.8667 | 0.8475 | 0.8506 |
62
- | 0.4433 | 25.0 | 400 | 0.4599 | 0.8276 | 0.9157 | 0.7692 | 0.8636 | 0.8475 | 0.8447 |
63
- | 0.3862 | 31.25 | 500 | 0.4208 | 0.8475 | 0.9157 | 0.7692 | 0.8636 | 0.8621 | 0.8516 |
64
- | 0.3702 | 37.5 | 600 | 0.3987 | 0.8475 | 0.9157 | 0.7692 | 0.8764 | 0.8772 | 0.8572 |
65
- | 0.3437 | 43.75 | 700 | 0.3872 | 0.8475 | 0.9157 | 0.7692 | 0.8764 | 0.8772 | 0.8572 |
66
- | 0.337 | 50.0 | 800 | 0.3759 | 0.8475 | 0.9157 | 0.7692 | 0.8764 | 0.8772 | 0.8572 |
67
- | 0.3253 | 56.25 | 900 | 0.3727 | 0.8475 | 0.9157 | 0.7692 | 0.8764 | 0.8772 | 0.8572 |
68
- | 0.3236 | 62.5 | 1000 | 0.3709 | 0.8475 | 0.9157 | 0.7692 | 0.8764 | 0.8772 | 0.8572 |
69
 
70
 
71
  ### Framework versions
 
17
 
18
  This model is a fine-tuned version of [Zamoranesis/mental_bert](https://huggingface.co/Zamoranesis/mental_bert) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.2426
21
+ - F1 Class 0: 0.8852
22
+ - F1 Class 1: 0.9512
23
+ - F1 Class 2: 0.8421
24
+ - F1 Class 3: 0.8539
25
+ - F1 Class 4: 0.9412
26
+ - F1: 0.8947
27
 
28
  ## Model description
29
 
 
42
  ### Training hyperparameters
43
 
44
  The following hyperparameters were used during training:
45
+ - learning_rate: 0.005
46
  - train_batch_size: 64
47
  - eval_batch_size: 64
48
  - seed: 42
 
56
 
57
  | Training Loss | Epoch | Step | Validation Loss | F1 Class 0 | F1 Class 1 | F1 Class 2 | F1 Class 3 | F1 Class 4 | F1 |
58
  |:-------------:|:-----:|:----:|:---------------:|:----------:|:----------:|:----------:|:----------:|:----------:|:------:|
59
+ | 0.7979 | 6.25 | 100 | 0.3557 | 0.8421 | 0.9512 | 0.8214 | 0.8889 | 0.9091 | 0.8825 |
60
+ | 0.2559 | 12.5 | 200 | 0.2823 | 0.9333 | 0.9412 | 0.8364 | 0.8602 | 0.9362 | 0.9015 |
61
+ | 0.1963 | 18.75 | 300 | 0.2610 | 0.9180 | 0.9756 | 0.7778 | 0.8352 | 0.9231 | 0.8859 |
62
+ | 0.1717 | 25.0 | 400 | 0.2534 | 0.9180 | 0.9630 | 0.8 | 0.8261 | 0.9412 | 0.8897 |
63
+ | 0.1511 | 31.25 | 500 | 0.2476 | 0.8667 | 0.9512 | 0.8148 | 0.8298 | 0.96 | 0.8845 |
64
+ | 0.1501 | 37.5 | 600 | 0.2513 | 0.9 | 0.9630 | 0.8 | 0.8261 | 0.9231 | 0.8824 |
65
+ | 0.1427 | 43.75 | 700 | 0.2581 | 0.9180 | 0.9756 | 0.8475 | 0.8810 | 0.8889 | 0.9022 |
66
+ | 0.1457 | 50.0 | 800 | 0.2428 | 0.8852 | 0.9512 | 0.8 | 0.8261 | 0.92 | 0.8765 |
67
+ | 0.1311 | 56.25 | 900 | 0.2462 | 0.9 | 0.9512 | 0.8 | 0.8352 | 0.9231 | 0.8819 |
68
+ | 0.1346 | 62.5 | 1000 | 0.2426 | 0.8852 | 0.9512 | 0.8421 | 0.8539 | 0.9412 | 0.8947 |
69
 
70
 
71
  ### Framework versions
config.json CHANGED
@@ -10,20 +10,20 @@
10
  "hidden_dropout_prob": 0.1,
11
  "hidden_size": 768,
12
  "id2label": {
13
- "0": "LABEL_0",
14
- "1": "LABEL_1",
15
- "2": "LABEL_2",
16
- "3": "LABEL_3",
17
- "4": "LABEL_4"
18
  },
19
  "initializer_range": 0.02,
20
  "intermediate_size": 3072,
21
  "label2id": {
22
- "LABEL_0": 0,
23
- "LABEL_1": 1,
24
- "LABEL_2": 2,
25
- "LABEL_3": 3,
26
- "LABEL_4": 4
27
  },
28
  "layer_norm_eps": 1e-12,
29
  "max_position_embeddings": 512,
 
10
  "hidden_dropout_prob": 0.1,
11
  "hidden_size": 768,
12
  "id2label": {
13
+ "0": "Trastornos de la personalidad antisocial",
14
+ "1": "Trastornos de la personalidad borderline",
15
+ "2": "Trastornos de la personalidad esquizot\u00edpica",
16
+ "3": "Trastornos de la personalidad histri\u00f3nica",
17
+ "4": "Trastornos de la personalidad narcisista"
18
  },
19
  "initializer_range": 0.02,
20
  "intermediate_size": 3072,
21
  "label2id": {
22
+ "Trastornos de la personalidad antisocial": 0,
23
+ "Trastornos de la personalidad borderline": 1,
24
+ "Trastornos de la personalidad esquizot\u00edpica": 2,
25
+ "Trastornos de la personalidad histri\u00f3nica": 3,
26
+ "Trastornos de la personalidad narcisista": 4
27
  },
28
  "layer_norm_eps": 1e-12,
29
  "max_position_embeddings": 512,
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d1ab857dedd1fc10183a7b9067bf200d92cee4def568c5556c70314a7afd32fc
3
  size 438012721
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0520a2a6ad23bb37e7100448d4fd70682c55dcdd9fd02e26bfb46e0faa67ecd3
3
  size 438012721
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6fd4a41631288adc77945297c3e922f783dd3b8d5935c03faa243210690b06e7
3
  size 4091
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b8ce4e118fb1dfe0cc48804922eade7d3fff61db2509f4f8abb12f02e6378a41
3
  size 4091