lucando27 commited on
Commit
e981da2
1 Parent(s): c84edaa

End of training

Browse files
Files changed (2) hide show
  1. README.md +7 -7
  2. model.safetensors +1 -1
README.md CHANGED
@@ -17,7 +17,7 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [distilbert/distilbert-base-uncased](https://huggingface.co/distilbert/distilbert-base-uncased) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.3644
21
  - Matthews Correlation: 0.7689
22
 
23
  ## Model description
@@ -38,8 +38,8 @@ More information needed
38
 
39
  The following hyperparameters were used during training:
40
  - learning_rate: 2e-05
41
- - train_batch_size: 8
42
- - eval_batch_size: 8
43
  - seed: 42
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
@@ -49,13 +49,13 @@ The following hyperparameters were used during training:
49
 
50
  | Training Loss | Epoch | Step | Validation Loss | Matthews Correlation |
51
  |:-------------:|:-----:|:----:|:---------------:|:--------------------:|
52
- | No log | 1.0 | 450 | 0.2765 | 0.7509 |
53
- | 0.3755 | 2.0 | 900 | 0.3644 | 0.7689 |
54
 
55
 
56
  ### Framework versions
57
 
58
- - Transformers 4.41.1
59
- - Pytorch 2.1.2
60
  - Datasets 2.19.1
61
  - Tokenizers 0.19.1
 
17
 
18
  This model is a fine-tuned version of [distilbert/distilbert-base-uncased](https://huggingface.co/distilbert/distilbert-base-uncased) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.3113
21
  - Matthews Correlation: 0.7689
22
 
23
  ## Model description
 
38
 
39
  The following hyperparameters were used during training:
40
  - learning_rate: 2e-05
41
+ - train_batch_size: 16
42
+ - eval_batch_size: 16
43
  - seed: 42
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
 
49
 
50
  | Training Loss | Epoch | Step | Validation Loss | Matthews Correlation |
51
  |:-------------:|:-----:|:----:|:---------------:|:--------------------:|
52
+ | No log | 1.0 | 225 | 0.2997 | 0.7459 |
53
+ | No log | 2.0 | 450 | 0.3113 | 0.7689 |
54
 
55
 
56
  ### Framework versions
57
 
58
+ - Transformers 4.41.0
59
+ - Pytorch 2.3.0+cu121
60
  - Datasets 2.19.1
61
  - Tokenizers 0.19.1
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:51f36bb0d768a8a50670eb0797e35f01f3f7e38fc7ac9e07d1bf63483e66b091
3
  size 267832560
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:26911ae85307a4abba57fcc9690bf9786e33df3920e5c840f242493c94bc6408
3
  size 267832560