Hugging Face's logo

KOSMiPOLITA
/
distilbert-base-pl-cased-finetuned-eo

Fill-Mask
Transformers
TensorBoard
Safetensors
distilbert
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
KOSMiPOLITA commited on
Commit
58db0e7
·
1 Parent(s): e477aa9

End of training

Browse files
Files changed (5) hide show
  1. README.md +7 -5
  2. model.safetensors +1 -1
  3. runs/Dec07_18-26-11_711068fa4b4f/events.out.tfevents.1701973578.711068fa4b4f.996.2 +3 -0
  4. runs/Dec07_18-26-11_711068fa4b4f/events.out.tfevents.1701973586.711068fa4b4f.996.3 +3 -0
  5. training_args.bin +1 -1
README.md CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [Geotrend/distilbert-base-pl-cased](https://huggingface.co/Geotrend/distilbert-base-pl-cased) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 3.4612
19
 
20
  ## Model description
21
 
@@ -40,16 +40,18 @@ The following hyperparameters were used during training:
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
- - num_epochs: 3.0
44
  - mixed_precision_training: Native AMP
45
 
46
  ### Training results
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
- | 4.2647 | 1.0 | 2 | 4.1777 |
51
- | 4.101 | 2.0 | 4 | 3.7704 |
52
- | 3.9268 | 3.0 | 6 | 3.2856 |
 
 
53
 
54
 
55
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [Geotrend/distilbert-base-pl-cased](https://huggingface.co/Geotrend/distilbert-base-pl-cased) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 2.5466
19
 
20
  ## Model description
21
 
 
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
+ - num_epochs: 5
44
  - mixed_precision_training: Native AMP
45
 
46
  ### Training results
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
+ | 4.4024 | 1.0 | 2 | 4.5714 |
51
+ | 4.0117 | 2.0 | 4 | 3.6626 |
52
+ | 3.5659 | 3.0 | 6 | 3.2994 |
53
+ | 3.6537 | 4.0 | 8 | 3.4048 |
54
+ | 2.901 | 5.0 | 10 | 3.1939 |
55
 
56
 
57
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1787692a02ad99bd0e55ca226f5d516d401b335ddabb2061d18eb4fa110378b1
3
  size 242962244
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:34f195197c1ba9d03eae3c2bd7667a6a317d76ce89bf7d8e151143f4e607d382
3
  size 242962244
runs/Dec07_18-26-11_711068fa4b4f/events.out.tfevents.1701973578.711068fa4b4f.996.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c35d286491f158ea5f695bf8e4518de2438a4c80b30ccf59186e53b52b6ce581
3
+ size 7401
runs/Dec07_18-26-11_711068fa4b4f/events.out.tfevents.1701973586.711068fa4b4f.996.3 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c8683b91888997456517c1736b2590421f559a499525852bf87f64b8490b935
3
+ size 354
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:438484f0ecc496e9c006a28b246fd067395b12497e2923806521b978f038bf75
3
  size 4600
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63ac14935d1a1482fd8fb13d94425f415d6262c1db889ab5990e4d80bd436588
3
  size 4600