Hugging Face's logo

crossroderick
/
occitan-distilgpt2-medium

Text Generation
Transformers
TensorBoard
Safetensors
gpt2
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Metrics Community
crossroderick commited on
Commit
db0cd58
•
1 Parent(s): 6eb6e64

Model save

Browse files
Files changed (4) hide show
  1. README.md +10 -17
  2. logs/events.out.tfevents.1709038344.AI-Machine.5203.0 +2 -2
  3. model.safetensors +1 -1
  4. saved_model/model.safetensors +1 -1
README.md CHANGED
@@ -1,28 +1,21 @@
1
  ---
2
  license: apache-2.0
 
3
  tags:
4
  - generated_from_trainer
5
- base_model: crossroderick/occitan-distilgpt2-medium
6
  model-index:
7
  - name: occitan-distilgpt2-medium
8
  results: []
9
- widget:
10
- - text: "Adieusatz! Ieu soi Micheu e"
11
- example_title: "Example 1"
12
- - text: "A mon vejaire"
13
- example_title: "Example 2"
14
- - text: "Mercés plan per la"
15
- example_title: "Example 3"
16
- - text: "Vòstres mots son mai"
17
- example_title: "Example 4"
18
  ---
19
- # occitan-distilgpt2-medium
20
 
21
- *Adieusatz brave monde!*
 
22
 
23
- This model is a fine-tuned version of [distilgpt2](https://huggingface.co/distilgpt2) on the Occitan language section of the Wikipedia dataset, and is part of a personal effort to study the Occitan language in an NLP environment. It achieves the following results on the evaluation set:
24
 
25
- - Loss: 2.4111
 
 
26
 
27
  ## Model description
28
 
@@ -55,9 +48,9 @@ The following hyperparameters were used during training:
55
 
56
  | Training Loss | Epoch | Step | Validation Loss |
57
  |:-------------:|:-----:|:----:|:---------------:|
58
- | 2.5677 | 1.0 | 812 | 2.4341 |
59
- | 2.5159 | 2.0 | 1625 | 2.4161 |
60
- | 2.4901 | 3.0 | 2436 | 2.4111 |
61
 
62
 
63
  ### Framework versions
 
1
  ---
2
  license: apache-2.0
3
+ base_model: crossroderick/occitan-distilgpt2-medium
4
  tags:
5
  - generated_from_trainer
 
6
  model-index:
7
  - name: occitan-distilgpt2-medium
8
  results: []
 
 
 
 
 
 
 
 
 
9
  ---
 
10
 
11
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
+ should probably proofread and complete it, then remove this comment. -->
13
 
14
+ # occitan-distilgpt2-medium
15
 
16
+ This model is a fine-tuned version of [crossroderick/occitan-distilgpt2-medium](https://huggingface.co/crossroderick/occitan-distilgpt2-medium) on an unknown dataset.
17
+ It achieves the following results on the evaluation set:
18
+ - Loss: 2.3656
19
 
20
  ## Model description
21
 
 
48
 
49
  | Training Loss | Epoch | Step | Validation Loss |
50
  |:-------------:|:-----:|:----:|:---------------:|
51
+ | 2.5123 | 1.0 | 812 | 2.3866 |
52
+ | 2.4579 | 2.0 | 1625 | 2.3721 |
53
+ | 2.4555 | 3.0 | 2436 | 2.3656 |
54
 
55
 
56
  ### Framework versions
logs/events.out.tfevents.1709038344.AI-Machine.5203.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f15a2fe3e25e10d9a72e5d0b0334051badce28da68569b27b00cf7bfa3b0834b
3
- size 6342
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:943b4658ecfa20abcb80fddc58473bd7ee2f78de5194e93ea5f322ff4049ed86
3
+ size 6967
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:aa01898a82964fcb349c03d267279f7a861e6c73830046f887de8dff94495e19
3
  size 327657928
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a4d3065c5890ac7b63610de5468d9e70763fe921b4c07b829d68ab3451f55f40
3
  size 327657928
saved_model/model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f4623b67228352328f94f668acab9e8aecea44114a7bd9c3a534dea987aa09c6
3
  size 327657928
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a4d3065c5890ac7b63610de5468d9e70763fe921b4c07b829d68ab3451f55f40
3
  size 327657928