Hugging Face's logo

crossroderick
/
occitan-distilgpt2-medium

Text Generation
Transformers
TensorBoard
Safetensors
gpt2
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Metrics Community
crossroderick commited on
Commit
1775bb7
•
1 Parent(s): 7117503

Model save

Browse files
Files changed (4) hide show
  1. README.md +10 -17
  2. logs/events.out.tfevents.1709290828.AI-Machine.8509.0 +2 -2
  3. model.safetensors +1 -1
  4. saved_model/model.safetensors +1 -1
README.md CHANGED
@@ -1,28 +1,21 @@
1
  ---
2
  license: apache-2.0
 
3
  tags:
4
  - generated_from_trainer
5
- base_model: crossroderick/occitan-distilgpt2-medium
6
  model-index:
7
  - name: occitan-distilgpt2-medium
8
  results: []
9
- widget:
10
- - text: "Adieusatz! Ieu soi Micheu e"
11
- example_title: "Example 1"
12
- - text: "A mon vejaire"
13
- example_title: "Example 2"
14
- - text: "Mercés plan per la"
15
- example_title: "Example 3"
16
- - text: "Vòstres mots son mai"
17
- example_title: "Example 4"
18
  ---
19
- # occitan-distilgpt2-medium
20
 
21
- *Adieusatz brave monde!*
 
22
 
23
- This model is a fine-tuned version of [distilgpt2](https://huggingface.co/distilgpt2) on the Occitan language section of the Wikipedia dataset, and is part of a personal effort to study the Occitan language in an NLP environment. It achieves the following results on the evaluation set:
24
 
25
- - Loss: 2.2427
 
 
26
 
27
  ## Model description
28
 
@@ -55,9 +48,9 @@ The following hyperparameters were used during training:
55
 
56
  | Training Loss | Epoch | Step | Validation Loss |
57
  |:-------------:|:-----:|:----:|:---------------:|
58
- | 2.3735 | 1.0 | 812 | 2.2565 |
59
- | 2.3359 | 2.0 | 1625 | 2.2457 |
60
- | 2.314 | 3.0 | 2436 | 2.2427 |
61
 
62
 
63
  ### Framework versions
 
1
  ---
2
  license: apache-2.0
3
+ base_model: crossroderick/occitan-distilgpt2-medium
4
  tags:
5
  - generated_from_trainer
 
6
  model-index:
7
  - name: occitan-distilgpt2-medium
8
  results: []
 
 
 
 
 
 
 
 
 
9
  ---
 
10
 
11
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
+ should probably proofread and complete it, then remove this comment. -->
13
 
14
+ # occitan-distilgpt2-medium
15
 
16
+ This model is a fine-tuned version of [crossroderick/occitan-distilgpt2-medium](https://huggingface.co/crossroderick/occitan-distilgpt2-medium) on an unknown dataset.
17
+ It achieves the following results on the evaluation set:
18
+ - Loss: 2.2236
19
 
20
  ## Model description
21
 
 
48
 
49
  | Training Loss | Epoch | Step | Validation Loss |
50
  |:-------------:|:-----:|:----:|:---------------:|
51
+ | 2.3582 | 1.0 | 854 | 2.2356 |
52
+ | 2.3228 | 2.0 | 1708 | 2.2261 |
53
+ | 2.286 | 3.0 | 2562 | 2.2236 |
54
 
55
 
56
  ### Framework versions
logs/events.out.tfevents.1709290828.AI-Machine.8509.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:db7b023aa2b0bc1572be218f68f46316c83de2060b5f463580f10796eae26a86
3
- size 6553
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:114d604ca0441723fc040049e5ad24d13d20bf2ee25e16ffc3aae6aaf767d0b7
3
+ size 7178
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e4c27aa7170994b60d404d45c39a5c886dc24a77a22c4218ce4ad35321583ac0
3
  size 327657928
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:78b811925270aa856f404af7dfa4ca95a4e889c670f2fe4a92addf5cd5d3782e
3
  size 327657928
saved_model/model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1ac1abeaeb36e503c3372ab08e971bbdc2b84fd18a5809de45f5606308957350
3
  size 327657928
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:78b811925270aa856f404af7dfa4ca95a4e889c670f2fe4a92addf5cd5d3782e
3
  size 327657928