Hugging Face's logo

crossroderick
/
occitan-distilgpt2-medium

Text Generation
Transformers
TensorBoard
Safetensors
gpt2
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Metrics Community
crossroderick commited on
Commit
ee9b369
•
1 Parent(s): e5da712

Model save

Browse files
Files changed (4) hide show
  1. README.md +10 -17
  2. logs/events.out.tfevents.1709547537.AI-Machine.5656.0 +2 -2
  3. model.safetensors +1 -1
  4. saved_model/model.safetensors +1 -1
README.md CHANGED
@@ -1,28 +1,21 @@
1
  ---
2
  license: apache-2.0
 
3
  tags:
4
  - generated_from_trainer
5
- base_model: crossroderick/occitan-distilgpt2-medium
6
  model-index:
7
  - name: occitan-distilgpt2-medium
8
  results: []
9
- widget:
10
- - text: "Adieusatz! Ieu soi Micheu e"
11
- example_title: "Example 1"
12
- - text: "A mon vejaire"
13
- example_title: "Example 2"
14
- - text: "Mercés plan per la"
15
- example_title: "Example 3"
16
- - text: "Vòstres mots son mai"
17
- example_title: "Example 4"
18
  ---
19
- # occitan-distilgpt2-medium
20
 
21
- *Adieusatz brave monde!*
 
22
 
23
- This model is a fine-tuned version of [distilgpt2](https://huggingface.co/distilgpt2) on the Occitan language section of the Wikipedia dataset, and is part of a personal effort to study the Occitan language in an NLP environment. It achieves the following results on the evaluation set:
24
 
25
- - Loss: 2.1597
 
 
26
 
27
  ## Model description
28
 
@@ -55,9 +48,9 @@ The following hyperparameters were used during training:
55
 
56
  | Training Loss | Epoch | Step | Validation Loss |
57
  |:-------------:|:-----:|:----:|:---------------:|
58
- | 2.2727 | 1.0 | 854 | 2.1682 |
59
- | 2.2369 | 2.0 | 1708 | 2.1618 |
60
- | 2.2173 | 3.0 | 2562 | 2.1597 |
61
 
62
 
63
  ### Framework versions
 
1
  ---
2
  license: apache-2.0
3
+ base_model: crossroderick/occitan-distilgpt2-medium
4
  tags:
5
  - generated_from_trainer
 
6
  model-index:
7
  - name: occitan-distilgpt2-medium
8
  results: []
 
 
 
 
 
 
 
 
 
9
  ---
 
10
 
11
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
+ should probably proofread and complete it, then remove this comment. -->
13
 
14
+ # occitan-distilgpt2-medium
15
 
16
+ This model is a fine-tuned version of [crossroderick/occitan-distilgpt2-medium](https://huggingface.co/crossroderick/occitan-distilgpt2-medium) on an unknown dataset.
17
+ It achieves the following results on the evaluation set:
18
+ - Loss: 2.1396
19
 
20
  ## Model description
21
 
 
48
 
49
  | Training Loss | Epoch | Step | Validation Loss |
50
  |:-------------:|:-----:|:----:|:---------------:|
51
+ | 2.2512 | 1.0 | 854 | 2.1453 |
52
+ | 2.2303 | 2.0 | 1708 | 2.1441 |
53
+ | 2.2065 | 3.0 | 2562 | 2.1396 |
54
 
55
 
56
  ### Framework versions
logs/events.out.tfevents.1709547537.AI-Machine.5656.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4fdd521abcd6c0a2670c4ebce2c11a12161025f277b4e90e52f26ec22a2ff507
3
- size 6553
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f3d2be98272863f7142492b94dedc7d80d4d6d1b00c37b8877dc0946787229b
3
+ size 7178
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e7ba72a14c3624e42ecd30f5267167cccc739f6daa6b9ce49222a52ab1802a02
3
  size 327657928
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1c83d1c1597173498a6a6fa66923a3ddae5b7bb642301f896b9b0eddbec2dead
3
  size 327657928
saved_model/model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bbd6bf3643ff44b600a6475eccfb364393fdb534b909dcff742297e2b5117600
3
  size 327657928
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1c83d1c1597173498a6a6fa66923a3ddae5b7bb642301f896b9b0eddbec2dead
3
  size 327657928