blatrie commited on
Commit
990312f
1 Parent(s): 5b80c1b

End of training

Browse files
Files changed (4) hide show
  1. README.md +7 -14
  2. config.json +1 -1
  3. model.safetensors +1 -1
  4. training_args.bin +1 -1
README.md CHANGED
@@ -1,8 +1,6 @@
1
  ---
2
- license: apache-2.0
3
  tags:
4
  - generated_from_trainer
5
- base_model: distilbert/distilgpt2
6
  datasets:
7
  - eli5_category
8
  model-index:
@@ -15,9 +13,13 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  # my_awesome_eli5_clm-model
17
 
18
- This model is a fine-tuned version of [distilbert/distilgpt2](https://huggingface.co/distilbert/distilgpt2) on the eli5_category dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 3.9540
 
 
 
 
21
 
22
  ## Model description
23
 
@@ -36,7 +38,7 @@ More information needed
36
  ### Training hyperparameters
37
 
38
  The following hyperparameters were used during training:
39
- - learning_rate: 2e-05
40
  - train_batch_size: 8
41
  - eval_batch_size: 8
42
  - seed: 42
@@ -44,15 +46,6 @@ The following hyperparameters were used during training:
44
  - lr_scheduler_type: linear
45
  - num_epochs: 3.0
46
 
47
- ### Training results
48
-
49
- | Training Loss | Epoch | Step | Validation Loss |
50
- |:-------------:|:-----:|:----:|:---------------:|
51
- | No log | 1.0 | 273 | 3.9545 |
52
- | 3.9544 | 2.0 | 546 | 3.9522 |
53
- | 3.9544 | 3.0 | 819 | 3.9540 |
54
-
55
-
56
  ### Framework versions
57
 
58
  - Transformers 4.41.2
 
1
  ---
 
2
  tags:
3
  - generated_from_trainer
 
4
  datasets:
5
  - eli5_category
6
  model-index:
 
13
 
14
  # my_awesome_eli5_clm-model
15
 
16
+ This model was trained from scratch on the eli5_category dataset.
17
  It achieves the following results on the evaluation set:
18
+ - eval_loss: 3.8984
19
+ - eval_runtime: 13.3316
20
+ - eval_samples_per_second: 41.48
21
+ - eval_steps_per_second: 5.251
22
+ - step: 0
23
 
24
  ## Model description
25
 
 
38
  ### Training hyperparameters
39
 
40
  The following hyperparameters were used during training:
41
+ - learning_rate: 5e-05
42
  - train_batch_size: 8
43
  - eval_batch_size: 8
44
  - seed: 42
 
46
  - lr_scheduler_type: linear
47
  - num_epochs: 3.0
48
 
 
 
 
 
 
 
 
 
 
49
  ### Framework versions
50
 
51
  - Transformers 4.41.2
config.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "_name_or_path": "distilbert/distilgpt2",
3
  "_num_labels": 1,
4
  "activation_function": "gelu_new",
5
  "architectures": [
 
1
  {
2
+ "_name_or_path": "my_awesome_eli5_clm-model",
3
  "_num_labels": 1,
4
  "activation_function": "gelu_new",
5
  "architectures": [
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ad6c6670f43068133777b1f5530c84ec18eab6a633a4154a5a5c2c14dfba1258
3
  size 327657928
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:39dd531895c705b9d7ea028d3e381144682916cfb58675cd44fb45321cd03c19
3
  size 327657928
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:36be157e396367f5fc54e61a8a1fd6c38d19a55d950a0d0601bd85afd450216f
3
  size 5112
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:901c7624745a99366554d4d37e2c87d4e1f48e3fe16d5f0c63ef33f1652fe6a4
3
  size 5112