End of training

README.md

@@ -0,0 +1,58 @@
+---
+base_model: distilgpt2
+tags:
+- generated_from_trainer
+model-index:
+- name: distilgpt2-finetuned-wikitext2
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# distilgpt2-finetuned-wikitext2
+
+This model is a fine-tuned version of [distilgpt2](https://huggingface.co/distilgpt2) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 3.0516
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 2e-05
+- train_batch_size: 8
+- eval_batch_size: 8
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 3.0
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss |
+|:-------------:|:-----:|:----:|:---------------:|
+| No log        | 1.0   | 125  | 3.1057          |
+| No log        | 2.0   | 250  | 3.0618          |
+| No log        | 3.0   | 375  | 3.0516          |
+
+
+### Framework versions
+
+- Transformers 4.40.0.dev0
+- Pytorch 2.2.1+cu121
+- Datasets 2.18.0
+- Tokenizers 0.15.2

generation_config.json

@@ -0,0 +1,6 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 50256,
+  "eos_token_id": 50256,
+  "transformers_version": "4.40.0.dev0"
+}

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:64bc1213493e3278e493bfe680835bec007476ce434c6114a75e75149cc2c0b9
+oid sha256:5d8d81effadc4ea1aff313acf2a2727983e2a295dffe48dc8d8f0f04dda20056
 size 327657928

runs/Apr05_10-57-49_wen/events.out.tfevents.1712285874.wen.639.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7bf8ddccd54fa408599596a1df4bd40e10945d3cec5102e28dfdd1732f467104
+size 4971

runs/Apr05_11-30-35_wen/events.out.tfevents.1712287840.wen.18051.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4a39dab9d396a14254401f82390b46669322e8fa386199667d4ba1e2525363a7
+size 4971

runs/Apr05_11-33-53_wen/events.out.tfevents.1712288038.wen.18051.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7f936b947510ddb829bc3e56c96d759ac0859900fe553df1d597bf59c04887bd
+size 4971

runs/Apr05_13-37-04_wen/events.out.tfevents.1712295446.wen.18051.2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:656badcc86d904bf83199724072165455f9474bfc93589e5e14e287b0b94936e
+size 6117

runs/Apr05_13-37-04_wen/events.out.tfevents.1712295990.wen.18051.3

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ca269162b4ca50312d3f25633ddd5e16301e32ed8c333f023e37b118ebb60fae
+size 6133

runs/Apr05_13-37-04_wen/events.out.tfevents.1712299757.wen.18051.4

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:17bac2cb82df86ee701e663158012c909998bbbfa1ddee01b57f1c19f5c2d609
+size 901

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5b845d230318adbea4546e061c23a1b5db42b3da52d427627bd441bdb3fe407b
+oid sha256:e83125a90b3b1b132963ec836663ee1e2bce000933f6277a83ac253ffe1b9060
 size 4920