End of training

README.md

@@ -0,0 +1,78 @@
+---
+license: mit
+base_model: microsoft/DialoGPT-small
+tags:
+- generated_from_trainer
+datasets:
+- crd3
+model-index:
+- name: DialoGPT-small-crd3
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# DialoGPT-small-crd3
+
+This model is a fine-tuned version of [microsoft/DialoGPT-small](https://huggingface.co/microsoft/DialoGPT-small) on the crd3 dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.9150
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 1e-05
+- train_batch_size: 8
+- eval_batch_size: 8
+- seed: 42
+- gradient_accumulation_steps: 4
+- total_train_batch_size: 32
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- lr_scheduler_warmup_steps: 500
+- num_epochs: 7
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss |
+|:-------------:|:-----:|:----:|:---------------:|
+| 2.7219        | 0.41  | 500  | 2.5055          |
+| 2.1998        | 0.82  | 1000 | 2.1320          |
+| 2.0375        | 1.23  | 1500 | 2.0455          |
+| 1.9719        | 1.64  | 2000 | 2.0024          |
+| 1.898         | 2.05  | 2500 | 1.9783          |
+| 1.8977        | 2.46  | 3000 | 1.9598          |
+| 1.8336        | 2.87  | 3500 | 1.9467          |
+| 1.8316        | 3.28  | 4000 | 1.9379          |
+| 1.7895        | 3.69  | 4500 | 1.9316          |
+| 1.777         | 4.11  | 5000 | 1.9267          |
+| 1.7648        | 4.52  | 5500 | 1.9205          |
+| 1.7478        | 4.93  | 6000 | 1.9181          |
+| 1.752         | 5.34  | 6500 | 1.9170          |
+| 1.7284        | 5.75  | 7000 | 1.9158          |
+| 1.7254        | 6.16  | 7500 | 1.9158          |
+| 1.7272        | 6.57  | 8000 | 1.9152          |
+| 1.7252        | 6.98  | 8500 | 1.9150          |
+
+
+### Framework versions
+
+- Transformers 4.33.1
+- Pytorch 2.0.1+cu118
+- Datasets 2.14.5
+- Tokenizers 0.13.3

generation_config.json

@@ -0,0 +1,6 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 50256,
+  "eos_token_id": 50256,
+  "transformers_version": "4.33.1"
+}

special_tokens_map.json

@@ -0,0 +1,24 @@
+{
+  "bos_token": {
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": "<|endoftext|>",
+  "unk_token": {
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer_config.json

@@ -0,0 +1,33 @@
+{
+  "add_bos_token": false,
+  "add_prefix_space": false,
+  "bos_token": {
+    "__type": "AddedToken",
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "clean_up_tokenization_spaces": true,
+  "eos_token": {
+    "__type": "AddedToken",
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "errors": "replace",
+  "model_max_length": 1024,
+  "pad_token": null,
+  "tokenizer_class": "GPT2Tokenizer",
+  "unk_token": {
+    "__type": "AddedToken",
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  }
+}