End of training

README.md

@@ -0,0 +1,15 @@
+---
+base_model: Qwen/Qwen2-0.5B-Instruct
+datasets: dataset_name
+library_name: transformers
+model_name: online-dpo-qwen2-4
+tags:
+- trl
+- online-dpo
+- generated_from_trainer
+licence: license
+---
+
+# Model Card for online-dpo-qwen2-4
+
+This model is a fine-tuned version of [Qwen/Qwen2-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2-0.5B-Instruct) on the https://huggingface.co/datasets/trl-lib/ultrafeedback-prompt dataset.

generation_config.json

@@ -0,0 +1,14 @@
+{
+  "bos_token_id": 151643,
+  "do_sample": true,
+  "eos_token_id": [
+    151645,
+    151643
+  ],
+  "pad_token_id": 151643,
+  "repetition_penalty": 1.1,
+  "temperature": 0.7,
+  "top_k": 20,
+  "top_p": 0.8,
+  "transformers_version": "4.45.0.dev0"
+}