Hugging Face model: kunjcr2/qwen2.5-0.5b-sft-dpo
Author: kunjcr2
Created: 2025-09-23 03:13:56
Last modified: 2025-09-23 03:30:14
Pipeline: text-generation
Library: peft
Likes: 1 | Downloads: 5
Tags: peft, safetensors, lora, sft, dpo, transformers, trl, text-generation, conversational, en, dataset:HuggingFaceH4/ultrachat_200k, dataset:HuggingFaceH4/ultrafeedback_binarized, base_model:Qwen/Qwen2.5-0.5B-Instruct, base_model:adapter:Qwen/Qwen2.5-0.5B-Instruct, license:apache-2.0, region:us
Base model relation: adapter
Base models: id: Qwen/Qwen2.5-0.5B-Instruct
Card metadata:
base_model: Qwen/Qwen2.5-0.5B-Instruct
library_name: peft
pipeline_tag: text-generation
tags: lora, sft, dpo, transformers, trl
datasets: HuggingFaceH4/ultrachat_200k, HuggingFaceH4/ultrafeedback_binarized
language: en
license: apache-2.0