Model: kunjcr2/qwen2.5-0.5b-sft-dpo
Author: kunjcr2
Pipeline: text-generation
Library: peft
Tags: peft, safetensors, lora, sft, dpo, transformers, trl, text-generation, conversational, en, dataset:HuggingFaceH4/ultrachat_200k, dataset:HuggingFaceH4/ultrafeedback_binarized, base_model:Qwen/Qwen2.5-0.5B-Instruct, base_model:adapter:Qwen/Qwen2.5-0.5B-Instruct, license:apache-2.0, region:us
Base models (adapter): id: Qwen/Qwen2.5-0.5B-Instruct
Card metadata: base_model: Qwen/Qwen2.5-0.5B-Instruct
library_name: peft
pipeline_tag: text-generation
tags: lora, sft, dpo, transformers, trl
datasets: HuggingFaceH4/ultrachat_200k, HuggingFaceH4/ultrafeedback_binarized
language: en
license: apache-2.0
Likes: 1 | All-time downloads: 54
Created: 2025-09-23 03:13:56