Hugging Face model: Karunathilaka123/truthful-qwen-dpo
Author: Karunathilaka123
Created: 2026-03-08 04:14:38
Last modified: 2026-03-09 00:06:01
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 12
Tags: transformers, safetensors, qwen2, text-generation, trl, dpo, conversational, dataset:jondurbin/truthy-dpo-v0.1, dataset:tatsu-lab/alpaca_eval, arxiv:1910.09700, base_model:Qwen/Qwen2.5-0.5B-Instruct, base_model:quantized:Qwen/Qwen2.5-0.5B-Instruct, text-generation-inference, endpoints_compatible, 4-bit, bitsandbytes, region:us
Base model relation: quantized
Base models: id: Qwen/Qwen2.5-0.5B-Instruct
Card metadata:
library_name: transformers
tags: trl, dpo
datasets: jondurbin/truthy-dpo-v0.1, tatsu-lab/alpaca_eval
base_model: Qwen/Qwen2.5-0.5B-Instruct