Hugging Face model: sak3E/qwen2.5-1.5b-dpo-truthful
Author: sak3E
Created: 2026-02-23 04:34:52
Last modified: 2026-03-08 15:27:39
Likes: 0 | Downloads: 0
Tags: safetensors, dpo, qlora, truthfulness, alignment, en, base_model:Qwen/Qwen2.5-1.5B-Instruct, base_model:finetune:Qwen/Qwen2.5-1.5B-Instruct, region:us
Base model relation: finetune
Base models: id: Qwen/Qwen2.5-1.5B-Instruct
Card metadata:
language: en
base_model: Qwen/Qwen2.5-1.5B-Instruct
tags: dpo, qlora, truthfulness, alignment