Hugging Face model: StevenMup2004/lab22-dpo-vn
Author: StevenMup2004
Created: 2026-05-08 14:41:09
Last modified: 2026-05-08 14:59:50
Library: peft
Likes: 0 | Downloads: 5
Tags: peft, safetensors, dpo, lora, qwen2.5, vietnamese, alignment, kaggle-t4, dataset:5CD-AI/Vietnamese-alpaca-gpt4-gg-translated, dataset:argilla/ultrafeedback-binarized-preferences-cleaned, base_model:unsloth/Qwen2.5-3B-bnb-4bit, base_model:adapter:unsloth/Qwen2.5-3B-bnb-4bit, license:mit, region:us
Base model relation: adapter
Base models: id: unsloth/Qwen2.5-3B-bnb-4bit
Card metadata:
license: mit
base_model: unsloth/Qwen2.5-3B-bnb-4bit
tags: dpo, lora, peft, qwen2.5, vietnamese, alignment, kaggle-t4
datasets: 5CD-AI/Vietnamese-alpaca-gpt4-gg-translated, argilla/ultrafeedback-binarized-preferences-cleaned