Hugging Face model: Nguyen11/lab22-dpo-vn
Author: Nguyen11
Created: 2026-05-08 04:31:12
Last modified: 2026-05-08 14:56:13
Likes: 0 | Downloads: 0
Tags: safetensors, dpo, vietnamese, alignment, lora, dataset:argilla/ultrafeedback-binarized-preferences-cleaned, dataset:5CD-AI/Vietnamese-alpaca-cleaned, base_model:unsloth/Qwen2.5-3B-bnb-4bit, base_model:adapter:unsloth/Qwen2.5-3B-bnb-4bit, region:us
Base model relation: adapter
Base models: id: unsloth/Qwen2.5-3B-bnb-4bit
Card metadata:
base_model: unsloth/Qwen2.5-3B-bnb-4bit
datasets: argilla/ultrafeedback-binarized-preferences-cleaned, 5CD-AI/Vietnamese-alpaca-cleaned
tags: dpo, vietnamese, alignment, lora