Hugging Face model: dactoan123/lab22-dpo-vn
Author: dactoan123
Created: 2026-05-08 05:12:08
Last modified: 2026-05-08 09:25:45
Likes: 0 | Downloads: 0
Tags: safetensors, dpo, alignment, vietnamese, lora, unsloth, vi, dataset:saillab/alpaca-vietnamese-cleaned, dataset:argilla/ultrafeedback-binarized-preferences-cleaned, base_model:unsloth/Qwen2.5-3B-bnb-4bit, base_model:adapter:unsloth/Qwen2.5-3B-bnb-4bit, license:apache-2.0, region:us
Base model relation: adapter
Base models: id: unsloth/Qwen2.5-3B-bnb-4bit
Card metadata:
base_model: unsloth/Qwen2.5-3B-bnb-4bit
datasets: saillab/alpaca-vietnamese-cleaned, argilla/ultrafeedback-binarized-preferences-cleaned
language: vi
tags: dpo, alignment, vietnamese, lora, unsloth
license: apache-2.0