Hugging Face model: codenopro/lab22-dpo-vn
Author: codenopro
Created: 2026-06-26 17:08:05
Last modified: 2026-06-26 17:19:42
Pipeline: text-generation
Library: peft
Likes: 0 | Downloads: 4
Tags: peft, safetensors, base_model:adapter:unsloth/Qwen2.5-3B-bnb-4bit, dpo, lora, transformers, trl, unsloth, text-generation, vi, dataset:5CD-AI/Vietnamese-alpaca-gpt4-gg-translated, dataset:argilla/ultrafeedback-binarized-preferences-cleaned, arxiv:1910.09700, base_model:unsloth/Qwen2.5-3B-bnb-4bit, license:apache-2.0, region:us
Base model relation: adapter
Base models: id: unsloth/Qwen2.5-3B-bnb-4bit
Card metadata:
base_model: unsloth/Qwen2.5-3B-bnb-4bit
library_name: peft
pipeline_tag: text-generation
license: apache-2.0
language: vi
datasets: 5CD-AI/Vietnamese-alpaca-gpt4-gg-translated, argilla/ultrafeedback-binarized-preferences-cleaned
tags: base_model:adapter:unsloth/Qwen2.5-3B-bnb-4bit, dpo, lora, transformers, trl, unsloth