Hugging Face model: Wan1302/lab22-dpo-adapter-adapter
Author: Wan1302
Created: 2026-05-08 08:37:10
Last modified: 2026-05-08 08:37:15
Library: peft
Likes: 0 | Downloads: 1
Tags: peft, safetensors, dpo, alignment, lora, qwen2.5, vinuni-lab22, vi, en, dataset:argilla/ultrafeedback-binarized-preferences-cleaned, base_model:unsloth/Qwen2.5-3B-bnb-4bit, base_model:adapter:unsloth/Qwen2.5-3B-bnb-4bit, license:apache-2.0, region:us
Base model relation: adapter
Base models: id: unsloth/Qwen2.5-3B-bnb-4bit
Card metadata:
base_model: unsloth/Qwen2.5-3B-bnb-4bit
library_name: peft
license: apache-2.0
datasets: argilla/ultrafeedback-binarized-preferences-cleaned
language: vi, en
tags: dpo, alignment, lora, qwen2.5, vinuni-lab22