Hugging Face model: makotonlo/LLM2026_DPO_SFT19_v11
Author: makotonlo
Created: 2026-02-23 14:06:36
Last modified: 2026-02-23 14:06:56
Pipeline: text-generation
Library: peft
Likes: 0 | Downloads: 1
Tags: peft, safetensors, dpo, unsloth, qwen, alignment, lora, text-generation, en, dataset:u-10bei/dpo-dataset, license:apache-2.0, region:us
Card metadata:
base_model: unsloth/qwen2.5-7b-instruct-bnb-4bit
datasets: u-10bei/dpo-dataset
language: en
license: apache-2.0
library_name: peft
pipeline_tag: text-generation
tags: dpo, unsloth, qwen, alignment, lora