Hugging Face model: psp-dada/Qwen2.5-Math-7B-Uni-DPO
Author: psp-dada
Created: 2026-02-11 18:06:36
Last modified: 2026-02-22 03:00:11
Pipeline: text-generation
Library: transformers
Likes: 1 | Downloads: 9
Tags: transformers, safetensors, qwen2, text-generation, bf16, qwen, RLHF, DPO, en, dataset:psp-dada/Uni-DPO, arxiv:2506.10054, base_model:Qwen/Qwen2.5-Math-7B, base_model:finetune:Qwen/Qwen2.5-Math-7B, license:apache-2.0, text-generation-inference, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: Qwen/Qwen2.5-Math-7B
Card metadata:
license: apache-2.0
datasets: psp-dada/Uni-DPO
language: en
base_model: Qwen/Qwen2.5-Math-7B
pipeline_tag: text-generation
library_name: transformers
tags: bf16, qwen, RLHF, DPO