Hugging Face model: fenyo/Qwen2.5-7B-base2instruct-DPO
Author: fenyo
Created: 2026-06-04 13:50:37
Last modified: 2026-06-04 13:56:48
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 7
Tags: transformers, safetensors, qwen2, text-generation, qwen2.5, sft, dpo, trl, instruction-tuning, conversational, fr, en, dataset:allenai/tulu-3-sft-mixture, dataset:HuggingFaceH4/ultrafeedback_binarized, base_model:Qwen/Qwen2.5-7B, base_model:finetune:Qwen/Qwen2.5-7B, license:apache-2.0, text-generation-inference, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: Qwen/Qwen2.5-7B
Card metadata:
license: apache-2.0
base_model: Qwen/Qwen2.5-7B
language: fr, en
library_name: transformers
pipeline_tag: text-generation
tags: qwen2.5, sft, dpo, trl, instruction-tuning
datasets: allenai/tulu-3-sft-mixture, HuggingFaceH4/ultrafeedback_binarized