Hugging Face model: AIR-hl/Qwen2.5-1.5B-DPO
Author: AIR-hl
Created: 2024-11-18 12:38:10
Last modified: 2025-01-02 06:56:25
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 14
Tags: transformers, tensorboard, safetensors, qwen2, text-generation, trl, qwen, dpo, alignment, custome, chat, conversational, dataset:HuggingFaceH4/ultrafeedback_binarized, base_model:AIR-hl/Qwen2.5-1.5B-ultrachat200k, base_model:finetune:AIR-hl/Qwen2.5-1.5B-ultrachat200k, license:apache-2.0, text-generation-inference, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: AIR-hl/Qwen2.5-1.5B-ultrachat200k
Card metadata:
license: apache-2.0
datasets: HuggingFaceH4/ultrafeedback_binarized
base_model: AIR-hl/Qwen2.5-1.5B-ultrachat200k
pipeline_tag: text-generation
tags: trl, qwen, dpo, alignment, transformers, custome, chat