Hugging Face model: nyeinchanaung/a5_dpo_qwen2
Author: nyeinchanaung
Created: 2025-03-01 18:24:25
Last modified: 2025-03-02 14:08:55
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 6
Tags: transformers, safetensors, qwen2, text-generation, trl, dpo, conversational, en, dataset:Dahoas/full-hh-rlhf, base_model:Qwen/Qwen2-0.5B-Instruct, base_model:finetune:Qwen/Qwen2-0.5B-Instruct, text-generation-inference, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: Qwen/Qwen2-0.5B-Instruct
Card metadata:
library_name: transformers
tags: trl, dpo
datasets: Dahoas/full-hh-rlhf
language: en
metrics: accuracy
base_model: Qwen/Qwen2-0.5B-Instruct
pipeline_tag: text-generation