Hugging Face model: cbyabush/gpt2-dpo-ultrafeedback
Author: cbyabush
Created: 2026-04-26 14:54:41
Last modified: 2026-05-30 06:52:36
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 12
Tags: transformers, safetensors, gpt2, text-generation, dpo, preference-optimization, fine-tuning, alignment, en, dataset:HuggingFaceH4/ultrafeedback_binarized, arxiv:2305.18290, arxiv:2310.01377, base_model:openai-community/gpt2, base_model:finetune:openai-community/gpt2, license:mit, text-generation-inference, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: openai-community/gpt2
Card metadata:
library_name: transformers
tags: dpo, preference-optimization, gpt2, fine-tuning, alignment
language: en
license: mit
base_model: gpt2
datasets: HuggingFaceH4/ultrafeedback_binarized