Hugging Face model: safouaneelg/gpt-oss-20b_DPO_ultrafeedback-lora
Author: safouaneelg
Created: 2025-09-28 20:04:15
Last modified: 2025-09-28 20:16:38
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 0
Tags: transformers, safetensors, text-generation, dpo, alignment, preference, gpt-oss, fine-tuned, lora, peft, conversational, en, dataset:argilla/ultrafeedback-binarized-preferences-cleaned, base_model:openai/gpt-oss-20b, base_model:adapter:openai/gpt-oss-20b, license:apache-2.0, endpoints_compatible, region:us
Base model relation: adapter
Base models: id: openai/gpt-oss-20b
Card metadata:
model_name: gpt-oss-20b-DPO-ultrafeedback-lora
base_model: openai/gpt-oss-20b
license: apache-2.0
language: en
tags: text-generation, dpo, alignment, preference, gpt-oss, fine-tuned, lora, peft
pipeline_tag: text-generation
library_name: transformers
author: Safouane El Ghazouali
author_email: safouane.elghazouali@gmail.com
model_creator: Safouane El Ghazouali
location: Switzerland
datasets: argilla/ultrafeedback-binarized-preferences-cleaned