Model: nabeelshan/rlhf-gpt2-pipeline
Author: nabeelshan
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, gpt2, rlhf, reinforcement-learning, ppo, reward-model, instruction-tuning, text-generation, en, dataset:Dahoas/synthetic-instruct-gptj-pairwise, base_model:openai-community/gpt2, base_model:finetune:openai-community/gpt2, license:apache-2.0, model-index, endpoints_compatible, region:us
Base models (finetune): id: openai-community/gpt2
Card metadata: license: apache-2.0
datasets: Dahoas/synthetic-instruct-gptj-pairwise
language: en
base_model: openai-community/gpt2
pipeline_tag: text-generation
library_name: transformers
tags: gpt2, rlhf, reinforcement-learning, ppo, reward-model, instruction-tuning
model-index: name: ppo_aligned_final
results: task: type: text-generation
dataset: type: Dahoas/synthetic-instruct-gptj-pairwise
name: Dahoas/synthetic-instruct-gptj-pairwise
split: evaluation
metrics: type: average_reward
value: 2.37
name: Average Reward Score
verified: no, type: rouge
value: 0.337
name: ROUGE-1
verified: no, type: rouge
value: 0.139
name: ROUGE-2
verified: no, type: rouge
value: 0.252
name: ROUGE-L
verified: no, name: reward_model_final
results: task: type: text-classification
dataset: type: Dahoas/synthetic-instruct-gptj-pairwise
name: Dahoas/synthetic-instruct-gptj-pairwise
split: evaluation
metrics: type: accuracy
value: 0.98
name: Preference Accuracy
verified: no, name: sft_full_final
results: task: type: text-generation
dataset: type: Dahoas/synthetic-instruct-gptj-pairwise
name: Dahoas/synthetic-instruct-gptj-pairwise
split: evaluation
metrics: type: rouge
value: 0.353
name: ROUGE-1
verified: no, type: rouge
value: 0.149
name: ROUGE-2
verified: no, type: rouge
value: 0.262
name: ROUGE-L
verified: no
Likes: 0 | All-time downloads: 0
Created: 2025-09-23 18:38:50