Hugging Face model: nicholasKluge/Harmless-RewardModel
Author: nicholasKluge
Created: 2024-05-27 09:24:28
Last modified: 2025-06-09 16:32:13
Pipeline: text-classification
Library: transformers
Likes: 2 | Downloads: 6
Tags: transformers, safetensors, roberta, text-classification, reward model, alignment, preference model, RLHF, en, dataset:nicholasKluge/harmless-aira-dataset, dataset:Anthropic/hh-rlhf, base_model:FacebookAI/roberta-base, base_model:finetune:FacebookAI/roberta-base, license:apache-2.0, co2_eq_emissions, text-embeddings-inference, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: FacebookAI/roberta-base
Card metadata:
license: apache-2.0
datasets: nicholasKluge/harmless-aira-dataset, Anthropic/hh-rlhf
language: en
metrics: accuracy
library_name: transformers
pipeline_tag: text-classification
tags: reward model, alignment, preference model, RLHF
co2_eq_emissions: emissions: 220
source: CodeCarbon
training_type: fine-tuning
geographical_location: Singapore
hardware_used: NVIDIA A100-SXM4-40GB
base_model: FacebookAI/roberta-base