Hugging Face model: ContextualAI/Contextual_KTO_Mistral_PairRM
Author: ContextualAI
Created: 2024-03-05 00:07:20
Last modified: 2024-04-26 20:31:59
Pipeline: text-generation
Library: transformers
Likes: 33 | Downloads: 61
Tags: transformers, safetensors, mistral, text-generation, human feedback, rlhf, preferences, alignment, HALO, halos, dpo, rl, conversational, en, dataset:snorkelai/Snorkel-Mistral-PairRM-DPO-Dataset, arxiv:2402.01306, license:apache-2.0, text-generation-inference, endpoints_compatible, region:us
Card metadata:
language: en
license: apache-2.0
tags: human feedback, rlhf, preferences, alignment, HALO, halos, dpo, rl
datasets: snorkelai/Snorkel-Mistral-PairRM-DPO-Dataset
metrics: accuracy