Hugging Face model: Fizzarolli/sapphia-410m-RM
Author: Fizzarolli
Created: 2024-04-02 21:59:45
Last modified: 2024-04-02 22:11:04
Library: peft
Likes: 0 | Downloads: 2
Tags: peft, safetensors, RLHF, RLAIF, PPO, RM, reward-model, reward_model, dataset:argilla/dpo-mix-7k, base_model:EleutherAI/pythia-410m-deduped, base_model:adapter:EleutherAI/pythia-410m-deduped, license:apache-2.0, region:us
Base model relation: adapter
Base models: id: EleutherAI/pythia-410m-deduped
Card metadata:
library_name: peft
base_model: EleutherAI/pythia-410m-deduped
license: apache-2.0
datasets: argilla/dpo-mix-7k
tags: RLHF, RLAIF, PPO, RM, reward-model, reward_model