Hugging Face model: ContextualAI/archangel_sft-kto_pythia1-4b
Author: ContextualAI
Created: 2023-12-03 03:09:24
Last modified: 2024-01-11 19:34:42
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 17
Tags: transformers, safetensors, gpt_neox, text-generation, human feedback, rlhf, preferences, alignment, HALO, halos, dpo, rl, en, dataset:stanfordnlp/SHP, dataset:Anthropic/hh-rlhf, dataset:OpenAssistant/oasst1, license:apache-2.0, text-generation-inference, endpoints_compatible, region:us
Card metadata:
license: apache-2.0
datasets: stanfordnlp/SHP, Anthropic/hh-rlhf, OpenAssistant/oasst1
language: en
metrics: accuracy
tags: human feedback, rlhf, preferences, alignment, HALO, halos, dpo, rl