Hugging Face model: tensorblock/archangel_sft-dpo_pythia2-8b-GGUF
Author: tensorblock
Created: 2024-12-28 16:17:40
Last modified: 2026-01-27 20:44:46
Likes: 0 | Downloads: 45
Tags: gguf, human feedback, rlhf, preferences, alignment, HALO, halos, dpo, rl, TensorBlock, GGUF, en, dataset:stanfordnlp/SHP, dataset:Anthropic/hh-rlhf, dataset:OpenAssistant/oasst1, base_model:ContextualAI/archangel_sft-dpo_pythia2-8b, base_model:quantized:ContextualAI/archangel_sft-dpo_pythia2-8b, license:apache-2.0, endpoints_compatible, region:us
Base model relation: quantized
Base models: id: ContextualAI/archangel_sft-dpo_pythia2-8b
Card metadata:
license: apache-2.0
datasets: stanfordnlp/SHP, Anthropic/hh-rlhf, OpenAssistant/oasst1
language: en
metrics: accuracy
tags: human feedback, rlhf, preferences, alignment, HALO, halos, dpo, rl, TensorBlock, GGUF
base_model: ContextualAI/archangel_sft-dpo_pythia2-8b