Hugging Face model: asedmammad/Contextual_KTO_Mistral_PairRM-GGUF
Author: asedmammad
Created: 2024-03-10 22:07:16
Last modified: 2024-03-11 01:54:18
Likes: 2 | Downloads: 278
Tags: gguf, kto, dpo, human feedback, rlhf, preferences, alignment, HALO, halos, rl, rlaif, en, dataset:snorkelai/Snorkel-Mistral-PairRM-DPO-Dataset, arxiv:2402.01306, base_model:ContextualAI/Contextual_KTO_Mistral_PairRM, base_model:quantized:ContextualAI/Contextual_KTO_Mistral_PairRM, license:apache-2.0, region:us, conversational
Base model relation: quantized
Base models: id: ContextualAI/Contextual_KTO_Mistral_PairRM
Card metadata:
base_model: ContextualAI/Contextual_KTO_Mistral_PairRM
inference: no
language: en
license: apache-2.0
tags: kto, dpo, human feedback, rlhf, preferences, alignment, HALO, halos, rl, rlaif
datasets: snorkelai/Snorkel-Mistral-PairRM-DPO-Dataset
metrics: accuracy
model_creator: ContextualAI
model_name: Contextual KTO Mistral PairRM
model_type: mistral
prompt_template: 

{prompt}



quantized_by: Ased Mammad