Model: asedmammad/Contextual_KTO_Mistral_PairRM-GGUF
Author: asedmammad
Tags: gguf, kto, dpo, human feedback, rlhf, preferences, alignment, HALO, halos, rl, rlaif, en, dataset:snorkelai/Snorkel-Mistral-PairRM-DPO-Dataset, arxiv:2402.01306, base_model:ContextualAI/Contextual_KTO_Mistral_PairRM, base_model:quantized:ContextualAI/Contextual_KTO_Mistral_PairRM, license:apache-2.0, region:us, conversational
Base models (quantized): id: ContextualAI/Contextual_KTO_Mistral_PairRM
Card metadata: base_model: ContextualAI/Contextual_KTO_Mistral_PairRM
inference: no
language: en
license: apache-2.0
tags: kto, dpo, human feedback, rlhf, preferences, alignment, HALO, halos, rl, rlaif
datasets: snorkelai/Snorkel-Mistral-PairRM-DPO-Dataset
metrics: accuracy
model_creator: ContextualAI
model_name: Contextual KTO Mistral PairRM
model_type: mistral
prompt_template: 

{prompt}



quantized_by: Ased Mammad
Likes: 2 | All-time downloads: 6834
Created: 2024-03-10 22:07:16