Hugging Face model: mradermacher/Mistral-7B-Instruct-v0.2-DPO-GGUF
Author: mradermacher
Created: 2024-12-30 14:19:48
Last modified: 2025-07-31 22:43:07
Library: transformers
Likes: 0 | Downloads: 63
Tags: transformers, gguf, alignment-handbook, trl, dpo, generated_from_trainer, en, dataset:Dahoas/full-hh-rlhf, license:apache-2.0, endpoints_compatible, region:us, conversational
Card metadata:
base_model: AmberYifan/Mistral-7B-Instruct-v0.2-DPO
datasets: Dahoas/full-hh-rlhf
language: en
library_name: transformers
license: apache-2.0
mradermacher: readme_rev: 1
quantized_by: mradermacher
tags: alignment-handbook, trl, dpo, generated_from_trainer, trl, dpo, generated_from_trainer