Hugging Face model: gCao/mistral-7b-dpo-arena
Author: gCao
Created: 2025-06-29 00:37:16
Last modified: 2025-06-29 00:37:26
Library: peft
Likes: 1 | Downloads: 5
Tags: peft, safetensors, fine-tuning, dpo, arena-dataset, lora, rlhf, dataset:lmarena-ai/arena-human-preference-55k, base_model:teknium/OpenHermes-2.5-Mistral-7B, base_model:adapter:teknium/OpenHermes-2.5-Mistral-7B, license:apache-2.0, region:us
Base model relation: adapter
Base models: id: teknium/OpenHermes-2.5-Mistral-7B
Card metadata:
license: apache-2.0
base_model: teknium/OpenHermes-2.5-Mistral-7B
tags: fine-tuning, dpo, arena-dataset, peft, lora, rlhf
datasets: lmarena-ai/arena-human-preference-55k