Model: gCao/mistral-7b-dpo-arena
Author: gCao
Library: peft
Tags: peft, safetensors, fine-tuning, dpo, arena-dataset, lora, rlhf, dataset:lmarena-ai/arena-human-preference-55k, base_model:teknium/OpenHermes-2.5-Mistral-7B, base_model:adapter:teknium/OpenHermes-2.5-Mistral-7B, license:apache-2.0, region:us
Base models (adapter): id: teknium/OpenHermes-2.5-Mistral-7B
Card metadata: license: apache-2.0
base_model: teknium/OpenHermes-2.5-Mistral-7B
tags: fine-tuning, dpo, arena-dataset, peft, lora, rlhf
datasets: lmarena-ai/arena-human-preference-55k
Likes: 1 | All-time downloads: 24
Created: 2025-06-29 00:37:16