Model: BKM1804/Nous-Hermes-2-Mistral-7B-DPO-39fb3919-a32f-4912-b8e6-5e6acb35a983-SFT_DPO_apo_sigmoid_rpo
Author: BKM1804
Library: peft
Tags: peft, safetensors, base_model:adapter:NousResearch/Nous-Hermes-2-Mistral-7B-DPO, dpo, lora, transformers, trl, arxiv:1910.09700, base_model:NousResearch/Nous-Hermes-2-Mistral-7B-DPO, region:us
Base models (adapter): id: NousResearch/Nous-Hermes-2-Mistral-7B-DPO
Card metadata: base_model: NousResearch/Nous-Hermes-2-Mistral-7B-DPO
library_name: peft
tags: base_model:adapter:NousResearch/Nous-Hermes-2-Mistral-7B-DPO, dpo, lora, transformers, trl
Likes: 0 | All-time downloads: 2
Created: 2025-07-12 02:32:53