Hugging Face model: BKM1804/Nous-Hermes-2-Mistral-7B-DPO-39fb3919-a32f-4912-b8e6-5e6acb35a983-SFT_DPO_apo_sigmoid_rpo
Author: BKM1804
Created: 2025-07-12 02:32:53
Last modified: 2025-07-12 03:24:28
Library: peft
Likes: 0 | Downloads: 2
Tags: peft, safetensors, base_model:adapter:NousResearch/Nous-Hermes-2-Mistral-7B-DPO, dpo, lora, transformers, trl, arxiv:1910.09700, base_model:NousResearch/Nous-Hermes-2-Mistral-7B-DPO, region:us
Base model relation: adapter
Base models: id: NousResearch/Nous-Hermes-2-Mistral-7B-DPO
Card metadata:
base_model: NousResearch/Nous-Hermes-2-Mistral-7B-DPO
library_name: peft
tags: base_model:adapter:NousResearch/Nous-Hermes-2-Mistral-7B-DPO, dpo, lora, transformers, trl