Hugging Face model: rinen0721/dpo-cp1000
Author: rinen0721
Created: 2025-01-28 16:15:29
Last modified: 2025-01-28 16:28:26
Library: peft
Likes: 0 | Downloads: 0
Tags: peft, safetensors, arxiv:1910.09700, base_model:mistralai/Mistral-Nemo-Instruct-2407, base_model:adapter:mistralai/Mistral-Nemo-Instruct-2407, region:us
Base model relation: adapter
Base models: id: mistralai/Mistral-Nemo-Instruct-2407
Card metadata:
base_model: mistralai/Mistral-Nemo-Instruct-2407
library_name: peft