Hugging Face model: Rico-Yangzm/task3_dpo_model1_v1
Author: Rico-Yangzm
Created: 2025-08-27 13:39:44
Last modified: 2025-08-27 13:46:33
Pipeline: text-generation
Library: peft
Likes: 0 | Downloads: 0
Tags: peft, safetensors, base_model:adapter:mistralai/Mistral-Nemo-Instruct-2407, dpo, lora, transformers, trl, text-generation, conversational, arxiv:1910.09700, base_model:mistralai/Mistral-Nemo-Instruct-2407, region:us
Base model relation: adapter
Base models: id: mistralai/Mistral-Nemo-Instruct-2407
Card metadata:
base_model: mistralai/Mistral-Nemo-Instruct-2407
library_name: peft
pipeline_tag: text-generation
tags: base_model:adapter:mistralai/Mistral-Nemo-Instruct-2407, dpo, lora, transformers, trl