Hugging Face model: npaiker/mistral-7b-dpo-ultrafeedback
Author: npaiker
Created: 2026-05-14 03:49:09
Last modified: 2026-05-14 15:10:24
Library: peft
Likes: 0 | Downloads: 2
Tags: peft, safetensors, mistral, dpo, rlhf, alignment, lora, qlora, en, dataset:openbmb/UltraFeedback, base_model:mistralai/Mistral-7B-v0.1, base_model:adapter:mistralai/Mistral-7B-v0.1, license:apache-2.0, region:us
Base model relation: adapter
Base models: id: mistralai/Mistral-7B-v0.1
Card metadata:
language: en
license: apache-2.0
base_model: mistralai/Mistral-7B-v0.1
tags: mistral, dpo, rlhf, alignment, peft, lora, qlora
datasets: openbmb/UltraFeedback