Hugging Face model: nevertmr/mistral-7b-qlora-dpo
Author: nevertmr
Created: 2025-03-26 00:00:15
Last modified: 2026-07-16 10:40:35
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 146
Tags: transformers, safetensors, mistral, text-generation, qlora, lora, peft, trl, dpo, bitsandbytes, 4-bit, question-answering, arc, en, dataset:tau/commonsense_qa, dataset:allenai/qasc, dataset:allenai/openbookqa, base_model:mistralai/Mistral-7B-v0.1, base_model:adapter:mistralai/Mistral-7B-v0.1, license:apache-2.0, model-index, endpoints_compatible, region:us
Base model relation: adapter
Base models: id: mistralai/Mistral-7B-v0.1
Card metadata:
license: apache-2.0
language: en
base_model: mistralai/Mistral-7B-v0.1
library_name: transformers
pipeline_tag: text-generation
tags: mistral, qlora, lora, peft, trl, dpo, bitsandbytes, 4-bit, question-answering, arc
datasets: tau/commonsense_qa, allenai/qasc, allenai/openbookqa
metrics: accuracy