Model: alvarobartt/Mistral-7B-v0.1-ORPO-PEFT
Author: alvarobartt
Pipeline: text-generation
Library: peft
Tags: peft, tensorboard, safetensors, mistral, orpo, qlora, trl, text-generation, conversational, en, dataset:alvarobartt/dpo-mix-7k-simplified, dataset:argilla/dpo-mix-7k, arxiv:2403.07691, base_model:mistralai/Mistral-7B-v0.1, base_model:adapter:mistralai/Mistral-7B-v0.1, license:apache-2.0, 4-bit, bitsandbytes, region:us
Base models (adapter): id: mistralai/Mistral-7B-v0.1
Card metadata: license: apache-2.0
datasets: alvarobartt/dpo-mix-7k-simplified, argilla/dpo-mix-7k
base_model: mistralai/Mistral-7B-v0.1
language: en
library_name: peft
pipeline_tag: text-generation
inference: no
tags: orpo, qlora, trl
Likes: 1 | All-time downloads: 59
Created: 2024-03-23 09:30:52