Hugging Face model: alvarobartt/Mistral-7B-v0.1-ORPO-PEFT
Author: alvarobartt
Created: 2024-03-23 09:30:52
Last modified: 2024-03-23 09:30:53
Pipeline: text-generation
Library: peft
Likes: 1 | Downloads: 9
Tags: peft, tensorboard, safetensors, mistral, orpo, qlora, trl, text-generation, conversational, en, dataset:alvarobartt/dpo-mix-7k-simplified, dataset:argilla/dpo-mix-7k, arxiv:2403.07691, base_model:mistralai/Mistral-7B-v0.1, base_model:adapter:mistralai/Mistral-7B-v0.1, license:apache-2.0, 4-bit, bitsandbytes, region:us
Base model relation: adapter
Base models: id: mistralai/Mistral-7B-v0.1
Card metadata:
license: apache-2.0
datasets: alvarobartt/dpo-mix-7k-simplified, argilla/dpo-mix-7k
base_model: mistralai/Mistral-7B-v0.1
language: en
library_name: peft
pipeline_tag: text-generation
inference: no
tags: orpo, qlora, trl