Model: g8a9/tweety-mistral-7b-dpo
Author: g8a9
Library: peft
Tags: peft, tensorboard, safetensors, mistral, alignment-handbook, generated_from_trainer, dataset:giux78/ultrafeedback-binarized-preferences-cleaned-ita, base_model:RiTA-nlp/tweety-7b-italian-mistral-v0.1, base_model:adapter:RiTA-nlp/tweety-7b-italian-mistral-v0.1, 4-bit, bitsandbytes, region:us
Base models (adapter): id: RiTA-nlp/tweety-7b-italian-mistral-v0.1
Card metadata: library_name: peft
tags: alignment-handbook, generated_from_trainer
base_model: g8a9/tweety-mistral-7b
datasets: giux78/ultrafeedback-binarized-preferences-cleaned-ita
model-index: name: dpo
Likes: 0 | All-time downloads: 50
Created: 2024-05-12 08:31:23