Model: ayoubkirouane/Mistral-SLERP-Merged7B-DPO
Author: ayoubkirouane
Pipeline: text-generation
Library: peft
Tags: peft, safetensors, trl, dpo, unsloth, text-generation, conversational, dataset:HuggingFaceH4/ultrafeedback_binarized, dataset:ayoubkirouane/Orca-Direct-Preference-Optimization, base_model:ayoubkirouane/Mistral-SLERP-Merged7B, base_model:adapter:ayoubkirouane/Mistral-SLERP-Merged7B, license:apache-2.0, region:us
Base models (adapter): id: ayoubkirouane/Mistral-SLERP-Merged7B
Card metadata: license: apache-2.0
library_name: peft
tags: trl, dpo, unsloth
base_model: ayoubkirouane/Mistral-SLERP-Merged7B
model-index: name: outputs
datasets: HuggingFaceH4/ultrafeedback_binarized, ayoubkirouane/Orca-Direct-Preference-Optimization
pipeline_tag: text-generation
Likes: 0 | All-time downloads: 70
Created: 2024-01-24 09:42:45