Hugging Face model: ayoubkirouane/Mistral-SLERP-Merged7B-DPO
Author: ayoubkirouane
Created: 2024-01-24 09:42:45
Last modified: 2024-01-24 12:08:48
Pipeline: text-generation
Library: peft
Likes: 0 | Downloads: 2
Tags: peft, safetensors, trl, dpo, unsloth, text-generation, conversational, dataset:HuggingFaceH4/ultrafeedback_binarized, dataset:ayoubkirouane/Orca-Direct-Preference-Optimization, base_model:ayoubkirouane/Mistral-SLERP-Merged7B, base_model:adapter:ayoubkirouane/Mistral-SLERP-Merged7B, license:apache-2.0, region:us
Base model relation: adapter
Base models: id: ayoubkirouane/Mistral-SLERP-Merged7B
Card metadata:
license: apache-2.0
library_name: peft
tags: trl, dpo, unsloth
base_model: ayoubkirouane/Mistral-SLERP-Merged7B
datasets: HuggingFaceH4/ultrafeedback_binarized, ayoubkirouane/Orca-Direct-Preference-Optimization
pipeline_tag: text-generation