---
library_name: transformers
tags:
- unsloth
- trl
- orpo
datasets:
- reciperesearch/dolphin-sft-v0.1-preference
---

## base model : 
- microsoft/Phi-3-mini-4k-instruct

## Dataset : 
- reciperesearch/dolphin-sft-v0.1-preference