| library_name: transformers | |
| tags: | |
| - unsloth | |
| - trl | |
| - orpo | |
| datasets: | |
| - reciperesearch/dolphin-sft-v0.1-preference | |
| ## base model : | |
| - microsoft/Phi-3-mini-4k-instruct | |
| ## Dataset : | |
| - reciperesearch/dolphin-sft-v0.1-preference |
| library_name: transformers | |
| tags: | |
| - unsloth | |
| - trl | |
| - orpo | |
| datasets: | |
| - reciperesearch/dolphin-sft-v0.1-preference | |
| ## base model : | |
| - microsoft/Phi-3-mini-4k-instruct | |
| ## Dataset : | |
| - reciperesearch/dolphin-sft-v0.1-preference |