---
library_name: transformers
tags:
- orpo
- llama
- llama 3
- fine tune
license: apache-2.0
datasets:
- mlabonne/orpo-dpo-mix-40k
---

# Model Card for Model ID

<!-- Provide a quick summary of what the model is/does. -->
Quick Llama 3 8B finetune with ORPO. Demontration that it can be fine tune in 2 hours only. 
Thanks to Maxime Labonne's notebook: 

https://colab.research.google.com/drive/1eHNWg9gnaXErdAa8_mcvjMupbSS6rDvi?usp=sharing

- **Number of training samples from the dataset**: 1500 out of 40K
- **Hardware Type:** L4
- **Hours of training:** 2
- **Cloud Provider:** google colab