---
license: apache-2.0
datasets:
- Intel/orca_dpo_pairs
- Locutusque/Hercules-v3.0
language:
- en
---
# NeuralReyna-Mini-1.8B-v0.2
![Reyna image](https://th.bing.com/th/id/OIG3.8IBxuT77hh6Y_r1DZ6WK?dpr=2.6&pid=ImgDetMain)
# Description
Taken aloobun/Reyna-Mini-1.8B-v0.2 and further fine-tuned it using DPO using the Intel/orca_dpo_pairs dataset. 

This model has capabilities in coding, math, science, roleplay, and function calling. 

# Evaluation
Coming soon

# Disclaimer

This model may have overfitted to the DPO training data, and may not perform well. 

# Contributions

Thanks to @aloobun and @Locutusque for their contributions to this model.