---
license: openrail
datasets:
- JeanKaddour/minipile
- Open-Orca/OpenOrca
language:
- en
---
Micro Mistral

A small version of mistral.

Similiar to some of the small llama variants, but uses GQA, tied embeddings, and sliding window attention.

Dataset
Minipile Instruct Math OpenOrca Synthetic Data



TODO: Complete Dataset section