metadata
license: openrail
datasets:
- JeanKaddour/minipile
- Open-Orca/OpenOrca
language:
- en
Micro Mistral
A small version of mistral.
Similiar to some of the small llama variants, but uses GQA, tied embeddings, and sliding window attention.
Dataset Minipile Instruct Math OpenOrca Synthetic Data
TODO: Complete Dataset section