| license: openrail | |
| datasets: | |
| - JeanKaddour/minipile | |
| - Open-Orca/OpenOrca | |
| language: | |
| - en | |
| Micro Mistral | |
| A small version of mistral. | |
| Similiar to some of the small llama variants, but uses GQA, tied embeddings, and sliding window attention. | |
| Dataset | |
| Minipile Instruct Math OpenOrca Synthetic Data | |
| TODO: Complete Dataset section |