metadata
license: apache-2.0
tags:
- mixtral
- finetune
Overview
This model is part of the Smaug series of finetuned models, this one based on https://huggingface.co/mistralai/Mixtral-8x7B-v0.1
Additional details will be added along with the datasets around 2022-02-20. For now see https://huggingface.co/abacusai/Smaug-72B-v0.1 for more information.
Evaluation Results
| Average | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
|---|---|---|---|---|---|---|
| 75.12 | 74.91 | 87.70 | 70.16 | 65.96 | 81.61 | 70.36 |