Commit
•
58c54f7
1
Parent(s):
fe54b3c
Create README.md
Browse files## Overview
This model is part of the Smaug series of finetuned models, this one based on https://huggingface.co/mistralai/Mixtral-8x7B-v0.1
Additional details will be added along with the datasets around 2022-02-20. For now see https://huggingface.co/abacusai/Smaug-72B-v0.1
for more information.
### Evaluation Results
| Average | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
| --- | --- | --- | --- | --- | --- | --- |
| 75.12 | 74.91 | 87.70 | 70.16 | 65.96 | 81.61 | 70.36 |