Multi Master
Collection
MOE models for general query information models that have good prior knowledge training
•
6 items
•
Updated
Model Card for MultiMaster 5x7B
Version 2 of a general purpose model for knowledge.
Model Details
Model Description
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
- Developed by: ibivibiv
- Funded by: ibivibiv
- Shared by: ibivibiv
- Model type: Mixtral
- Language(s) (NLP): English
- License: Apache 2
Uses
General Knowledge
Direct Use
Evaluation
Coming Soon
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 73.33 |
| AI2 Reasoning Challenge (25-Shot) | 70.48 |
| HellaSwag (10-Shot) | 87.59 |
| MMLU (5-Shot) | 65.09 |
| TruthfulQA (0-shot) | 60.63 |
| Winogrande (5-shot) | 84.29 |
| GSM8k (5-shot) | 71.87 |
- Downloads last month
- 2,747
Collection including ibivibiv/multimaster-7b-v2
Evaluation results
- normalized accuracy on AI2 Reasoning Challenge (25-Shot)test set Open LLM Leaderboard70.480
- normalized accuracy on HellaSwag (10-Shot)validation set Open LLM Leaderboard87.590
- accuracy on MMLU (5-Shot)test set Open LLM Leaderboard65.090
- mc2 on TruthfulQA (0-shot)validation set Open LLM Leaderboard60.630
- accuracy on Winogrande (5-shot)validation set Open LLM Leaderboard84.290
- accuracy on GSM8k (5-shot)test set Open LLM Leaderboard71.870