Please use the updated version Tess-10.7B-v1.5b
Tess-10.7B-v1.5b has hyperparameter optimizations. Access at: https://huggingface.co/migtissera/Tess-10.7B-v1.5b
Tess, short for Tesoro (Treasure in Italian), is a general purpose Large Language Model series. Tess-10.7B-v1.5 was trained on the SOLAR-10.7B base.
Prompt Format:
SYSTEM: <ANY SYSTEM CONTEXT>
USER:
ASSISTANT:
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 66.55 |
| AI2 Reasoning Challenge (25-Shot) | 65.02 |
| HellaSwag (10-Shot) | 84.07 |
| MMLU (5-Shot) | 65.09 |
| TruthfulQA (0-shot) | 47.43 |
| Winogrande (5-shot) | 83.35 |
| GSM8k (5-shot) | 54.36 |
- Downloads last month
- 3,448
Evaluation results
- normalized accuracy on AI2 Reasoning Challenge (25-Shot)test set Open LLM Leaderboard65.020
- normalized accuracy on HellaSwag (10-Shot)validation set Open LLM Leaderboard84.070
- accuracy on MMLU (5-Shot)test set Open LLM Leaderboard65.090
- mc2 on TruthfulQA (0-shot)validation set Open LLM Leaderboard47.430
- accuracy on Winogrande (5-shot)validation set Open LLM Leaderboard83.350
- accuracy on GSM8k (5-shot)test set Open LLM Leaderboard54.360