Dionysus-Mistral-m3-v6 - A Fine-tuned Language Model
Overview
Dionysus-Mistral-m3-v6 is a language model fine-tuned on the AIDC-ai-business/Marcoroni-7B-v3 architecture. This model is mainly used for roleplay.
Model Details
- Developer: DECEM
- Base Model: AIDC-ai-business/Marcoroni-7B-v3
- Fine-tuning Method: SFT
- Language: English
Prompting
Prompt Template for alpaca style
{system prompt} (without the {})
### Instruction:
{user_name}: {prompt} (without the {})
### Response:
{character_name}: (without the {})
stop_words: </s>
Open LLM Leaderboard Evaluation Details
https://huggingface.co/datasets/open-llm-leaderboard/details_decem__Dionysus-Mistral-m3-v6
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 67.10 |
| AI2 Reasoning Challenge (25-Shot) | 63.14 |
| HellaSwag (10-Shot) | 84.51 |
| MMLU (5-Shot) | 62.82 |
| TruthfulQA (0-shot) | 49.49 |
| Winogrande (5-shot) | 78.45 |
| GSM8k (5-shot) | 64.22 |
- Downloads last month
- 3,169
Evaluation results
- normalized accuracy on AI2 Reasoning Challenge (25-Shot)test set Open LLM Leaderboard63.140
- normalized accuracy on HellaSwag (10-Shot)validation set Open LLM Leaderboard84.510
- accuracy on MMLU (5-Shot)test set Open LLM Leaderboard62.820
- mc2 on TruthfulQA (0-shot)validation set Open LLM Leaderboard49.490
- accuracy on Winogrande (5-shot)validation set Open LLM Leaderboard78.450
- accuracy on GSM8k (5-shot)test set Open LLM Leaderboard64.220