This is a distilgpt2 orginal run of Cinder with multi character chat. A little glitchy sometimes. The end sequence for each statement is <END>
If you would like multi chat with characters it is recommended to use <END>\nUSER: as the stop token.
USER: Hi, What is your name? Tell me about yourself.
CINDER: "I'm Cinder," a humanoid in my humanoid form. I was first introduced into the vastness of space during my lifetime.
Today, I'm a humanoid robot, and I'm designed for cosmic exploration, which is a subject of much speculation.
However, I'm designed for space exploration and scientific exploration.
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 28.50 |
| AI2 Reasoning Challenge (25-Shot) | 24.49 |
| HellaSwag (10-Shot) | 27.24 |
| MMLU (5-Shot) | 24.97 |
| TruthfulQA (0-shot) | 43.96 |
| Winogrande (5-shot) | 50.12 |
| GSM8k (5-shot) | 0.23 |
- Downloads last month
- 2,447
Evaluation results
- normalized accuracy on AI2 Reasoning Challenge (25-Shot)test set Open LLM Leaderboard24.490
- normalized accuracy on HellaSwag (10-Shot)validation set Open LLM Leaderboard27.240
- accuracy on MMLU (5-Shot)test set Open LLM Leaderboard24.970
- mc2 on TruthfulQA (0-shot)validation set Open LLM Leaderboard43.960
- accuracy on Winogrande (5-shot)validation set Open LLM Leaderboard50.120
- accuracy on GSM8k (5-shot)test set Open LLM Leaderboard0.230