My Projects
Collection
Projects I've worked on (includes collabs)
•
17 items
•
Updated
•
5
WARNING! This is a "Frankenmerge" - this model is untested!
By mrfakename
Please note that this is an experimental model. We cannot guarantee model quality.
This is the first (alpha) release of NeuralOrca. NeuralOrca is a merge of the following models:
We use the ChatML prompt format.
Example:
<|im_start|>system
You are NeuralOrca, a helpful AI assistant.
<|im_end|>
<|im_start|>user
How are you?<|im_end|>
<|im_start|>assistant
Coming soon
The context length for this model is 8192 tokens (8K).
You are responsible for your use of NeuralOrca.
This software is licensed under the Apache 2.0 license. If you want to use it for commercial use, it's probably fine but please contact me first.
Detailed results can be found here
Metric | Value |
---|---|
Avg. | 67.64 |
AI2 Reasoning Challenge (25-Shot) | 65.27 |
HellaSwag (10-Shot) | 85.07 |
MMLU (5-Shot) | 63.68 |
TruthfulQA (0-shot) | 54.58 |
Winogrande (5-shot) | 78.77 |
GSM8k (5-shot) | 58.45 |