
PeanutJar/Mistral-v0.1-PeanutButter-v0.0.5-SFT-7B-QLoRA
Updated
•
4
Stuff related to PeanutButter, the Model & Dataset series.
Tabula Rasa.
Model Version | QLoRA | F16 Safetensors | GGML |
---|---|---|---|
Mistral-v0.1-PeanutButter-v0.0.0-7B | Mistral-v0.1-PeanutButter-v0.0.0-7B | ||
Mistral-v0.1-PeanutButter-v0.0.2-7B | Mistral-v0.1-PeanutButter-v0.0.2-7B |
Model | Average | ARC | HellaSwag | MMLU | TruthfulQA |
---|---|---|---|---|---|
GPT-4 | 84.30 | 96.30 | 95.30 | 86.40 | 59.00 |
GPT-3.5 | 71.90 | 85.20 | 85.50 | 70.00 | 47.00 |
ehartford/dolphin-2.1-mistral-7b | 67.06 | 64.42 | 84.92 | 63.32 | 55.56 |
Open-Orca/Mistral-7B-OpenOrca | 65.84 | 64.08 | 83.99 | 62.24 | 53.05 |
migtissera/SynthIA-7B-v1.3 | 64.90 | 62.12 | 83.45 | 62.65 | 51.37 |
caisarl76/Mistral-7B-guanaco1k-ep2 | 64.68 | 60.07 | 82.76 | 61.65 | 54.40 |
akjindal53244/Mistral-7B-v0.1-Open-Platypus | 64.64 | 62.37 | 85.08 | 63.79 | 47.33 |
ehartford/dolphin-2.0-mistral-7b | 64.37 | 59.22 | 80.26 | 56.90 | 61.08 |
PeanutJar/Mistral-v0.1-PeanutButter-v0.0.0-7B | 64.34 | 62.20 | 84.10 | 64.14 | 46.94 |
PocketDoc/Dans-TotSirocco-7b | 64.24 | 62.03 | 84.23 | 64.19 | 46.49 |
bhenrym14/mistral-7b-platypus-fp16 | 64.10 | 63.05 | 84.15 | 64.11 | 45.07 |
ehartford/samantha-mistral-7b | 63.73 | 63.40 | 84.10 | 61.36 | 46.08 |
caisarl76/Mistral-7B-OpenOrca-Guanaco-accu16 | 63.73 | 59.73 | 83.08 | 61.29 | 50.81 |
mistralai/Mistral-7B-v0.1 | 62.40 | 59.98 | 83.31 | 64.16 | 42.15 |
PulsarAI/Nebula-7B | 61.33 | 59.30 | 83.46 | 57.00 | 45.56 |
Weyaxi/Samantha-Nebula-7B | 60.76 | 57.00 | 82.25 | 54.21 | 49.58 |
oh-yeontaek/llama-2-7B-LoRA-assemble | 60.02 | 57.34 | 78.81 | 50.75 | 53.18 |
HyperbeeAI/Tulpar-7b-v1 | 59.96 | 57.00 | 79.69 | 51.33 | 51.83 |
meta-llama/Llama-2-13b-chat-hf | 59.93 | 59.04 | 81.94 | 54.64 | 44.12 |
stabilityai/StableBeluga-7B | 59.59 | 56.31 | 79.14 | 52.71 | 50.19 |
edor/Stable-Platypus2-mini-7B | 59.16 | 54.86 | 78.95 | 51.78 | 51.06 |
meta-llama/Llama-2-13b-hf | 58.66 | 59.39 | 82.13 | 55.77 | 37.38 |
circulus/Llama-2-7b-orca-v1 | 58.59 | 56.31 | 79.14 | 52.71 | 50.19 |
JosephusCheung/Qwen-LLaMAfied-7B-Chat | 58.50 | 50.94 | 83.47 | 53.52 | 46.09 |
jondurbin/spicyboros-7b-2.2 | 58.09 | 56.57 | 80.09 | 48.47 | 47.22 |
NousResearch/Nous-Hermes-llama-2-7b | 57.85 | 55.12 | 78.94 | 48.34 | 49.01 |
migtissera/Synthia-7B | 57.53 | 56.14 | 78.60 | 50.35 | 45.03 |
edor/Hermes-Platypus2-mini-7B | 57.34 | 53.75 | 79.24 | 47.08 | 49.28 |
lmsys/vicuna-7b-delta-v1.1 | 56.43 | 53.67 | 77.50 | 45.61 | 48.95 |
meta-llama/Llama-2-7b-chat-hf | 56.34 | 52.90 | 78.55 | 48.32 | 45.57 |
heegyu/LIMA2-7b-hf | 55.45 | 53.24 | 80.60 | 43.22 | 44.74 |
meta-llama/Llama-2-7b-hf | 54.32 | 53.07 | 78.59 | 46.87 | 38.76 |