Nebula-7B / README.md
Weyaxi's picture
Adding Evaluation Results (#2)
ca07c9b
metadata
license: apache-2.0
datasets:
  - garage-bAInd/Open-Platypus
language:
  - en

image/png

Buy Me A Coffee

Nebula-7b

Original weights of Nebula-7B. Finetuned from mistralai/Mistral-7B-v0.1.

Lora Weights

You can access original lora weights from here:

PulsarAI/Nebula-7B-Lora

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 53.93
ARC (25-shot) 59.3
HellaSwag (10-shot) 83.46
MMLU (5-shot) 57.0
TruthfulQA (0-shot) 45.56
Winogrande (5-shot) 76.4
GSM8K (5-shot) 14.86
DROP (3-shot) 40.96