Edit model card

Buy Me A Coffee

This is OpenLLaMA 3B V2 finetuned on ShareGPT Hyperfiltered for 1 epochs.

Prompt template:

### HUMAN:
{prompt}

### RESPONSE:
<leave a newline for the model to answer>

GGML quants available here.
GPTQ quants available here.

Note: Don't expect this model to be good, I was just starting out to finetune. So don't roast me please!

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 41.02
ARC (25-shot) 41.3
HellaSwag (10-shot) 71.85
MMLU (5-shot) 27.51
TruthfulQA (0-shot) 38.34
Winogrande (5-shot) 66.38
GSM8K (5-shot) 0.76

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 41.02
AI2 Reasoning Challenge (25-Shot) 41.30
HellaSwag (10-Shot) 71.85
MMLU (5-Shot) 27.51
TruthfulQA (0-shot) 38.34
Winogrande (5-shot) 66.38
GSM8k (5-shot) 0.76
Downloads last month
3,617
Safetensors
Model size
3.43B params
Tensor type
F32
Β·
FP16
Β·

Dataset used to train acrastt/Puma-3B

Spaces using acrastt/Puma-3B 11

Evaluation results