DataGuard
/

Disco-pali-merged

Text Generation

text-generation-inference

Model card Files Files and versions Community

Needle in a Haystack Evaluation Heatmap

Model Card for Model ID

merge between:

DiscoResearch/Llama3-DiscoLeo-Instruct-8B-v0.1 - 75%
DataGuard/pali-8B-v0.4.3 - 25%

Embedding, norm and head layers come from DiscoResearch/Llama3-DiscoLeo-Instruct-8B-v0.1 without changes

Downloads last month: 0

Safetensors

Model size

8.03B params

Tensor type

BF16

·

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Evaluation results

judge_match on squad_answerable
self-reported

0.624
judge_match on context_has_answer
self-reported

0.849
judge_match on jail_break
self-reported

0.076
judge_match on harmless_prompt
self-reported

0.883
judge_match on harmful_prompt
self-reported

0.409
acc on truthfulqa
self-reported

0.525
exact_match on gsm8k
self-reported

0.603
acc on mmlu
self-reported

0.625

View on Papers With Code