Model: HaileyStorm/llama3-5.4b-instruct
Author: HaileyStorm
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, llama, text-generation, mergekit, prune, dpo, instruct, conversational, dataset:mlabonne/orpo-dpo-mix-40k, base_model:meta-llama/Meta-Llama-3-8B-Instruct, base_model:finetune:meta-llama/Meta-Llama-3-8B-Instruct, license:llama3, model-index, text-generation-inference, endpoints_compatible, region:us
Base models (finetune): id: meta-llama/Meta-Llama-3-8B-Instruct
Card metadata: base_model: meta-llama/Meta-Llama-3-8B-Instruct
library_name: transformers
tags: mergekit, prune, dpo, instruct
datasets: mlabonne/orpo-dpo-mix-40k
license: llama3
pipeline_tag: text-generation
model-index: name: llama3-5.4b-instruct
results: task: type: text-generation
dataset: name: truthfulqa_mc2
type: truthfulqa_mc2
metrics: name: TruthfulQA (0-Shot)
type: TruthfulQA (0-Shot)
value: 0.517686926475562
verified: no, task: type: text-generation
dataset: name: ai2_arc
type: ai2_arc
metrics: name: AI2 Reasoning Challenge (25-Shot)
type: AI2 Reasoning Challenge (25-Shot)
value: 0.360068259385666
verified: no, task: type: text-generation
dataset: name: hellaswag
type: hellaswag
metrics: name: HellaSwag (10-Shot)
type: HellaSwag (10-Shot)
value: 0.503485361481777
verified: no, task: type: text-generation
dataset: name: winogrande
type: winogrande
metrics: name: Winogrande (5-Shot)
type: Winogrande (5-Shot)
value: 0.633780584056827
verified: no, task: type: text-generation
dataset: name: mmlu
type: mmlu
metrics: name: MMLU (5-Shot)
type: MMLU (5-Shot)
value: 0.290912975359635
verified: no
Likes: 1 | All-time downloads: 1706
Created: 2024-05-26 12:55:43