Model: TobDeBer/PowerMoe-3b-GGUF
Author: TobDeBer
Pipeline: text-generation
Tags: gguf, text-generation, arxiv:2408.13359, base_model:ibm-research/PowerMoE-3b, base_model:quantized:ibm-research/PowerMoE-3b, license:apache-2.0, model-index, region:us
Base models (quantized): id: ibm-research/PowerMoE-3b
Card metadata: pipeline_tag: text-generation
inference: no
license: apache-2.0
model-index: name: ibm/PowerMoE-3b
results: task: type: text-generation
dataset: type: lm-eval-harness
name: ARC
metrics: name: accuracy-norm
type: accuracy-norm
value: 58.1
verified: no, task: type: text-generation
dataset: type: lm-eval-harness
name: BoolQ
metrics: name: accuracy
type: accuracy
value: 65
verified: no, task: type: text-generation
dataset: type: lm-eval-harness
name: Hellaswag
metrics: name: accuracy-norm
type: accuracy-norm
value: 71.5
verified: no, task: type: text-generation
dataset: type: lm-eval-harness
name: OpenBookQA
metrics: name: accuracy-norm
type: accuracy-norm
value: 41
verified: no, task: type: text-generation
dataset: type: lm-eval-harness
name: PIQA
metrics: name: accuracy-norm
type: accuracy-norm
value: 79.1
verified: no, task: type: text-generation
dataset: type: lm-eval-harness
name: Winogrande
metrics: name: accuracy-norm
type: accuracy-norm
value: 65
verified: no, task: type: text-generation
dataset: type: lm-eval-harness
name: MMLU (5 shot)
metrics: name: accuracy
type: accuracy
value: 42.8
verified: no, task: type: text-generation
dataset: type: lm-eval-harness
name: GSM8k (5 shot)
metrics: name: accuracy
type: accuracy
value: 25.9
verified: no, task: type: text-generation
dataset: type: lm-eval-harness
name: math (4 shot)
metrics: name: accuracy
type: accuracy
value: 14.8
verified: no, task: type: text-generation
dataset: type: bigcode-eval
name: humaneval
metrics: name: pass@1
type: pass@1
value: 20.1
verified: no, task: type: text-generation
dataset: type: bigcode-eval
name: MBPP
metrics: name: pass@1
type: pass@1
value: 32.4
verified: no
base_model: ibm/PowerMoE-3b
Likes: 1 | All-time downloads: 116
Created: 2024-09-17 12:46:28