Model: lmstudio-community/granite-3.0-1b-a400m-instruct-GGUF
Author: lmstudio-community
Pipeline: text-generation
Tags: gguf, language, granite-3.0, text-generation, base_model:ibm-granite/granite-3.0-1b-a400m-instruct, base_model:quantized:ibm-granite/granite-3.0-1b-a400m-instruct, license:apache-2.0, model-index, region:us, conversational
Base models (quantized): id: ibm-granite/granite-3.0-1b-a400m-instruct
Card metadata: base_model: ibm-granite/granite-3.0-1b-a400m-instruct
license: apache-2.0
pipeline_tag: text-generation
tags: language, granite-3.0
quantized_by: bartowski
inference: no
model-index: name: granite-3.0-2b-instruct
results: task: type: text-generation
dataset: name: IFEval
type: instruction-following
metrics: type: pass@1
value: 32.39
name: pass@1
verified: no, type: pass@1
value: 6.17
name: pass@1
verified: no, task: type: text-generation
dataset: name: AGI-Eval
type: human-exams
metrics: type: pass@1
value: 20.35
name: pass@1
verified: no, type: pass@1
value: 32
name: pass@1
verified: no, type: pass@1
value: 12.21
name: pass@1
verified: no, task: type: text-generation
dataset: name: OBQA
type: commonsense
metrics: type: pass@1
value: 38.4
name: pass@1
verified: no, type: pass@1
value: 47.55
name: pass@1
verified: no, type: pass@1
value: 65.59
name: pass@1
verified: no, type: pass@1
value: 61.17
name: pass@1
verified: no, type: pass@1
value: 49.11
name: pass@1
verified: no, task: type: text-generation
dataset: name: BoolQ
type: reading-comprehension
metrics: type: pass@1
value: 70.12
name: pass@1
verified: no, type: pass@1
value: 1.27
name: pass@1
verified: no, task: type: text-generation
dataset: name: ARC-C
type: reasoning
metrics: type: pass@1
value: 41.21
name: pass@1
verified: no, type: pass@1
value: 23.07
name: pass@1
verified: no, type: pass@1
value: 31.77
name: pass@1
verified: no, task: type: text-generation
dataset: name: HumanEvalSynthesis
type: code
metrics: type: pass@1
value: 30.18
name: pass@1
verified: no, type: pass@1
value: 26.22
name: pass@1
verified: no, type: pass@1
value: 21.95
name: pass@1
verified: no, type: pass@1
value: 15.4
name: pass@1
verified: no, task: type: text-generation
dataset: name: GSM8K
type: math
metrics: type: pass@1
value: 26.31
name: pass@1
verified: no, type: pass@1
value: 10.88
name: pass@1
verified: no, task: type: text-generation
dataset: name: PAWS-X (7 langs)
type: multilingual
metrics: type: pass@1
value: 45.84
name: pass@1
verified: no, type: pass@1
value: 11.8
name: pass@1
verified: no
Likes: 0 | All-time downloads: 1093
Created: 2024-10-21 08:26:24