Model: farpluto/granite-3.0-3b-a800m-instruct-Q4_K_M-GGUF
Author: farpluto
Pipeline: text-generation
Library: transformers
Tags: transformers, gguf, language, granite-3.0, llama-cpp, gguf-my-repo, text-generation, base_model:ibm-granite/granite-3.0-3b-a800m-instruct, base_model:quantized:ibm-granite/granite-3.0-3b-a800m-instruct, license:apache-2.0, model-index, region:us, conversational
Base models (quantized): id: ibm-granite/granite-3.0-3b-a800m-instruct
Card metadata: pipeline_tag: text-generation
inference: no
license: apache-2.0
library_name: transformers
tags: language, granite-3.0, llama-cpp, gguf-my-repo
base_model: ibm-granite/granite-3.0-3b-a800m-instruct
model-index: name: granite-3.0-2b-instruct
results: task: type: text-generation
dataset: name: IFEval
type: instruction-following
metrics: type: pass@1
value: 42.49
name: pass@1
verified: no, type: pass@1
value: 7.02
name: pass@1
verified: no, task: type: text-generation
dataset: name: AGI-Eval
type: human-exams
metrics: type: pass@1
value: 25.7
name: pass@1
verified: no, type: pass@1
value: 50.16
name: pass@1
verified: no, type: pass@1
value: 20.51
name: pass@1
verified: no, task: type: text-generation
dataset: name: OBQA
type: commonsense
metrics: type: pass@1
value: 40.8
name: pass@1
verified: no, type: pass@1
value: 59.95
name: pass@1
verified: no, type: pass@1
value: 71.86
name: pass@1
verified: no, type: pass@1
value: 67.01
name: pass@1
verified: no, type: pass@1
value: 48
name: pass@1
verified: no, task: type: text-generation
dataset: name: BoolQ
type: reading-comprehension
metrics: type: pass@1
value: 78.65
name: pass@1
verified: no, type: pass@1
value: 6.71
name: pass@1
verified: no, task: type: text-generation
dataset: name: ARC-C
type: reasoning
metrics: type: pass@1
value: 50.94
name: pass@1
verified: no, type: pass@1
value: 26.85
name: pass@1
verified: no, type: pass@1
value: 37.7
name: pass@1
verified: no, task: type: text-generation
dataset: name: HumanEvalSynthesis
type: code
metrics: type: pass@1
value: 39.63
name: pass@1
verified: no, type: pass@1
value: 40.85
name: pass@1
verified: no, type: pass@1
value: 35.98
name: pass@1
verified: no, type: pass@1
value: 27.4
name: pass@1
verified: no, task: type: text-generation
dataset: name: GSM8K
type: math
metrics: type: pass@1
value: 47.54
name: pass@1
verified: no, type: pass@1
value: 19.86
name: pass@1
verified: no, task: type: text-generation
dataset: name: PAWS-X (7 langs)
type: multilingual
metrics: type: pass@1
value: 50.23
name: pass@1
verified: no, type: pass@1
value: 28.87
name: pass@1
verified: no
Likes: 0 | All-time downloads: 123
Created: 2024-10-26 08:38:51