Model: davelsphere/granite-3.0-2b-instruct-Q4_K_M-GGUF
Author: davelsphere
Pipeline: text-generation
Library: transformers
Tags: transformers, gguf, language, granite-3.0, llama-cpp, gguf-my-repo, text-generation, base_model:ibm-granite/granite-3.0-2b-instruct, base_model:quantized:ibm-granite/granite-3.0-2b-instruct, license:apache-2.0, model-index, region:us, conversational
Base models (quantized): id: ibm-granite/granite-3.0-2b-instruct
Card metadata: pipeline_tag: text-generation
inference: no
license: apache-2.0
library_name: transformers
tags: language, granite-3.0, llama-cpp, gguf-my-repo
base_model: ibm-granite/granite-3.0-2b-instruct
model-index: name: granite-3.0-2b-instruct
results: task: type: text-generation
dataset: name: IFEval
type: instruction-following
metrics: type: pass@1
value: 46.07
name: pass@1
verified: no, type: pass@1
value: 7.66
name: pass@1
verified: no, task: type: text-generation
dataset: name: AGI-Eval
type: human-exams
metrics: type: pass@1
value: 29.75
name: pass@1
verified: no, type: pass@1
value: 56.03
name: pass@1
verified: no, type: pass@1
value: 27.92
name: pass@1
verified: no, task: type: text-generation
dataset: name: OBQA
type: commonsense
metrics: type: pass@1
value: 43.2
name: pass@1
verified: no, type: pass@1
value: 66.36
name: pass@1
verified: no, type: pass@1
value: 76.79
name: pass@1
verified: no, type: pass@1
value: 71.9
name: pass@1
verified: no, type: pass@1
value: 53.37
name: pass@1
verified: no, task: type: text-generation
dataset: name: BoolQ
type: reading-comprehension
metrics: type: pass@1
value: 84.89
name: pass@1
verified: no, type: pass@1
value: 19.73
name: pass@1
verified: no, task: type: text-generation
dataset: name: ARC-C
type: reasoning
metrics: type: pass@1
value: 54.35
name: pass@1
verified: no, type: pass@1
value: 28.61
name: pass@1
verified: no, type: pass@1
value: 43.74
name: pass@1
verified: no, task: type: text-generation
dataset: name: HumanEvalSynthesis
type: code
metrics: type: pass@1
value: 50.61
name: pass@1
verified: no, type: pass@1
value: 45.58
name: pass@1
verified: no, type: pass@1
value: 51.83
name: pass@1
verified: no, type: pass@1
value: 41
name: pass@1
verified: no, task: type: text-generation
dataset: name: GSM8K
type: math
metrics: type: pass@1
value: 59.66
name: pass@1
verified: no, type: pass@1
value: 23.66
name: pass@1
verified: no, task: type: text-generation
dataset: name: PAWS-X (7 langs)
type: multilingual
metrics: type: pass@1
value: 61.42
name: pass@1
verified: no, type: pass@1
value: 37.13
name: pass@1
verified: no
Likes: 0 | All-time downloads: 946
Created: 2024-10-21 07:17:48