Model: tensorblock/granite-3b-code-base-128k-GGUF
Author: tensorblock
Pipeline: text-generation
Library: transformers
Tags: transformers, gguf, code, granite, TensorBlock, GGUF, text-generation, dataset:codeparrot/github-code-clean, dataset:bigcode/starcoderdata, dataset:open-web-math/open-web-math, dataset:math-ai/StackMathQA, base_model:ibm-granite/granite-3b-code-base-128k, base_model:quantized:ibm-granite/granite-3b-code-base-128k, license:apache-2.0, model-index, region:us
Base models (quantized): id: ibm-granite/granite-3b-code-base-128k
Card metadata: pipeline_tag: text-generation
inference: no
license: apache-2.0
datasets: codeparrot/github-code-clean, bigcode/starcoderdata, open-web-math/open-web-math, math-ai/StackMathQA
metrics: code_eval
library_name: transformers
tags: code, granite, TensorBlock, GGUF
base_model: ibm-granite/granite-3b-code-base-128k
model-index: name: granite-3b-code-base-128k
results: task: type: text-generation
dataset: name: HumanEvalSynthesis (Python)
type: bigcode/humanevalpack
metrics: type: pass@1
value: 36
name: pass@1
verified: no, type: pass@1
value: 30.5
name: pass@1
verified: no, type: pass@1
value: 22.4
name: pass@1
verified: no, type: pass@1
value: 19.9
name: pass@1
verified: no, task: type: text-generation
dataset: name: RepoQA (Python@16K)
type: repoqa
metrics: type: pass@1 (thresh=0.5)
value: 40
name: pass@1 (thresh=0.5)
verified: no, type: pass@1 (thresh=0.5)
value: 36
name: pass@1 (thresh=0.5)
verified: no, type: pass@1 (thresh=0.5)
value: 37
name: pass@1 (thresh=0.5)
verified: no, type: pass@1 (thresh=0.5)
value: 27
name: pass@1 (thresh=0.5)
verified: no, type: pass@1 (thresh=0.5)
value: 29
name: pass@1 (thresh=0.5)
verified: no, task: type: text-generation
dataset: name: LCC (Balanced)
type: lcc
metrics: type: Exact Match@4K
value: 54.6
name: Exact Match@4K
verified: no, type: Exact Match@8K
value: 56.8
name: Exact Match@8K
verified: no, type: Exact Match@16K
value: 52.2
name: Exact Match@16K
verified: no, type: Exact Match@32K
value: 57.8
name: Exact Match@32K
verified: no, task: type: text-generation
dataset: name: RepoBench-P (Balanced)
type: repobench
metrics: type: Exact Match@4K
value: 39.8
name: Exact Match@4K
verified: no, type: Exact Match@8K
value: 46.8
name: Exact Match@8K
verified: no, type: Exact Match@16K
value: 43.1
name: Exact Match@16K
verified: no, type: Exact Match@32K
value: 45.3
name: Exact Match@32K
verified: no
Likes: 0 | All-time downloads: 2037
Created: 2024-11-28 22:39:19