Model: charlescai2016/granite-8b-code-instruct-128k-Q4_K_M-GGUF
Author: charlescai2016
Pipeline: text-generation
Library: transformers
Tags: transformers, gguf, code, granite, llama-cpp, gguf-my-repo, text-generation, dataset:bigcode/commitpackft, dataset:TIGER-Lab/MathInstruct, dataset:meta-math/MetaMathQA, dataset:glaiveai/glaive-code-assistant-v3, dataset:glaive-function-calling-v2, dataset:bugdaryan/sql-create-context-instruction, dataset:garage-bAInd/Open-Platypus, dataset:nvidia/HelpSteer, dataset:bigcode/self-oss-instruct-sc2-exec-filter-50k, base_model:ibm-granite/granite-8b-code-instruct-128k, base_model:quantized:ibm-granite/granite-8b-code-instruct-128k, license:apache-2.0, model-index, region:us, conversational
Base models (quantized): id: ibm-granite/granite-8b-code-instruct-128k
Card metadata: base_model: ibm-granite/granite-8b-code-instruct-128k
datasets: bigcode/commitpackft, TIGER-Lab/MathInstruct, meta-math/MetaMathQA, glaiveai/glaive-code-assistant-v3, glaive-function-calling-v2, bugdaryan/sql-create-context-instruction, garage-bAInd/Open-Platypus, nvidia/HelpSteer, bigcode/self-oss-instruct-sc2-exec-filter-50k
library_name: transformers
license: apache-2.0
metrics: code_eval
pipeline_tag: text-generation
tags: code, granite, llama-cpp, gguf-my-repo
inference: no
model-index: name: granite-8B-Code-instruct-128k
results: task: type: text-generation
dataset: name: HumanEvalSynthesis (Python)
type: bigcode/humanevalpack
metrics: type: pass@1
value: 62.2
name: pass@1
verified: no, type: pass@1
value: 51.4
name: pass@1
verified: no, type: pass@1
value: 38.9
name: pass@1
verified: no, type: pass@1
value: 38.3
name: pass@1
verified: no, task: type: text-generation
dataset: name: RepoQA (Python@16K)
type: repoqa
metrics: type: pass@1 (thresh=0.5)
value: 73
name: pass@1 (thresh=0.5)
verified: no, type: pass@1 (thresh=0.5)
value: 37
name: pass@1 (thresh=0.5)
verified: no, type: pass@1 (thresh=0.5)
value: 73
name: pass@1 (thresh=0.5)
verified: no, type: pass@1 (thresh=0.5)
value: 62
name: pass@1 (thresh=0.5)
verified: no, type: pass@1 (thresh=0.5)
value: 63
name: pass@1 (thresh=0.5)
verified: no
Likes: 0 | All-time downloads: 110
Created: 2024-08-03 20:15:29