Model: mlx-community/granite-20b-code-instruct-8bit
Author: mlx-community
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, gpt_bigcode, text-generation, code, granite, mlx, conversational, dataset:bigcode/commitpackft, dataset:TIGER-Lab/MathInstruct, dataset:meta-math/MetaMathQA, dataset:glaiveai/glaive-code-assistant-v3, dataset:glaive-function-calling-v2, dataset:bugdaryan/sql-create-context-instruction, dataset:garage-bAInd/Open-Platypus, dataset:nvidia/HelpSteer, base_model:ibm-granite/granite-20b-code-base-8k, base_model:finetune:ibm-granite/granite-20b-code-base-8k, license:apache-2.0, model-index, text-generation-inference, endpoints_compatible, region:us
Base models (finetune): id: ibm-granite/granite-20b-code-base-8k
Card metadata: license: apache-2.0
library_name: transformers
tags: code, granite, mlx
base_model: ibm-granite/granite-20b-code-base
datasets: bigcode/commitpackft, TIGER-Lab/MathInstruct, meta-math/MetaMathQA, glaiveai/glaive-code-assistant-v3, glaive-function-calling-v2, bugdaryan/sql-create-context-instruction, garage-bAInd/Open-Platypus, nvidia/HelpSteer
metrics: code_eval
pipeline_tag: text-generation
inference: yes
model-index: name: granite-20b-code-instruct
results: task: type: text-generation
dataset: name: HumanEvalSynthesis(Python)
type: bigcode/humanevalpack
metrics: type: pass@1
value: 60.4
name: pass@1
verified: no, type: pass@1
value: 53.7
name: pass@1
verified: no, type: pass@1
value: 58.5
name: pass@1
verified: no, type: pass@1
value: 42.1
name: pass@1
verified: no, type: pass@1
value: 45.7
name: pass@1
verified: no, type: pass@1
value: 42.7
name: pass@1
verified: no, type: pass@1
value: 44.5
name: pass@1
verified: no, type: pass@1
value: 42.7
name: pass@1
verified: no, type: pass@1
value: 49.4
name: pass@1
verified: no, type: pass@1
value: 32.3
name: pass@1
verified: no, type: pass@1
value: 42.1
name: pass@1
verified: no, type: pass@1
value: 18.3
name: pass@1
verified: no, type: pass@1
value: 43.9
name: pass@1
verified: no, type: pass@1
value: 43.9
name: pass@1
verified: no, type: pass@1
value: 45.7
name: pass@1
verified: no, type: pass@1
value: 41.5
name: pass@1
verified: no, type: pass@1
value: 41.5
name: pass@1
verified: no, type: pass@1
value: 29.9
name: pass@1
verified: no
Likes: 0 | All-time downloads: 267
Created: 2024-05-06 21:39:28