Granite-20B-Code-Instruct
ExLlamav2 8 bpw quants of https://huggingface.co/ibm-granite/granite-20b-code-instruct
- Downloads last month
- 3
This model does not have enough activity to be deployed to Inference API (serverless) yet.
Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.
Quantized from
Datasets used to train altomek/Granite-20B-Code-Instruct-8bpw-EXL2
Evaluation results
- pass@1 on HumanEvalSynthesis(Python)self-reported60.400
- pass@1 on HumanEvalSynthesis(JavaScript)self-reported53.700
- pass@1 on HumanEvalSynthesis(Java)self-reported58.500
- pass@1 on HumanEvalSynthesis(Go)self-reported42.100
- pass@1 on HumanEvalSynthesis(C++)self-reported45.700
- pass@1 on HumanEvalSynthesis(Rust)self-reported42.700
- pass@1 on HumanEvalExplain(Python)self-reported44.500
- pass@1 on HumanEvalExplain(JavaScript)self-reported42.700
- pass@1 on HumanEvalExplain(Java)self-reported49.400
- pass@1 on HumanEvalExplain(Go)self-reported32.300