Model: LiteLLMs/starcoder2-15b-instruct-v0.1-GGUF
Author: LiteLLMs
Pipeline: text-generation
Library: transformers
Tags: transformers, gguf, code, GGUF, text-generation, dataset:bigcode/self-oss-instruct-sc2-exec-filter-50k, base_model:bigcode/starcoder2-15b, base_model:quantized:bigcode/starcoder2-15b, license:bigcode-openrail-m, model-index, endpoints_compatible, region:us, conversational
Base models (quantized): id: bigcode/starcoder2-15b
Card metadata: license: bigcode-openrail-m
library_name: transformers
tags: code, GGUF
base_model: bigcode/starcoder2-15b
datasets: bigcode/self-oss-instruct-sc2-exec-filter-50k
pipeline_tag: text-generation
model-index: name: starcoder2-15b-instruct-v0.1
results: task: type: text-generation
dataset: name: LiveCodeBench (code generation)
type: livecodebench-codegeneration
metrics: type: pass@1
value: 20.4
verified: no, task: type: text-generation
dataset: name: LiveCodeBench (self repair)
type: livecodebench-selfrepair
metrics: type: pass@1
value: 20.9
verified: no, task: type: text-generation
dataset: name: LiveCodeBench (test output prediction)
type: livecodebench-testoutputprediction
metrics: type: pass@1
value: 29.8
verified: no, task: type: text-generation
dataset: name: LiveCodeBench (code execution)
type: livecodebench-codeexecution
metrics: type: pass@1
value: 28.1
verified: no, task: type: text-generation
dataset: name: HumanEval
type: humaneval
metrics: type: pass@1
value: 72.6
verified: no, task: type: text-generation
dataset: name: HumanEval+
type: humanevalplus
metrics: type: pass@1
value: 63.4
verified: no, task: type: text-generation
dataset: name: MBPP
type: mbpp
metrics: type: pass@1
value: 75.2
verified: no, task: type: text-generation
dataset: name: MBPP+
type: mbppplus
metrics: type: pass@1
value: 61.2
verified: no, task: type: text-generation
dataset: name: DS-1000
type: ds-1000
metrics: type: pass@1
value: 40.6
verified: no
quantized_by: andrijdavid
Likes: 1 | All-time downloads: 3520
Created: 2024-04-30 06:31:08