Model: tensorblock/starcoder2-15b-instruct-v0.1-GGUF
Author: tensorblock
Pipeline: text-generation
Library: transformers
Tags: transformers, gguf, code, TensorBlock, GGUF, text-generation, dataset:bigcode/self-oss-instruct-sc2-exec-filter-50k, base_model:bigcode/starcoder2-15b-instruct-v0.1, base_model:quantized:bigcode/starcoder2-15b-instruct-v0.1, license:bigcode-openrail-m, model-index, endpoints_compatible, region:us, conversational
Base models (quantized): id: bigcode/starcoder2-15b-instruct-v0.1
Card metadata: pipeline_tag: text-generation
base_model: bigcode/starcoder2-15b-instruct-v0.1
datasets: bigcode/self-oss-instruct-sc2-exec-filter-50k
license: bigcode-openrail-m
library_name: transformers
tags: code, TensorBlock, GGUF
model-index: name: starcoder2-15b-instruct-v0.1
results: task: type: text-generation
dataset: name: LiveCodeBench (code generation)
type: livecodebench-codegeneration
metrics: type: pass@1
value: 20.4
verified: no, task: type: text-generation
dataset: name: LiveCodeBench (self repair)
type: livecodebench-selfrepair
metrics: type: pass@1
value: 20.9
verified: no, task: type: text-generation
dataset: name: LiveCodeBench (test output prediction)
type: livecodebench-testoutputprediction
metrics: type: pass@1
value: 29.8
verified: no, task: type: text-generation
dataset: name: LiveCodeBench (code execution)
type: livecodebench-codeexecution
metrics: type: pass@1
value: 28.1
verified: no, task: type: text-generation
dataset: name: HumanEval
type: humaneval
metrics: type: pass@1
value: 72.6
verified: no, task: type: text-generation
dataset: name: HumanEval+
type: humanevalplus
metrics: type: pass@1
value: 63.4
verified: no, task: type: text-generation
dataset: name: MBPP
type: mbpp
metrics: type: pass@1
value: 75.2
verified: no, task: type: text-generation
dataset: name: MBPP+
type: mbppplus
metrics: type: pass@1
value: 61.2
verified: no, task: type: text-generation
dataset: name: DS-1000
type: ds-1000
metrics: type: pass@1
value: 40.6
verified: no
Likes: 0 | All-time downloads: 1949
Created: 2024-11-13 20:29:02