Model: mlx-community/starcoder2-15b-instruct-v0.1-4bit
Author: mlx-community
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, starcoder2, text-generation, code, mlx, conversational, dataset:bigcode/self-oss-instruct-sc2-exec-filter-50k, base_model:bigcode/starcoder2-15b, base_model:finetune:bigcode/starcoder2-15b, license:bigcode-openrail-m, model-index, text-generation-inference, endpoints_compatible, region:us
Base models (finetune): id: bigcode/starcoder2-15b
Card metadata: license: bigcode-openrail-m
library_name: transformers
tags: code, mlx
base_model: bigcode/starcoder2-15b
datasets: bigcode/self-oss-instruct-sc2-exec-filter-50k
pipeline_tag: text-generation
model-index: name: starcoder2-15b-instruct-v0.1
results: task: type: text-generation
dataset: name: LiveCodeBench (code generation)
type: livecodebench-codegeneration
metrics: type: pass@1
value: 20.4
verified: no, task: type: text-generation
dataset: name: LiveCodeBench (self repair)
type: livecodebench-selfrepair
metrics: type: pass@1
value: 20.9
verified: no, task: type: text-generation
dataset: name: LiveCodeBench (test output prediction)
type: livecodebench-testoutputprediction
metrics: type: pass@1
value: 29.8
verified: no, task: type: text-generation
dataset: name: LiveCodeBench (code execution)
type: livecodebench-codeexecution
metrics: type: pass@1
value: 28.1
verified: no, task: type: text-generation
dataset: name: HumanEval
type: humaneval
metrics: type: pass@1
value: 72.6
verified: no, task: type: text-generation
dataset: name: HumanEval+
type: humanevalplus
metrics: type: pass@1
value: 63.4
verified: no, task: type: text-generation
dataset: name: MBPP
type: mbpp
metrics: type: pass@1
value: 75.2
verified: no, task: type: text-generation
dataset: name: MBPP+
type: mbppplus
metrics: type: pass@1
value: 61.2
verified: no, task: type: text-generation
dataset: name: DS-1000
type: ds-1000
metrics: type: pass@1
value: 40.6
verified: no
Likes: 0 | All-time downloads: 300
Created: 2024-04-29 20:55:58