Model: osukhoroslov-hw/starcoder-Q5_K_M-GGUF
Author: osukhoroslov-hw
Pipeline: text-generation
Library: transformers
Tags: transformers, gguf, code, llama-cpp, gguf-my-repo, text-generation, dataset:bigcode/the-stack-dedup, base_model:bigcode/starcoder, base_model:quantized:bigcode/starcoder, license:bigcode-openrail-m, model-index, endpoints_compatible, region:us
Base models (quantized): id: bigcode/starcoder
Card metadata: base_model: bigcode/starcoder
datasets: bigcode/the-stack-dedup
library_name: transformers
license: bigcode-openrail-m
metrics: code_eval
pipeline_tag: text-generation
tags: code, llama-cpp, gguf-my-repo
inference: yes
widget: text: def print_hello_world():
example_title: Hello world
group: Python
extra_gated_prompt: ## Model License Agreement
Please read the BigCode [OpenRAIL-M license](https://huggingface.co/spaces/bigcode/bigcode-model-license-agreement) agreement before accepting it.
  
extra_gated_fields: I accept the above license agreement, and will use the Model complying with the set of use restrictions and sharing requirements: checkbox
model-index: name: StarCoder
results: task: type: text-generation
dataset: name: HumanEval (Prompted)
type: openai_humaneval
metrics: type: pass@1
value: 0.408
name: pass@1
verified: no, type: pass@1
value: 0.336
name: pass@1
verified: no, task: type: text-generation
dataset: name: MBPP
type: mbpp
metrics: type: pass@1
value: 0.527
name: pass@1
verified: no, task: type: text-generation
dataset: name: DS-1000 (Overall Completion)
type: ds1000
metrics: type: pass@1
value: 0.26
name: pass@1
verified: no, task: type: text-generation
dataset: name: MultiPL-HumanEval (C++)
type: nuprl/MultiPL-E
metrics: type: pass@1
value: 0.3155
name: pass@1
verified: no, type: pass@1
value: 0.2101
name: pass@1
verified: no, type: pass@1
value: 0.1357
name: pass@1
verified: no, type: pass@1
value: 0.1761
name: pass@1
verified: no, type: pass@1
value: 0.3022
name: pass@1
verified: no, type: pass@1
value: 0.2302
name: pass@1
verified: no, type: pass@1
value: 0.3079
name: pass@1
verified: no, type: pass@1
value: 0.2389
name: pass@1
verified: no, type: pass@1
value: 0.2608
name: pass@1
verified: no, type: pass@1
value: 0.1734
name: pass@1
verified: no, type: pass@1
value: 0.3357
name: pass@1
verified: no, type: pass@1
value: 0.155
name: pass@1
verified: no, type: pass@1
value: 0.0124
name: pass@1
verified: no, type: pass@1
value: 0.0007
name: pass@1
verified: no, type: pass@1
value: 0.2184
name: pass@1
verified: no, type: pass@1
value: 0.2761
name: pass@1
verified: no, type: pass@1
value: 0.1046
name: pass@1
verified: no, type: pass@1
value: 0.2274
name: pass@1
verified: no, type: pass@1
value: 0.3229
name: pass@1
verified: no
Likes: 0 | All-time downloads: 233
Created: 2024-07-12 17:55:44