Model: mlx-community/stable-code-3b-mlx
Author: mlx-community
Pipeline: text-generation
Library: transformers
Tags: transformers, stablelm_epoch, text-generation, causal-lm, code, mlx, custom_code, en, dataset:tiiuae/falcon-refinedweb, dataset:bigcode/the-stack-github-issues, dataset:bigcode/commitpackft, dataset:bigcode/starcoderdata, dataset:EleutherAI/proof-pile-2, dataset:meta-math/MetaMathQA, license:other, model-index, region:us
Card metadata: language: en
license: other
library_name: transformers
tags: causal-lm, code, mlx
datasets: tiiuae/falcon-refinedweb, bigcode/the-stack-github-issues, bigcode/commitpackft, bigcode/starcoderdata, EleutherAI/proof-pile-2, meta-math/MetaMathQA
metrics: code_eval
model-index: name: StarCoderBase-3B
results: task: type: text-generation
dataset: name: MultiPL-HumanEval (Python)
type: nuprl/MultiPL-E
metrics: type: pass@1
value: 32.4
name: pass@1
verified: no, type: pass@1
value: 30.9
name: pass@1
verified: no, type: pass@1
value: 32.1
name: pass@1
verified: no, type: pass@1
value: 32.1
name: pass@1
verified: no, type: pass@1
value: 24.2
name: pass@1
verified: no, type: pass@1
value: 23
name: pass@1
verified: no
Likes: 1 | All-time downloads: 339
Created: 2024-01-17 03:38:22