Text Generation
Transformers
GGUF
code
Eval Results
Inference Endpoints
conversational
munish0838's picture
Create README.md
59b8205 verified
metadata
pipeline_tag: text-generation
base_model: bigcode/starcoder2-15b-instruct-v0.1
datasets:
  - bigcode/self-oss-instruct-sc2-exec-filter-50k
license: bigcode-openrail-m
library_name: transformers
tags:
  - code
model-index:
  - name: starcoder2-15b-instruct-v0.1
    results:
      - task:
          type: text-generation
        dataset:
          name: LiveCodeBench (code generation)
          type: livecodebench-codegeneration
        metrics:
          - type: pass@1
            value: 20.4
      - task:
          type: text-generation
        dataset:
          name: LiveCodeBench (self repair)
          type: livecodebench-selfrepair
        metrics:
          - type: pass@1
            value: 20.9
      - task:
          type: text-generation
        dataset:
          name: LiveCodeBench (test output prediction)
          type: livecodebench-testoutputprediction
        metrics:
          - type: pass@1
            value: 29.8
      - task:
          type: text-generation
        dataset:
          name: LiveCodeBench (code execution)
          type: livecodebench-codeexecution
        metrics:
          - type: pass@1
            value: 28.1
      - task:
          type: text-generation
        dataset:
          name: HumanEval
          type: humaneval
        metrics:
          - type: pass@1
            value: 72.6
      - task:
          type: text-generation
        dataset:
          name: HumanEval+
          type: humanevalplus
        metrics:
          - type: pass@1
            value: 63.4
      - task:
          type: text-generation
        dataset:
          name: MBPP
          type: mbpp
        metrics:
          - type: pass@1
            value: 75.2
      - task:
          type: text-generation
        dataset:
          name: MBPP+
          type: mbppplus
        metrics:
          - type: pass@1
            value: 61.2
      - task:
          type: text-generation
        dataset:
          name: DS-1000
          type: ds-1000
        metrics:
          - type: pass@1
            value: 40.6

StarCoder2-Instruct-GGUF

Model Summary

We introduce StarCoder2-15B-Instruct-v0.1, the very first entirely self-aligned code Large Language Model (LLM) trained with a fully permissive and transparent pipeline. Our open-source pipeline uses StarCoder2-15B to generate thousands of instruction-response pairs, which are then used to fine-tune StarCoder-15B itself without any human annotations or distilled data from huge and proprietary LLMs.

self-alignment pipeline

Use

Intended use

The model is designed to respond to coding-related instructions in a single turn. Instructions in other styles may result in less accurate responses.

Bias, Risks, and Limitations

StarCoder2-15B-Instruct-v0.1 is primarily finetuned for Python code generation tasks that can be verified through execution, which may lead to certain biases and limitations. For example, the model might not adhere strictly to instructions that dictate the output format. In these situations, it's beneficial to provide a response prefix or a one-shot example to steer the model’s output. Additionally, the model may have limitations with other programming languages and out-of-domain coding tasks.

The model also inherits the bias, risks, and limitations from its base StarCoder2-15B model. For more information, please refer to the StarCoder2-15B model card.

Evaluation on EvalPlus, LiveCodeBench, and DS-1000

EvalPlus

LiveCodeBench and DS-1000

Training Details

Hyperparameters

  • Optimizer: Adafactor
  • Learning rate: 1e-5
  • Epoch: 4
  • Batch size: 64
  • Warmup ratio: 0.05
  • Scheduler: Linear
  • Sequence length: 1280
  • Dropout: Not applied

Hardware

1 x NVIDIA A100 80GB

Resources