starchat

starchat is a merge of the following models using mergekit:

🧩 Configuration

slices:
  - sources:
      - model: bigcode/starcoder-chat
        layer_range: [0, 32]
      - model: bigcode/starcoder
        layer_range: [0, 32]
merge_method: slerp
base_model: bigcode/starcoder
parameters:
  t:
    - filter: self_attn
      value: [0, 0.5, 0.3, 0.7, 1]
    - filter: mlp
      value: [1, 0.5, 0.7, 0.3, 0]
    - value: 0.5
dtype: bfloat16

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.