JayhC/Layris_9B-8bpw-h8-exl2

.

8bpw/h8 exl2 quantization of ChaoticNeutrals/Layris_9B using default exllamav2 calibration dataset.

---

ORIGINAL CARD:

Layris

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the passthrough merge method.

Models Merged

The following models were included in the merge:

• ChaoticNeutrals/Eris_Remix_7B
• l3utterfly/mistral-7b-v0.1-layla-v4

Configuration

The following YAML configuration was used to produce this model:

slices:
  - sources:
      - model: ChaoticNeutrals/Eris_Remix_7B
        layer_range: [0, 20]
  - sources:
      - model: l3utterfly/mistral-7b-v0.1-layla-v4
        layer_range: [12, 32]
merge_method: passthrough
dtype: float16