perky-103b-v0.1_exl2_3.35bpw / mergekit_config.yml
Dracones's picture
Upload folder using huggingface_hub
f26dc1b verified
raw
history blame contribute delete
No virus
288 Bytes
slices:
- sources:
- model: models/perky-70b-v0.1
layer_range: [0, 30]
- sources:
- model: models/perky-70b-v0.1
layer_range: [10, 70]
- sources:
- model: models/perky-70b-v0.1
layer_range: [50, 80]
merge_method: passthrough
dtype: float16