Confluence-Renegade-7B / mergekit_config.yml
Nekochu's picture
Add RoleBeagle-Moistral-7B-v2
83a3733 verified
slices:
- sources:
- model: ./models/Moistral-11B-v2
layer_range: [0, 48]
- sources:
- model: ./models/RoleBeagle-11B
layer_range: [34, 48]
merge_method: passthrough
parameters:
normalize: true
int8_mask: true
dtype: float16
name: RoleBeagle-Moistral-7B-v2