license: apache-2.0 | |
language: | |
- en | |
tags: | |
- merge | |
![image/png](https://i.ibb.co/xDWvPx4/00002-2540071728.png) | |
Test merge, a part of xxx777xxxASD/10.7B-Loyal-Mistral-Maid-32k-v0.2-A | |
### Loyal Toppy Maid | |
``` | |
slices: | |
- sources: | |
- model: Undi95/Toppy-M-7B | |
layer_range: [0, 24] | |
- sources: | |
- model: SanjiWatsuki/Loyal-Macaroni-Maid-7B | |
layer_range: [8, 32] | |
merge_method: passthrough | |
dtype: bfloat16 | |
``` | |