File size: 458 Bytes
d741b13 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 |
slices:
- sources:
- model: NousResearch/Meta-Llama-3-8B
layer_range: [0,9]
- sources:
- model: NousResearch/Meta-Llama-3-8B
layer_range: [5,14]
- sources:
- model: NousResearch/Meta-Llama-3-8B
layer_range: [10,19]
- sources:
- model: NousResearch/Meta-Llama-3-8B
layer_range: [15,24]
- sources:
- model: NousResearch/Meta-Llama-3-8B
layer_range: [20,32]
merge_method: passthrough
dtype: bfloat16
|