File size: 223 Bytes
8d6d645 |
1 2 3 4 5 6 7 8 9 10 11 12 |
slices:
- sources:
- model: mlabonne/NeuralMonarch-7B
layer_range: [0, 24]
- sources:
- model: mlabonne/AlphaMonarch-7B
layer_range: [8, 32]
merge_method: passthrough
dtype: bfloat16
random_seed: 0
|