NeuralQuant-9B
This model is a merge of the following models made with mergekit:
🧩 Configuration
slices:
- sources:
- model: quantumaikr/quantum-v0.01
layer_range: [0, 32]
- sources:
- model: mlabonne/NeuralHermes-2.5-Mistral-7B
layer_range: [24, 32]
merge_method: passthrough
dtype: bfloat16
- Downloads last month
- 419
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support