Nous-Hermes-2_openchat-3.5_32layers
Nous-Hermes-2_openchat-3.5_32layers is a merge of the following models using mergekit:
🧩 Configuration
slices:
- sources:
- model: openchat/openchat-3.5-0106
layer_range: [0, 32]
- sources:
- model: NousResearch/Nous-Hermes-2-SOLAR-10.7B
layer_range: [24, 32]
merge_method: passthrough
dtype: bfloat16
- Downloads last month
- 1
Model is too large to load in Inference API (serverless). To try the model, launch it on Inference Endpoints (dedicated)
instead.