merge
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the TIES merge method using TheDrummer/Rocinante-12B-v1.1 as a base.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
models:
- model: anthracite-org/magnum-v4-12b
parameters:
density: 0.3
weight: 0.3
- model: TheDrummer/Rocinante-12B-v1.1
parameters:
density: 0.7
weight: 0.5
- model: VongolaChouko/Starcannon-Unleashed-12B-v1.0
parameters:
density: 0.1
weight: 0.2
merge_method: ties
base_model: TheDrummer/Rocinante-12B-v1.1
parameters:
normalize: true
int8_mask: true
dtype: bfloat16
- Downloads last month
- 14
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
Model tree for bazwyn/Stage1-12B
Merge model
this model