metadata

base_model:
  - RozGrov/NemoDori-v0.2-12B-MN-BT
  - crestf411/nemo-sunfall-v0.6.1
  - unsloth/Mistral-Nemo-Instruct-2407
  - UsernameJustAnother/Nemo-12B-Marlin-v5
library_name: transformers
tags:
  - mergekit
  - merge

NemoDori-v0.6-12B-MN-ties

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the TIES merge method using RozGrov/NemoDori-v0.2-12B-MN-BT as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:


models:
  - model: crestf411/nemo-sunfall-v0.6.1
    parameters:
      weight: 0.22
  - model: UsernameJustAnother/Nemo-12B-Marlin-v5
    parameters:
      weight: 0.22
  - model: unsloth/Mistral-Nemo-Instruct-2407
    parameters:
      weight: 0.22
  - model: RozGrov/NemoDori-v0.2-12B-MN-BT
    parameters:
      weight: 0.9
merge_method: ties
base_model: RozGrov/NemoDori-v0.2-12B-MN-BT
parameters:
    density: 0.93
dtype: bfloat16