Untitled Model (1)

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Model Stock merge method using /mnt/mx22b_e1 as a base.

Models Merged

The following models were included in the merge:

/mnt/mx22b_e6
/mnt/mx22b_e3
/mnt/mx22b_e2
/mnt/mx22b_e5
/mnt/mx22b_e7
/mnt/mx22b_e4
/mnt/mx22b_e8

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: /mnt/mx22b_e1
  - model: /mnt/mx22b_e2
  - model: /mnt/mx22b_e3
  - model: /mnt/mx22b_e4
  - model: /mnt/mx22b_e5
  - model: /mnt/mx22b_e6
  - model: /mnt/mx22b_e7
  - model: /mnt/mx22b_e8
merge_method: model_stock
base_model: /mnt/mx22b_e1
dtype: bfloat16