README.md

metadata

base_model: []
library_name: transformers
tags:
  - mergekit
  - merge

Maid-Reborn-v22-10B

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the DARE TIES merge method using Maid-Reborn-v2-Remerge as a base.

Models Merged

The following models were included in the merge:

• Maid-Reborn-v2.1-Remerge

Configuration

The following YAML configuration was used to produce this model:

models: # Top-Loyal-Bruins-Maid-DARE-7B
  - model: Maid-Reborn-v2-Remerge
    # no parameters necessary for base model
  - model: Maid-Reborn-v2.1-Remerge
    parameters:
      weight: 0.50
      density: 0.5
  - model: Maid-Reborn-v2.1-Remerge
    parameters:
      weight: 0.50
      density: 0.5
merge_method: dare_ties
base_model: Maid-Reborn-v2-Remerge
parameters:
  int8_mask: true
dtype: bfloat16
name: Eclectic Maid