bruhzair/Mutant-Writer-t3-123b

Mutant-t2

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Linear merge method.

Models Merged

The following models were included in the merge:

• /workspace/cache/models--anthracite-org--magnum-v4-123b/snapshots/68fdd395bf5282429aa11d3b2737add1944243b3
• /workspace/cache/models--TheDrummer--Behemoth-123B-v1.2/snapshots/51354019a02b742aa5a73fe16800225ff719c46d
• /workspace/cache/models--gghfez--Writer-Large-2411-v2.1/snapshots/cb12d12db43e04ae42ac7a3c3ac987c867fd4757

Configuration

The following YAML configuration was used to produce this model:

dtype: float16
merge_method: linear
slices:
- sources:
  - layer_range: [0, 88]
    model: /workspace/cache/models--gghfez--Writer-Large-2411-v2.1/snapshots/cb12d12db43e04ae42ac7a3c3ac987c867fd4757
    parameters:
      weight: 0.7
  - layer_range: [0, 88]
    model: /workspace/cache/models--TheDrummer--Behemoth-123B-v1.2/snapshots/51354019a02b742aa5a73fe16800225ff719c46d
    parameters:
      weight: 0.65
  - layer_range: [0, 88]
    model: /workspace/cache/models--anthracite-org--magnum-v4-123b/snapshots/68fdd395bf5282429aa11d3b2737add1944243b3
    parameters:
      weight: 0.6