README.md

metadata

base_model:
  - vicgalle/NeuralBeagle-11B
  - jeonsworld/CarbonVillain-en-10.7B-v4
tags:
  - mergekit
  - merge
license: apache-2.0

CarbonBeagle-11B

An experiment in merging models of different architectures and sizes. Here are the steps:

1. Upscale mlabonne/NeuralBeagle14-7B to vicgalle/franken-Beagle-11B.
2. DPO-tune vicgalle/franken-Beagle-11B to vicgalle/NeuralBeagle-11B.
3. Merge vicgalle/NeuralBeagle-11B and jeonsworld/CarbonVillain-en-10.7B-v4.

Merge Details

Merge Method

This model was merged using the linear merge method.

Models Merged

The following models were included in the merge:

• vicgalle/NeuralBeagle-11B
• jeonsworld/CarbonVillain-en-10.7B-v4

Configuration

The following YAML configuration was used to produce this model:

models:
    - model: jeonsworld/CarbonVillain-en-10.7B-v4
      parameters:
        weight: 1.0
    - model: vicgalle/NeuralBeagle-11B
      parameters:
        weight: 0.5
merge_method: linear

dtype: float16