shqiponja-59b-v1 / README.md
nisten's picture
Upload folder using huggingface_hub
7cb4c7b verified
metadata
base_model:
  - jondurbin/nontoxic-bagel-34b-v0.2
tags:
  - mergekit
  - frankenstein

merged

Meow, picked these two models specifically to compliment each others strengths. mergekit.

Merge Details

Merge Method

This model was merged using the Undi95 style passthrough merge method.

Models Merged

The following models were included in the merge:

  • NousResearch/Nous-Hermes-2-Yi-34B
  • jondurbin/nontoxic-bagel-34b-v0.2

Configuration

The following YAML configuration was used to produce this model:

dtype: bfloat16
merge_method: passthrough
slices:
- sources:
  - layer_range: [0, 52]
    model: /home/admin/nv1/nontoxic-bagel-34b-v0.2
- sources:
  - layer_range: [8, 60]
    model: /home/admin/nv1/Nous-Hermes-2-Yi-34B

enjoy