metadata

license: other
license_name: yi-34b
license_link: https://huggingface.co/01-ai/Yi-34B/blob/main/LICENSE

Nous-Hermes-2-SUS-Chat-2x34B

This is the model for Nous-Hermes-2-SUS-Chat-2x34B. I used mergekit to merge models.

Yaml Config

base_model: Yi-34B
gate_mode: hidden
dtype: bfloat16
experts:
  - source_model: Nous-Hermes-2-Yi-34B
    positive_prompts: [""]
  - source_model: SUS-Chat-34B
    positive_prompts: [""]