MrRobotoAI/219

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Linear merge method.

Models Merged

The following models were included in the merge:

• hf-100/Llama-3.1-8b-Spellbound-NaturalWriter-instruct-0.1-chkpt-608-16-bit
• MrRobotoAI/216 + Blackroot/Llama-3-LongStory-LORA
• MrRobotoAI/211
• MrRobotoAI/212 + marsfu2009/writer_lora
• MrRobotoAI/212 + hf-100/Llama-3.1-Spellbound-StoryWriter-0.1-lora

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: MrRobotoAI/212+marsfu2009/writer_lora
  - model: MrRobotoAI/216+Blackroot/Llama-3-LongStory-LORA
  - model: MrRobotoAI/212+hf-100/Llama-3.1-Spellbound-StoryWriter-0.1-lora
  - model: MrRobotoAI/211
  - model: hf-100/Llama-3.1-8b-Spellbound-NaturalWriter-instruct-0.1-chkpt-608-16-bit
parameters:
    weight: 1.0
merge_method: linear
dtype: float16