README.md

metadata

base_model:
  - xdrshjr/llama3.2_1b_uncensored_5000_8epoch_lora
  - cognitivecomputations/Dolphin3.0-Llama3.2-1B
  - diabolic6045/open-llama-3.2-1B-Instruct
  - huihui-ai/Llama-3.2-1B-Instruct-abliterated
library_name: transformers
tags:
  - mergekit
  - merge

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Model Stock merge method using cognitivecomputations/Dolphin3.0-Llama3.2-1B as a base.

Models Merged

The following models were included in the merge:

• xdrshjr/llama3.2_1b_uncensored_5000_8epoch_lora
• diabolic6045/open-llama-3.2-1B-Instruct
• huihui-ai/Llama-3.2-1B-Instruct-abliterated

Configuration

The following YAML configuration was used to produce this model:

models:
- model: diabolic6045/open-llama-3.2-1B-Instruct
- model: xdrshjr/llama3.2_1b_uncensored_5000_8epoch_lora
- model: cognitivecomputations/Dolphin3.0-Llama3.2-1B
- model: huihui-ai/Llama-3.2-1B-Instruct-abliterated
base_model: cognitivecomputations/Dolphin3.0-Llama3.2-1B
merge_method: model_stock
dtype: bfloat16
parameters:
  t: [0, 0.5, 1, 0.5, 0]