README.md

---
license: apache-2.0
tags:
- merge
- mergekit
- lazymergekit
- unsloth/Llama-3.2-3B-Instruct
- Lyte/Llama-3.2-3B-Overthinker
- huihui-ai/Llama-3.2-3B-Instruct-abliterated
---

# Llama-3.2-8B-Instruct

Llama-3.2-8B-Instruct is a merge of the following models using [mergekit](https://github.com/cg123/mergekit):
* [unsloth/Llama-3.2-3B-Instruct](https://huggingface.co/unsloth/Llama-3.2-3B-Instruct)
* [Lyte/Llama-3.2-3B-Overthinker](https://huggingface.co/Lyte/Llama-3.2-3B-Overthinker)
* [huihui-ai/Llama-3.2-3B-Instruct-abliterated](https://huggingface.co/huihui-ai/Llama-3.2-3B-Instruct-abliterated)

## 🧩 Configuration

```yaml
slices:
  - sources:
      - model: unsloth/Llama-3.2-3B-Instruct
        layer_range: [0, 24]
  - sources:
      - model: Lyte/Llama-3.2-3B-Overthinker
        layer_range: [4, 24]
  - sources:
      - model: huihui-ai/Llama-3.2-3B-Instruct-abliterated
        layer_range: [8, 28]
merge_method: passthrough
dtype: bfloat16
```