---
license: apache-2.0
language:
- en
tags:
- merge
- moe
---
![image/png](https://i.ibb.co/71BdpSQ/00005-1478892296.png)

Test "sandwich" merge, part of [xxx777xxxASD/PrimaMonarch-EroSumika-2x10.7B-128k](https://huggingface.co/xxx777xxxASD/PrimaMonarch-EroSumika-2x10.7B-128k)

[Exl2, 6.0 bpw](https://huggingface.co/xxx777xxxASD/PrimaSumika-10.7B-128k-bpw-6.0) (Fits in 12GB VRAM/42k context/4-bit cache)