File size: 313 Bytes
7381e93 68b4f64 86dbef4 7381e93 86dbef4 1ac5eb9 86dbef4 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
---
license: llama2
tags:
- moe
- merge
---
<img src=https://huggingface.co/lodrick-the-lafted/Grafted-Llama2-2x70B/resolve/main/gl.png>
The Llamas are WinterGoddess + AuroraNights.
This is yet another mergekit abomination.
Still undergoing testing.
This is probably more of a "dense" MoE than a sparse one.
|