README.md

metadata

license: llama2
tags:
  - moe
  - merge

The Llamas are WinterGoddess + AuroraNights.

This is yet another mergekit abomination.

Still undergoing testing.

This is probably more of a "dense" MoE than a sparse one.