| license: apache-2.0 | |
| tags: | |
| - merge | |
| language: | |
| - en | |
|  | |
| # It will run...but on what hardware? | |
| ## 512 experts in one MoE | |
| [A giant merge of all the same model](https://huggingface.co/ahxt/LiteLlama-460M-1T) |