---
license: llama3
language:
- en
- ja
- de
- zh
---

## LLama-3-3x8b-multilingual
This model is MoE merge of following three models
1. namespace-Pt/Llama-3-8B-Instruct-80K-QLoRA-Merged
2. meta-llama/Meta-Llama-3-8B-Instruct
3. lightblue/suzume-llama-3-8B-multilingual

The model has context length of 80k.