| license: llama3 | |
| language: | |
| - en | |
| - ja | |
| - de | |
| - zh | |
| ## LLama-3-3x8b-multilingual | |
| This model is MoE merge of following three models | |
| 1. namespace-Pt/Llama-3-8B-Instruct-80K-QLoRA-Merged | |
| 2. meta-llama/Meta-Llama-3-8B-Instruct | |
| 3. lightblue/suzume-llama-3-8B-multilingual | |
| The model has context length of 80k. |