README.md

metadata

license: llama3
language:
  - en
  - ja
  - de
  - zh

LLama-3-3x8b-multilingual

This model is MoE merge of following three models

1. namespace-Pt/Llama-3-8B-Instruct-80K-QLoRA-Merged
2. meta-llama/Meta-Llama-3-8B-Instruct
3. lightblue/suzume-llama-3-8B-multilingual

The model has context length of 80k.