| tags: | |
| - Multilingual | |
| license: mit | |
| language: | |
| - af | |
| - am | |
| - ar | |
| - hy | |
| - as | |
| - ast | |
| - az | |
| - be | |
| - bn | |
| - bs | |
| - bg | |
| - my | |
| - ca | |
| - ceb | |
| - zho | |
| - hr | |
| - cs | |
| - da | |
| - nl | |
| - en | |
| - et | |
| - tl | |
| - fi | |
| - fr | |
| - ff | |
| - gl | |
| - lg | |
| - ka | |
| - de | |
| - el | |
| - gu | |
| - ha | |
| - he | |
| - hi | |
| - hu | |
| - is | |
| - ig | |
| - id | |
| - ga | |
| - it | |
| - ja | |
| - jv | |
| - kea | |
| - kam | |
| - kn | |
| - kk | |
| - km | |
| - ko | |
| - ky | |
| - lo | |
| - lv | |
| - ln | |
| - lt | |
| - luo | |
| - lb | |
| - mk | |
| - ms | |
| - ml | |
| - mt | |
| - mi | |
| - mr | |
| - mn | |
| - ne | |
| - ns | |
| - no | |
| - ny | |
| - oc | |
| - or | |
| - om | |
| - ps | |
| - fa | |
| - pl | |
| - pt | |
| - pa | |
| - ro | |
| - ru | |
| - sr | |
| - sn | |
| - sd | |
| - sk | |
| - sl | |
| - so | |
| - ku | |
| - es | |
| - sw | |
| - sv | |
| - tg | |
| - ta | |
| - te | |
| - th | |
| - tr | |
| - uk | |
| - umb | |
| - ur | |
| - uz | |
| - vi | |
| - cy | |
| - wo | |
| - xh | |
| - yo | |
| - zu | |
| ### Model Sources | |
| - **Paper**: LLaMAX: Scaling Linguistic Horizons of LLM by Enhancing Translation Capabilities Beyond 100 Languages | |
| - **Link**: https://arxiv.org/pdf/2407.05975 | |
| - **Repository**: https://github.com/CONE-MT/LLaMAX/ | |
| - **Demo**: https://huggingface.co/spaces/vilarin/LLaMAX3-Translator Thanks for the efforts from @AnnioDance. | |
| ### Model Description | |
| LLaMAX3-8B is a multilingual language base model, developed through continued pre-training on Llama3, and supports over 100 languages. | |
| LLaMAX3-8B can serve as a base model to support downstream multilingual tasks but without instruct-following capability. | |
| We further fine-tune LLaMAX3-8B on Alpaca dataset to enhance its instruct-following capabilities. The model is available at https://huggingface.co/LLaMAX/LLaMAX3-8B-Alpaca. | |
| ### Supported Languages | |
| Akrikaans (af), Amharic (am), Arabic (ar), Armenian (hy), Assamese (as), Asturian (ast), Azerbaijani (az), Belarusian (be), Bengali (bn), Bosnian (bs), Bulgarian (bg), Burmese (my), Catalan (ca), Cebuano (ceb), Chinese Simpl (zho), Chinese Trad (zho), Croatian (hr), Czech (cs), Danish (da), Dutch (nl), English (en), Estonian (et), Filipino (tl), Finnish (fi), French (fr), Fulah (ff), Galician (gl), Ganda (lg), Georgian (ka), German (de), Greek (el), Gujarati (gu), Hausa (ha), Hebrew (he), Hindi (hi), Hungarian (hu), Icelandic (is), Igbo (ig), Indonesian (id), Irish (ga), Italian (it), Japanese (ja), Javanese (jv), Kabuverdianu (kea), Kamba (kam), Kannada (kn), Kazakh (kk), Khmer (km), Korean (ko), Kyrgyz (ky), Lao (lo), Latvian (lv), Lingala (ln), Lithuanian (lt), Luo (luo), Luxembourgish (lb), Macedonian (mk), Malay (ms), Malayalam (ml), Maltese (mt), Maori (mi), Marathi (mr), Mongolian (mn), Nepali (ne), Northern Sotho (ns), Norwegian (no), Nyanja (ny), Occitan (oc), Oriya (or), Oromo (om), Pashto (ps), Persian (fa), Polish (pl), Portuguese (pt), Punjabi (pa), Romanian (ro), Russian (ru), Serbian (sr), Shona (sn), Sindhi (sd), Slovak (sk), Slovenian (sl), Somali (so), Sorani Kurdish (ku), Spanish (es), Swahili (sw), Swedish (sv), Tajik (tg), Tamil (ta), Telugu (te), Thai (th), Turkish (tr), Ukrainian (uk), Umbundu (umb), Urdu (ur), Uzbek (uz), Vietnamese (vi), Welsh (cy), Wolof (wo), Xhosa (xh), Yoruba (yo), Zulu (zu) | |
| ### Model Index | |
| | Model | LLaMAX | LLaMAX-Alpaca | | |
| |---------|----------------------------------------------------------|-----------------------------------------------------------------| | |
| | Llama-2 | [Link](https://huggingface.co/LLaMAX/LLaMAX2-7B) | [Link](https://huggingface.co/LLaMAX/LLaMAX2-7B-Alpaca) | | |
| | Llama-3 | [Link](https://huggingface.co/LLaMAX/LLaMAX3-8B) | [Link](https://huggingface.co/LLaMAX/LLaMAX3-8B-Alpaca) | | |
| ### Citation | |
| If our model helps your work, please cite this paper: | |
| ``` | |
| @article{lu2024llamax, | |
| title={LLaMAX: Scaling Linguistic Horizons of LLM by Enhancing Translation Capabilities Beyond 100 Languages}, | |
| author={Lu, Yinquan and Zhu, Wenhao and Li, Lei and Qiao, Yu and Yuan, Fei}, | |
| journal={arXiv preprint arXiv:2407.05975}, | |
| year={2024} | |
| } | |
| ``` |