Update README.md
Browse files
README.md
CHANGED
@@ -20,7 +20,7 @@ base_model: meta-llama/Llama-3.1-8B-Instruct
|
|
20 |
---
|
21 |
# Llama3.1 8B CPT SEA-LIONv3
|
22 |
SEA-LION is a collection of Large Language Models (LLMs) which has been pretrained and instruct-tuned for the Southeast Asia (SEA) region.
|
23 |
-
This is the card for the Llama3.1 8B CPT SEA-LIONv3 base model which has undergone continued pre-training from the instruct [Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct) model.
|
24 |
|
25 |
SEA-LION stands for <i>Southeast Asian Languages In One Network</i>.
|
26 |
|
@@ -93,7 +93,7 @@ Llama3.1 8B CPT SEA-LIONv3 base model was continued pre-trained on 200B tokens o
|
|
93 |
|
94 |
|
95 |
Note:
|
96 |
-
- All token counts are counted using Llama 3.1 tokenizer
|
97 |
- Wiki* sources includes Wikipedia, Wiki Books, Wiki Source, Wiki Voyage and Fandom Wiki
|
98 |
- News* sources includes VOA, Global Voices, MediaCorp, VinBigData-News
|
99 |
- Tamil news is sourced with permission from [Seithi](https://seithi.mediacorp.sg/)
|
|
|
20 |
---
|
21 |
# Llama3.1 8B CPT SEA-LIONv3
|
22 |
SEA-LION is a collection of Large Language Models (LLMs) which has been pretrained and instruct-tuned for the Southeast Asia (SEA) region.
|
23 |
+
This is the model card for the Llama3.1 8B CPT SEA-LIONv3 base model which has undergone continued pre-training from the instruct [Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct) model.
|
24 |
|
25 |
SEA-LION stands for <i>Southeast Asian Languages In One Network</i>.
|
26 |
|
|
|
93 |
|
94 |
|
95 |
Note:
|
96 |
+
- All token counts are counted using Llama 3.1 8B Instruct tokenizer
|
97 |
- Wiki* sources includes Wikipedia, Wiki Books, Wiki Source, Wiki Voyage and Fandom Wiki
|
98 |
- News* sources includes VOA, Global Voices, MediaCorp, VinBigData-News
|
99 |
- Tamil news is sourced with permission from [Seithi](https://seithi.mediacorp.sg/)
|