mesolitica
/

mallam-3B-4096

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

huseinzol05 commited on Dec 28, 2023

Commit

f7df233

•

1 Parent(s): bbb3867

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -3,7 +3,9 @@ language:
 - ms
 ---
-# MaLLaM 🌙 3B (Malaysia Large Language Model), Pretrain 3B 4096 context length Mistral on Malaysian text
 README at https://github.com/mesolitica/malaya/tree/5.1/pretrained-model/mistral

 - ms
 ---
+# MaLLaM 🌙 3B (Malaysia Large Language Model), Pretrain 3B 4096 context length on Malaysian text
+Pretrain from scratch 3B parameters using Mistral architecture on 90B Malaysian text tokens.
 README at https://github.com/mesolitica/malaya/tree/5.1/pretrained-model/mistral