tokyotech-llm
/

Swallow-MX-8x7b-NVE-v0.1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Taishi-N324 commited on May 3

Commit

518e312

•

1 Parent(s): 47ea8db

Upload README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -109,7 +109,7 @@ The following datasets were used for continual pre-training.
 - [Algebraic Stack](https://huggingface.co/datasets/EleutherAI/proof-pile-2)
 - [Japanese Wikipedia](https://dumps.wikimedia.org/other/cirrussearch)
 - [RefinedWeb](https://huggingface.co/datasets/tiiuae/falcon-refinedweb)
-- [Swallow Corpus](https://chokkan.org/temp/tokyotech-llm/swallow-corpus)
 - [The Pile](https://huggingface.co/datasets/EleutherAI/pile)
 - [The Vault](https://github.com/FSoft-AI4Code/TheVault)

 - [Algebraic Stack](https://huggingface.co/datasets/EleutherAI/proof-pile-2)
 - [Japanese Wikipedia](https://dumps.wikimedia.org/other/cirrussearch)
 - [RefinedWeb](https://huggingface.co/datasets/tiiuae/falcon-refinedweb)
+- [Swallow Corpus](https://arxiv.org/abs/2404.17733)
 - [The Pile](https://huggingface.co/datasets/EleutherAI/pile)
 - [The Vault](https://github.com/FSoft-AI4Code/TheVault)