---
license: apache-2.0
datasets:
- pg19
metrics:
- perplexity
pipeline_tag: text-generation
---

Train in 30B Byte. Mode size 353M. Table 2 in [MambaByte](https://arxiv.org/abs/2401.13660)