README.md

metadata

license: apache-2.0
datasets:
  - pg19
metrics:
  - perplexity
pipeline_tag: text-generation

Train in 30B Byte. Mode size 353M. Table 2 in MambaByte