File size: 306 Bytes
d41a444 16242c4 d41a444 16242c4 |
1 2 3 4 5 6 7 8 |
---
license: bigscience-bloom-rail-1.0
---
# Tokenizer used for all BLOOM models
Tokenizer information are provided at [https://huggingface.co/bigscience/bloom#preprocessing](https://huggingface.co/bigscience/bloom#preprocessing)
TODO: point to paper once it comes out with extra details on the tokenizer |