--- license: bigscience-bloom-rail-1.0 --- # Tokenizer used for all BLOOM models Tokenizer information are provided at [https://huggingface.co/bigscience/bloom#preprocessing](https://huggingface.co/bigscience/bloom#preprocessing) TODO: point to paper once it comes out with extra details on the tokenizer