Adds the tokenizer configuration file (#7)
Browse files- Adds tokenizer_config.json file (eb86b9eeabbb0344e3f71f12e08d06d9e89bf914)
Co-authored-by: Lysandre <lysandre@users.noreply.huggingface.co>
- Adds tokenizer_config.json file (eb86b9eeabbb0344e3f71f12e08d06d9e89bf914)
Co-authored-by: Lysandre <lysandre@users.noreply.huggingface.co>