huggingface-course
/

albert-tokenizer-without-normalizer

albert-tokenizer-without-normalizer / tokenizer_config.json

add modified albert tokenizer

67b371b over 2 years ago

No virus

43 Bytes

	{
	"tokenizer_class": "AlbertTokenizer"
	}