cahya
/

TestLM

Text Generation

Model card Files Files and versions Community

TestLM / tokenizer_config.json

cahya's picture

first commit

ccf67eb 4 months ago

242 Bytes

	{
	"name_or_path": "rwkv-world",
	"add_prefix_space": false,
	"tokenizer_class": "RWKVWorldTokenizer",
	"use_fast": false,
	"auto_map": {
	"AutoTokenizer": [
	"tokenization_rwkv_world.RWKVWorldTokenizer",
	null
	]
	}
	}