Could not locate the tokenization_chatglm.py inside THUDM/chatglm3-6b.

#39
by creekmooon - opened

tokenizer_config.json
"auto_map": {
"AutoTokenizer": [
"THUDM/chatglm3-6b--tokenization_chatglm.ChatGLMTokenizer",
null
]
tokenization_chatglm.ChatGLMTokenizer

ttry to change "THUDM/chatglm3-6b--tokenization_chatglm.ChatGLMTokenizer" to "tokenization_chatglm.ChatGLMTokenizer"

ttry to change "THUDM/chatglm3-6b--tokenization_chatglm.ChatGLMTokenizer" to "tokenization_chatglm.ChatGLMTokenizer"

yea, after the modification, the model can be loaded normally.

creekmooon changed discussion status to closed

Sign up or log in to comment