Could not locate the tokenization_chatglm.py inside THUDM/chatglm3-6b.
#39
by
creekmooon
- opened
tokenizer_config.json
"auto_map": {
"AutoTokenizer": [
"THUDM/chatglm3-6b--tokenization_chatglm.ChatGLMTokenizer",
null
]
tokenization_chatglm.ChatGLMTokenizer
ttry to change "THUDM/chatglm3-6b--tokenization_chatglm.ChatGLMTokenizer" to "tokenization_chatglm.ChatGLMTokenizer"
ttry to change "THUDM/chatglm3-6b--tokenization_chatglm.ChatGLMTokenizer" to "tokenization_chatglm.ChatGLMTokenizer"
yea, after the modification, the model can be loaded normally.
creekmooon
changed discussion status to
closed