Can't load or quant model
#1
by
bartowski
- opened
Seems like something is off in your tokenizer.json, any chance you can look into it? Getting
Tokenizer.from_file(tokenizer_json)
Exception: data did not match any variant of untagged enum PyPreTokenizerTypeWrapper at line 12564 column 3
I updated the tokenizer.json and you can try again or install transformer version 4.39
@bartowski can we wait the quantised version? :)
@bartowski can we wait the quantised version? :)
you can find a quantised version at https://huggingface.co/Monor/Nxcode-CQ-7B-orpo-gguf.