no tokenizer.json

#2
by Eruuu - opened

no tokenizer.json

There is indeed no tokenizer.json in this repo. There is no tokenizer.json in the repo for the base model I tuned this off of either. While I haven't personally used this unquantized version for inference, I know for a fact it is (or at the very least, was) possible to quantize it.

Which stack are you using that insists such a file is required?

I don't have any plan to quantize or finetune the model, yet, at least. But there's this platform where I want to host the model at and it requires the tokenizer.json in order to run the model, that's why i require the file

Thank you!

Sign up or log in to comment