FileNotFoundError - the tokenizer.model file could not be found
Thank you for providing the gguf version of the model. I followed your suggestion and utilized make-ggml.py as instructed earlier. However, I encountered an error: FileNotFoundError - the tokenizer.model file could not be found. It seems that this file is not present in their directory. Can you confirm if you used the same make-ggml.py script as previously recommended? If affirmative, could you please specify where you obtained the tokenizer.model file?
This model uses a different tokenizer format, without tokenizer.model. Pass --vocabtype bpe to convert.py and it should work to make the FP16, from which you can make quantisations as usual.
Or just use my GGUFs? Or are you trying to make GGUF of an AquilaChat fine tune?
I would like to express my appreciation for your advice. I successfully quantized my fine-tuned AquilaChat model using --vocabtype bpe.