Gguf conversion
#4
by
krjii
- opened
Has anyone successfully converted this model to gguf using the hf to gguf ? I get a unknown tokenizer error when running after quantitize.
I'm about to test this one -> https://huggingface.co/MoMonir/Llama-3-8B-Web-GGUF