Text Generation
GGUF

Testing experimental quants

#2
by bartowski - opened

@ZeroWw try to compare these ones if you can

I'm going to be testing Meta-Llama-3-8B-Instruct-f16-q4_K_S.gguf against Meta-Llama-3-8B-Instruct-q4_K_S.gguf, I'll share any findings in this thread

excellent, I appreciate it!!

Sign up or log in to comment