Please post the imatrix that was used to quantize
#1
by
Joseph717171
- opened
Very, much appreciate what you and your company are doing - great work. However, can you please post the imatrix that you used to quantize the models to GGUF? It would be an invaluable resource to the community. Thanks in advance 🙏😁
Very, much appreciate what you and your company are doing - great work. However, can you please post the imatrix that you used to quantize the models to GGUF? It would be an invaluable resource to the community. Thanks in advance 🙏😁
Hey @Joseph717171 thanks a lot for the support! You can find the Imatrix here: https://huggingface.co/PrunaAI/Meta-Llama-3-8B-Instruct-GGUF-Imatrix-smashed
sharpenb
changed discussion status to
closed