GGUF Version of LLAMA 3.1 Instruct
** Other quants are being uploaded **
2-bit
3-bit
4-bit
5-bit
8-bit