GGUF quants of https://huggingface.co/WhiteRabbitNeo/Llama-3-WhiteRabbitNeo-8B-v2.0
4-bit
5-bit
6-bit