Collection of quantized versions of Meta-Llama-3-8B-Instruct model
-
alokabhishek/Meta-Llama-3-8B-Instruct-bnb-8bit
Text Generation • Updated • 75 • 1 -
alokabhishek/Meta-Llama-3-8B-Instruct-bnb-4bit
Text Generation • Updated • 65 • 1 -
alokabhishek/Meta-Llama-3-8B-Instruct-5.0-bpw-exl2
Text Generation • Updated • 8 • 1 -
alokabhishek/Meta-Llama-3-8B-Instruct-6.0-bpw-exl2
Text Generation • Updated • 5 • 1