TheBlokes Base Llama 2 GPTQ's - a lallesx Collection

lallesx 's Collections

TheBlokes Base Llama 2 GGML's

TheBlokes Base Llama 2 GGUF's

TheBlokes Base Llama 2 GPTQ's

TheBlokes Base Llama quants

TheBlokes Base Llama 2 GPTQ's

updated Sep 10, 2023

His base GPTQ quants for Llama 2 & CodeLlama

TheBloke/Llama-2-7B-GPTQ

Text Generation • Updated Sep 27, 2023 • 517k • 80
TheBloke/Llama-2-7B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 121k • 262
TheBloke/Llama-2-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 5.55k • 120
TheBloke/Llama-2-13B-chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 16.5k • 362
TheBloke/Llama-2-70B-GPTQ

Text Generation • Updated Sep 27, 2023 • 1.75k • 83
TheBloke/Llama-2-70B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 9.96k • 260
TheBloke/CodeLlama-7B-GPTQ

Text Generation • Updated Sep 27, 2023 • 120 • 14
TheBloke/CodeLlama-7B-Instruct-GPTQ

Text Generation • Updated Sep 27, 2023 • 34.1k • 46
TheBloke/CodeLlama-7B-Python-GPTQ

Text Generation • Updated Sep 27, 2023 • 110 • 23
TheBloke/CodeLlama-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 116 • 11
TheBloke/CodeLlama-13B-Instruct-GPTQ

Text Generation • Updated Sep 27, 2023 • 417 • 38
TheBloke/CodeLlama-13B-Python-GPTQ

Text Generation • Updated Sep 27, 2023 • 95 • 20
TheBloke/CodeLlama-34B-GPTQ

Text Generation • Updated Sep 27, 2023 • 38 • 20
TheBloke/CodeLlama-34B-Instruct-GPTQ

Text Generation • Updated Sep 27, 2023 • 205 • 74
TheBloke/CodeLlama-34B-Python-GPTQ

Text Generation • Updated Sep 27, 2023 • 40 • 14