iproskurina/Mistral-7B-v0.3-GPTQ-4bit-g128
Text Generation
•
Updated
•
39
Quantized LLMs
LLMs quantized with GPTQ
-
-
iproskurina/bloom-7b1-GPTQ-4bit-g128
Text Generation • Updated • 42 • 2 -
iproskurina/bloom-1b7-GPTQ-4bit-g128
Text Generation • Updated • 30 -
iproskurina/bloom-3b-GPTQ-4bit-g128
Text Generation • Updated • 27 -
iproskurina/bloom-560m-GPTQ-4bit-g128
Text Generation • Updated • 13 -
iproskurina/bloom-1b1-GPTQ-4bit-g128
Text Generation • Updated • 11 -
iproskurina/opt-2.7b-GPTQ-4bit-g128
Text Generation • Updated • 39 -
iproskurina/opt-13b-GPTQ-4bit-g128
Text Generation • Updated • 39 -
iproskurina/opt-6.7b-GPTQ-4bit-g128
Text Generation • Updated • 23 -
iproskurina/opt-125m-GPTQ-4bit-g128
Text Generation • Updated • 23 -
iproskurina/opt-350m-GPTQ-4bit-g128
Text Generation • Updated • 19 -
iproskurina/opt-1.3b-GPTQ-4bit-g128
Text Generation • Updated • 24 -
iproskurina/Mistral-7B-v0.1-GPTQ-8bit-g128
Text Generation • Updated • 43 -
iproskurina/Mistral-7B-v0.3-GPTQ-8bit-g128
Text Generation • Updated • 41 -
iproskurina/Mistral-7B-v0.1-GPTQ-3bit-g64
Text Generation • Updated • 23 -
iproskurina/Mistral-7B-v0.1-GPTQ-8bit-g64
Text Generation • Updated • 23 -
iproskurina/Mistral-7B-v0.1-GPTQ-4bit-g128
Text Generation • Updated • 22 -
iproskurina/Mistral-7B-v0.1-GPTQ-3bit-g128
Text Generation • Updated • 21 -
TheBloke/Mistral-7B-Instruct-v0.1-GPTQ
Text Generation • Updated • 365k • 77 -
TheBloke/Mistral-7B-Instruct-v0.2-GPTQ
Text Generation • Updated • 354k • 49 -
TheBloke/bloomz-176B-GPTQ
Text Generation • Updated • 57 • 20 -
TheBloke/BLOOMChat-176B-v1-GPTQ
Text Generation • Updated • 21 • 31 -
TheBloke/Llama-2-13B-chat-GPTQ
Text Generation • Updated • 16.4k • 362