-
-
-
-
-
-
Inference status
Active filters:
gptq
hugging-quants/Meta-Llama-3.1-405B-Instruct-GPTQ-INT4
Text Generation
•
Updated
•
1.26k
•
11
hugging-quants/Meta-Llama-3.1-70B-Instruct-GPTQ-INT4
Text Generation
•
Updated
•
1.22k
•
5
hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4
Text Generation
•
Updated
•
1.85k
•
6
TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ
Text Generation
•
Updated
•
951
•
553
Qwen/Qwen2-0.5B-Instruct-GPTQ-Int4
Text Generation
•
Updated
•
1.4k
•
10
ArthurGprog/Codestral-22B-v0.1-FIM-Fix-GPTQ
Text Generation
•
Updated
•
178
•
2
neuralmagic/Qwen2-72B-Instruct-quantized.w4a16
Text Generation
•
Updated
•
40
•
3
ModelCloud/gemma-2-27b-it-gptq-4bit
Text Generation
•
Updated
•
1.3k
•
3
ModelCloud/Meta-Llama-3.1-405B-Instruct-gptq-4bit
Text Generation
•
Updated
•
2
TheBloke/WizardLM-7B-uncensored-GPTQ
Text Generation
•
Updated
•
670
•
188
TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ
Text Generation
•
Updated
•
3.89k
•
310
TheBloke/guanaco-13B-GPTQ
Text Generation
•
Updated
•
61
•
29
TheBloke/WizardLM-Uncensored-SuperCOT-StoryTelling-30B-GPTQ
Text Generation
•
Updated
•
92
•
84
TheBloke/WizardCoder-15B-1.0-GPTQ
Text Generation
•
Updated
•
166
•
178
TheBloke/CAMEL-13B-Role-Playing-Data-SuperHOT-8K-GPTQ
Text Generation
•
Updated
•
33
•
7
TheBloke/Llama-2-70B-GPTQ
Text Generation
•
Updated
•
1.85k
•
82
TheBloke/llama2_7b_chat_uncensored-GPTQ
Text Generation
•
Updated
•
89
•
66
TheBloke/airoboros-l2-13B-gpt4-1.4.1-GPTQ
Text Generation
•
Updated
•
54
•
29
TheBloke/MythoMax-L2-13B-GPTQ
Text Generation
•
Updated
•
4.84k
•
171
TheBloke/CodeLlama-13B-Instruct-GPTQ
Text Generation
•
Updated
•
1.13k
•
37
Qwen/Qwen-VL-Chat-Int4
Text Generation
•
Updated
•
16.4k
•
85
TheBloke/Baichuan2-13B-Chat-GPTQ
Text Generation
•
Updated
•
29
•
20
TheBloke/storytime-13B-GPTQ
Text Generation
•
Updated
•
656
•
22
TheBloke/Mistral-7B-Instruct-v0.1-GPTQ
Text Generation
•
Updated
•
349k
•
74
TheBloke/Nous-Capybara-7B-GPTQ
Text Generation
•
Updated
•
14
•
3
squarelike/Gugugo-koen-7B-V1.1-GPTQ
Translation
•
Updated
•
31
•
3
TheBloke/Nous-Capybara-7B-v1.9-GPTQ
Text Generation
•
Updated
•
16
•
3
TheBloke/Nous-Capybara-3B-v1.9-GPTQ
Text Generation
•
Updated
•
16
•
8
TheBloke/OpenHermes-2.5-Mistral-7B-GPTQ
Text Generation
•
Updated
•
641
•
27
TheBloke/MythoMist-7B-GPTQ
Text Generation
•
Updated
•
23
•
4