-
-
-
-
-
-
Inference status
Active filters:
awq
Qwen/Qwen2-VL-72B-Instruct-AWQ
Image-Text-to-Text
•
Updated
•
2.18M
•
23
Qwen/Qwen2.5-32B-Instruct-AWQ
Text Generation
•
Updated
•
17.6k
•
31
Qwen/Qwen2-VL-7B-Instruct-AWQ
Image-Text-to-Text
•
Updated
•
56k
•
33
hugging-quants/gemma-2-9b-it-AWQ-INT4
Text Generation
•
Updated
•
234
•
3
WisPerMed/Llama-3.1-SauerkrautLM-70b-Instruct-AWQ
Text Generation
•
Updated
•
75
•
3
hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4
Text Generation
•
Updated
•
9.09k
•
36
hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4
Text Generation
•
Updated
•
166k
•
81
Qwen/Qwen2.5-72B-Instruct-AWQ
Text Generation
•
Updated
•
22.9k
•
24
TheBloke/llama2_70b_chat_uncensored-AWQ
Text Generation
•
Updated
•
260
•
6
TheBloke/Pygmalion-2-7B-AWQ
Text Generation
•
Updated
•
82
•
5
TheBloke/Phind-CodeLlama-34B-v2-AWQ
Text Generation
•
Updated
•
211
•
32
TheBloke/Wizard-Vicuna-13B-Uncensored-AWQ
Text Generation
•
Updated
•
54
•
13
TheBloke/Wizard-Vicuna-30B-Uncensored-AWQ
Text Generation
•
Updated
•
251
•
13
TheBloke/WizardLM-7B-uncensored-AWQ
Text Generation
•
Updated
•
68
•
4
TheBloke/fin-llama-33B-AWQ
Text Generation
•
Updated
•
54
•
5
TheBloke/Mistral-7B-Instruct-v0.1-AWQ
Text Generation
•
Updated
•
486k
•
36
TheBloke/llava-v1.5-13B-AWQ
Text Generation
•
Updated
•
174
•
33
TheBloke/LLaMA2-13B-Tiefighter-AWQ
Text Generation
•
Updated
•
255
•
38
TheBloke/MetaMath-Mistral-7B-AWQ
Text Generation
•
Updated
•
182
•
1
TheBloke/Yarn-Mistral-7B-128k-AWQ
Text Generation
•
Updated
•
1.07k
•
71
TheBloke/OpenHermes-2.5-Mistral-7B-AWQ
Text Generation
•
Updated
•
7.1k
•
21
TheBloke/deepseek-coder-6.7B-instruct-AWQ
Text Generation
•
Updated
•
2.98k
•
15
TheBloke/deepseek-coder-6.7B-base-AWQ
Text Generation
•
Updated
•
14.1k
•
8
TheBloke/Qwen-7B-Chat-AWQ
Text Generation
•
Updated
•
38
•
8
01-ai/Yi-6B-Chat-4bits
Text Generation
•
Updated
•
620
•
20
ybelkada/Mixtral-8x7B-Instruct-v0.1-AWQ
Text Generation
•
Updated
•
18.4k
•
15
casperhansen/mixtral-instruct-awq
Text Generation
•
Updated
•
43.5k
•
43
TheBloke/dolphin-2.6-mistral-7B-AWQ
Text Generation
•
Updated
•
306
•
8
TheBloke/dolphin-2.6-mistral-7B-dpo-laser-AWQ
Text Generation
•
Updated
•
65
•
10
LuongNam/Vistral-7B-Chat-AWQ
Text Generation
•
Updated
•
11
•
2