-
-
-
-
-
-
Inference status
Active filters:
4-bit
SeanScripts/NVLM-D-72B-nf4
Image-Text-to-Text
•
Updated
•
17.4k
•
7
Qwen/Qwen2.5-72B-Instruct-AWQ
Text Generation
•
Updated
•
11.6k
•
22
hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4
Text Generation
•
Updated
•
153k
•
78
hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4
Text Generation
•
Updated
•
227k
•
16
Qwen/Qwen2-VL-7B-Instruct-AWQ
Image-Text-to-Text
•
Updated
•
47.9k
•
29
Qwen/Qwen2.5-72B-Instruct-GPTQ-Int4
Text Generation
•
Updated
•
6.06k
•
15
mlx-community/Llama-3.2-3B-Instruct-4bit
Text Generation
•
Updated
•
2.38k
•
6
unsloth/llama-3-8b-Instruct-bnb-4bit
Text Generation
•
Updated
•
318k
•
125
unsloth/Meta-Llama-3.1-8B-bnb-4bit
Text Generation
•
Updated
•
289k
•
72
openbmb/MiniCPM-V-2_6-int4
Image-Text-to-Text
•
Updated
•
36.7k
•
59
Dharine/cropmodel-10k_mistral
Text Generation
•
Updated
•
582
•
2
Qwen/Qwen2-VL-72B-Instruct-AWQ
Image-Text-to-Text
•
Updated
•
2.17M
•
17
Qwen/Qwen2.5-32B-Instruct-GPTQ-Int4
Text Generation
•
Updated
•
3.16k
•
9
unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit
Updated
•
13k
•
23
unsloth/Llama-3.2-90B-Vision-Instruct-bnb-4bit
Updated
•
1.53k
•
9
cyan2k/molmo-7B-D-bnb-4bit
Text Generation
•
Updated
•
5.06k
•
12
zamal/Molmo-7B-GPTQ-4bit
Updated
•
55
•
2
TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ
Text Generation
•
Updated
•
6.56k
•
316
TheBloke/gorilla-7B-GPTQ
Text Generation
•
Updated
•
43
•
26
TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ
Text Generation
•
Updated
•
716
•
560
TheBloke/WizardLM-33B-V1-0-Uncensored-SuperHOT-8K-GPTQ
Text Generation
•
Updated
•
74
•
91
TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GPTQ
Text Generation
•
Updated
•
332
•
138
TheBloke/Llama-2-7B-Chat-GPTQ
Text Generation
•
Updated
•
80.2k
•
259
TheBloke/Llama-2-13B-chat-GPTQ
Text Generation
•
Updated
•
13.1k
•
361
TheBloke/airoboros-l2-13b-gpt4-m2.0-GPTQ
Text Generation
•
Updated
•
41
•
29
TheBloke/CodeLlama-7B-Instruct-GPTQ
Text Generation
•
Updated
•
98.5k
•
45
TheBloke/CodeLlama-13B-Instruct-GPTQ
Text Generation
•
Updated
•
375
•
38
Qwen/Qwen-VL-Chat-Int4
Text Generation
•
Updated
•
3k
•
88
TheBloke/Mythalion-13B-GPTQ
Text Generation
•
Updated
•
325
•
53
TheBloke/Chronos-70B-v2-GPTQ
Text Generation
•
Updated
•
33
•
11