-
-
-
-
-
-
Inference Providers
Active filters:
6-bit
MaziyarPanahi/Qwen2.5-7B-Instruct-GGUF
Text Generation
•
Updated
•
1.89M
•
9
MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF
Text Generation
•
Updated
•
1M
•
11
MaziyarPanahi/Llama-3.2-1B-Instruct-GGUF
Text Generation
•
Updated
•
1.89M
•
8
NeoChen1024/gemma-2-9B-it-advanced-v2.1-exl2-6.0bpw-h8
Text Generation
•
Updated
•
9
•
2
Jellon/aya-expanse-32b-exl2-6bpw
Text Generation
•
Updated
•
24
•
1
MaziyarPanahi/Qwen2.5-7B-Instruct-abliterated-v2-GGUF
Text Generation
•
Updated
•
522
•
3
MaziyarPanahi/llm_3_2_flux_prompt-GGUF
Text Generation
•
Updated
•
241
•
2
MaziyarPanahi/Llama-3.2-1B-GGUF
Text Generation
•
Updated
•
137
•
1
MaziyarPanahi/SmolLM2-135M-Instruct-GGUF
Text Generation
•
Updated
•
98
•
2
mlx-community/Qwen2.5-72B-Instruct-6bit
Text Generation
•
Updated
•
24
•
1
MaziyarPanahi/Sailor2-8B-Chat-GGUF
Text Generation
•
Updated
•
34
•
3
MaziyarPanahi/Llama-3.3-70B-Instruct-GGUF
Text Generation
•
Updated
•
942k
•
12
MaziyarPanahi/Pleias-Nano-GGUF
Text Generation
•
Updated
•
166
•
5
MaziyarPanahi/AngelSlayer-12B-Unslop-Mell-RPMax-DARKNESS-GGUF
Text Generation
•
Updated
•
169
•
1
MaziyarPanahi/patricide-12B-Unslop-Mell-v2-GGUF
Text Generation
•
Updated
•
840
•
3
mlx-community/phi-4-6bit
Text Generation
•
Updated
•
129
•
5
MaziyarPanahi/HELVETE-X-GGUF
Text Generation
•
Updated
•
79
•
1
MaziyarPanahi/Qwen2.5-7B-HomerCreative-Mix-GGUF
Text Generation
•
Updated
•
555
•
1
MaziyarPanahi/AngelSlayer-12B-Unslop-Mell-RPMax-DARKNESS-v2-GGUF
Text Generation
•
Updated
•
512
•
3
MaziyarPanahi/LongWriter-Qwen2.5-7B-Instruct-GGUF
Text Generation
•
Updated
•
494
•
1
MaziyarPanahi/WiNGPT-Babel-GGUF
Text Generation
•
Updated
•
56
•
1
MaziyarPanahi/Qwen2.5-Coder-0.5B-QwQ-draft-GGUF
Text Generation
•
Updated
•
696
•
3
MaziyarPanahi/phi-4-GGUF
Text Generation
•
Updated
•
1.34M
•
4
Jellon/Darkest-Muse-v1-exl2-6bpw-h8
nisten/deepseek-r1-qwen32b-mlx-6bit
Text Generation
•
Updated
•
68
•
14
mlx-community/DeepSeek-R1-Distill-Qwen-7B-6bit
Updated
•
414
•
2
mlx-community/DeepSeek-R1-Distill-Qwen-14B-6bit
Updated
•
372
•
6
Statuo/Deepseeker-Kunou-Qwen2.5-14b-EXL2-6bpw
Text Generation
•
Updated
•
12
•
1
MikeRoz/deepseek-ai_DeepSeek-R1-Distill-Llama-70B-6.0bpw-h6-exl2
Darkhn/L3.3-Nevoria-Exp-R1-6.0bpw-h8-exl2
Text Generation
•
Updated
•
30
•
3