-
-
-
-
-
-
Inference Providers
Active filters:
6-bit
MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF
Text Generation
•
8B
•
Updated
•
201k
•
93
MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF
Text Generation
•
1B
•
Updated
•
187k
•
13
MikeRoz/ArliAI_Mistral-Small-22B-ArliAI-RPMax-v1.1-6.0bpw-h6-exl2
Updated
•
83
•
29
MaziyarPanahi/ChatMusician-GGUF
Text Generation
•
7B
•
Updated
•
301
•
14
MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF
Text Generation
•
141B
•
Updated
•
187k
•
75
MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF
Text Generation
•
7B
•
Updated
•
219k
•
106
MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF
Text Generation
•
71B
•
Updated
•
182k
•
40
MaziyarPanahi/MistralNemoTiny-GGUF
Text Generation
•
5B
•
Updated
•
50
•
1
MaziyarPanahi/Llama-3.3-70B-Instruct-GGUF
Text Generation
•
71B
•
Updated
•
203k
•
14
mlx-community/Llama-4-Maverick-17B-16E-Instruct-6bit
Text Generation
•
88B
•
Updated
•
1.37k
•
2
mlx-community/Llama-3.2-3B-Instruct-uncensored-6bit
Text Generation
•
0.7B
•
Updated
•
2.08k
•
3
dphn/Dolphin-Llama3-8B-Instruct-exl2-6bpw
Updated
•
1.36k
•
4
MaziyarPanahi/Qwen3-4B-GGUF
Text Generation
•
4B
•
Updated
•
185k
•
3
zerofata/MS3.2-PaintedFantasy-Visage-33B_exl3_6bpw
Text Generation
•
13B
•
Updated
•
15
•
1
nightmedia/Qwen3-53B-A3B-TOTAL-RECALL-MASTER-CODER-v1.4-q6-mlx
Text Generation
•
53B
•
Updated
•
142
•
1
nightmedia/Spiral-Qwen3-4B-dq68-mlx
Text Generation
•
0.9B
•
Updated
•
15
•
1
nightmedia/Spiral-Qwen3-4B-dwq6-mlx
Text Generation
•
1B
•
Updated
•
60
•
1
lmstudio-community/SmolLM3-3B-MLX-6bit
Text Generation
•
0.7B
•
Updated
•
768
•
1
lmstudio-community/Devstral-Small-2507-MLX-6bit
Text Generation
•
24B
•
Updated
•
118k
•
1
mlx-community/Devstral-Small-2507-8bit
Text Generation
•
24B
•
Updated
•
56
•
1
mlx-community/LFM2-350M-6bit
Text Generation
•
0.1B
•
Updated
•
4
•
1
mlx-community/LFM2-700M-6bit
Text Generation
•
0.2B
•
Updated
•
5
•
1
mlx-community/LFM2-1.2B-6bit
Text Generation
•
0.3B
•
Updated
•
5
•
1
LoneStriker/Yi-6B-200K-6.0bpw-h6-exl2
Text Generation
•
Updated
•
6
•
1
MaziyarPanahi/phi-2-GGUF
Text Generation
•
3B
•
Updated
•
209
•
6
MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
•
7B
•
Updated
•
67
•
6
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
•
7B
•
Updated
•
100
•
4
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF
Text Generation
•
7B
•
Updated
•
168
•
5
MaziyarPanahi/NeuralPipe-7B-slerp-GGUF
Text Generation
•
7B
•
Updated
•
74
•
3
MaziyarPanahi/NeuralPipe-7B-slerp-v0.2-GGUF
Text Generation
•
7B
•
Updated
•
83
•
2