Edit Models filters

Inference status

Misc

Inference Endpoints

4-bit precision

8-bit precision

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

846

Full-text search

Active filters: imatrix

legraphista/Mistral-Small-Instruct-2409-IMat-GGUF

Text Generation • Updated Sep 18 • 377

legraphista/Qwen2.5-0.5B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19 • 153

legraphista/Qwen2.5-1.5B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19 • 861

legraphista/Qwen2.5-3B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19 • 307

legraphista/Qwen2.5-7B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19 • 198

legraphista/Qwen2.5-14B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19 • 425

duyntnet/Mistral-Small-Instruct-2409-imatrix-GGUF

Text Generation • Updated Sep 19 • 47

legraphista/Qwen2.5-32B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19 • 471

legraphista/Qwen2.5-Coder-1.5B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19 • 1.16k

legraphista/Qwen2.5-Math-1.5B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19 • 662

legraphista/Qwen2.5-Coder-7B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19 • 353

legraphista/Qwen2.5-Math-7B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19 • 696

legraphista/Qwen2.5-72B-Instruct-IMat-GGUF

Text Generation • Updated Sep 20 • 319

duyntnet/Qwen2.5-3B-Instruct-imatrix-GGUF

Text Generation • Updated Sep 20 • 87

duyntnet/Qwen2.5-7B-Instruct-imatrix-GGUF

Text Generation • Updated Sep 21 • 132

duyntnet/Qwen2.5-14B-Instruct-imatrix-GGUF

Text Generation • Updated Sep 23 • 232 • 1

duyntnet/Qwen2.5-32B-Instruct-imatrix-GGUF

Text Generation • Updated Sep 24 • 87

duyntnet/Llama-3.2-3B-Instruct-imatrix-GGUF

Text Generation • Updated Sep 25 • 104

duyntnet/Llama-3.2-1B-Instruct-imatrix-GGUF

Text Generation • Updated Sep 25 • 101

legraphista/Llama-3.2-1B-Instruct-IMat-GGUF

Text Generation • Updated Sep 25 • 1.04k

legraphista/Llama-3.2-3B-Instruct-IMat-GGUF

Text Generation • Updated Sep 25 • 814 • 1

legraphista/Llama-Guard-3-1B-IMat-GGUF

Text Generation • Updated Sep 25 • 499

v000000/Typhon-Mixtral-v1-imatrix-v2.Q6_K-GGUF

Updated Sep 26 • 10 • 1

bartowski/Mistral-Small-22B-ArliAI-RPMax-v1.1-GGUF

Text Generation • Updated Sep 26 • 5.58k • 9

LPN64/LongCite-llama3.1-8b-GGUF

Text Generation • Updated Oct 1 • 327 • 5

duyntnet/Qwen2.5-Coder-7B-Instruct-imatrix-GGUF

Text Generation • Updated Sep 27 • 178

duyntnet/Llama-3.2-1B-imatrix-GGUF

Text Generation • Updated Sep 29 • 449

duyntnet/Llama-3.2-3B-imatrix-GGUF

Text Generation • Updated Sep 29 • 447

duyntnet/DeepSeek-V2-Lite-Chat-imatrix-GGUF

Text Generation • Updated Oct 1 • 421

duyntnet/Qwen2.5-1.5B-Instruct-imatrix-GGUF

Text Generation • Updated Oct 1 • 115