Edit Models filters

text-generation-inference

4-bit precision

AutoTrain Compatible

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

1,427

Full-text search

Active filters: quantized

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated 2 days ago • 33.5k • 21

legraphista/Mistral-Large-Instruct-2407-IMat-GGUF

Text Generation • Updated 2 days ago • 2.51k • 16

MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated 5 days ago • 3.55k • 26

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated 3 days ago • 12.1k • 10

MaziyarPanahi/Mistral-Large-Instruct-2407-GGUF

Text Generation • Updated about 3 hours ago • 327 • 8

legraphista/Meta-Llama-3.1-70B-Instruct-IMat-GGUF

Text Generation • Updated 2 days ago • 3.2k • 7

MaziyarPanahi/Llama-3-Groq-70B-Tool-Use-GGUF

Text Generation • Updated 9 days ago • 302 • 5

MaziyarPanahi/SmolLM-1.7B-Instruct-GGUF

Text Generation • Updated 4 days ago • 564 • 3

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14 • 12k • 154

astronomer/Llama-3-8B-Instruct-GPTQ-8-Bit

Text Generation • Updated Apr 22 • 16.3k • 24

qualcomm/Stable-Diffusion-v2.1

Unconditional Image Generation • Updated 10 days ago • 6

MaziyarPanahi/calme-2.1-qwen2-72b-GGUF

Text Generation • Updated 6 days ago • 22.9k • 4

MaziyarPanahi/mathstral-7B-v0.1-GGUF

Text Generation • Updated 10 days ago • 92.8k • 4

qualcomm/Llama-v3-8B-Chat

Text Generation • Updated 10 days ago • 2

legraphista/Meta-Llama-3.1-8B-Instruct-IMat-GGUF

Text Generation • Updated 1 day ago • 2.23k • 2

MaziyarPanahi/gemma-2b-GGUF

Text Generation • Updated Feb 27 • 439 • 6

qualcomm/Stable-Diffusion

Unconditional Image Generation • Updated Apr 30 • 14

qualcomm/Llama-v2-7B-Chat

Text Generation • Updated 10 days ago • 21

Lewdiculous/Kunoichi-DPO-v2-7B-GGUF-Imatrix

Text Generation • Updated May 4 • 1.83k • 32

argmaxinc/whisperkit-coreml

Updated 4 days ago • 13.2k • 62

FantasiaFoundry/GGUF-Quantization-Script

Text Generation • Updated 19 days ago • 48

MaziyarPanahi/Saul-Instruct-v1-GGUF

Text Generation • Updated Mar 10 • 245 • 6

Lewdiculous/Model-Requests

Updated about 24 hours ago • 34

mistral-community/Mixtral-8x22B-v0.1-AWQ

Text Generation • Updated 22 days ago • 12.9k • 32

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15 • 2.34k • 71

qualcomm/YOLOv8-Detection-Quantized

Object Detection • Updated 10 days ago • 1

MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-AWQ

Text Generation • Updated Apr 18 • 3.28k • 10

astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit

Text Generation • Updated Apr 22 • 5.46k • 24

qualcomm/Yolo-NAS-Quantized

Object Detection • Updated 10 days ago • 1

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22 • 188k • 52