Edit Models filters

text-generation-inference

4-bit precision

AutoTrain Compatible

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

1,401

Full-text search

Active filters: quantized

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16 • 1.81k • 113

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14 • 29.4k • 149

legraphista/glm-4-9b-chat-GGUF

Text Generation • Updated 26 days ago • 19.4k • 11

afrideva/Llama-160M-Chat-v1-GGUF

Text Generation • Updated Dec 21, 2023 • 54 • 2

afrideva/Smol-Llama-101M-Chat-v1-GGUF

Text Generation • Updated Dec 29, 2023 • 134 • 3

afrideva/Llama-68M-Chat-v1-GGUF

Text Generation • Updated Jan 17 • 133 • 1

qualcomm/Baichuan-7B

Text Generation • Updated 12 days ago • 6

qualcomm/Llama-v2-7B-Chat

Text Generation • Updated 20 days ago • 19

argmaxinc/whisperkit-coreml

Updated 3 days ago • 2.96k • 58

MaziyarPanahi/ChatMusician-GGUF

Text Generation • Updated Mar 2 • 382 • 12

FantasiaFoundry/GGUF-Quantization-Script

Text Generation • Updated 8 days ago • 45

Lewdiculous/Model-Requests

Updated 13 days ago • 32

Lewdiculous/Nyanade_Stunna-Maid-7B-v0.2-GGUF-IQ-Imatrix

Updated May 4 • 1.78k • 39

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15 • 2.43k • 70

MaziyarPanahi/WizardLM-2-7B-AWQ

Text Generation • Updated Apr 15 • 44 • 7

MaziyarPanahi/WizardLM-2-8x22B-AWQ

Text Generation • Updated Apr 16 • 955 • 9

astronomer/Llama-3-8B-Instruct-GPTQ-8-Bit

Text Generation • Updated Apr 22 • 10.5k • 22

afrideva/Phi-3-mini-128k-instruct_function-GGUF

Text Generation • Updated May 8 • 73 • 1

afrideva/phi-3-portuguese-tom-cat-4k-instruct-GGUF

Text Generation • Updated May 18 • 91 • 1

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22 • 344k • 50

qualcomm/Riffusion

Unconditional Image Generation • Updated 12 days ago • 1

qualcomm/Stable-Diffusion-v2.1

Unconditional Image Generation • Updated 12 days ago • 4

legraphista/Higgs-Llama-3-70B-IMat-GGUF

Text Generation • Updated Jun 6 • 1.59k • 7

legraphista/glm-4-9b-chat-IMat-GGUF

Text Generation • Updated 26 days ago • 20.2k • 3

legraphista/glm-4-9b-chat-1m-GGUF

Text Generation • Updated 1 day ago • 16.9k • 15

legraphista/Gemma-2-9B-It-SPPO-Iter3-IMat-GGUF

Text Generation • Updated 11 days ago • 51.9k • 3

legraphista/codegeex4-all-9b-IMat-GGUF

Text Generation • Updated 10 days ago • 4.72k • 8

4darsh-Dev/Meta-Llama-3-8B-quantized-GPTQ

Text Generation • Updated 10 days ago • 1

ravenscroftj/CodeGen-350M-multi-ggml-quant

Text Generation • Updated Apr 24, 2023 • 2

ravenscroftj/CodeGen-2B-multi-ggml-quant

Text Generation • Updated Aug 5, 2023 • 2