Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

Models

39,481

Full-text search

Active filters: gguf

ZeroWw/NuminaMath-7B-TIR-GGUF

Updated Jul 12 • 30 • 2

prometheus-eval/prometheus-7b-v2.0-GGUF

Text2Text Generation • Updated Jul 12 • 15 • 2

ZeroWw/DeepSeek-V2-Lite-Chat-GGUF

Updated Jul 12 • 34

QuantFactory/Llama3-Med42-8B-GGUF

Text Generation • Updated Jul 13 • 102 • 1

martintomov/Qwen1.5-32B-Chat-Q4_K_M-GGUF

Text Generation • Updated Jul 12 • 14

vrathi101/moe-merged-llama8binstructv3-fp16_qtz-v0.gguf

Cran-May/Qwen2-7B-Instruct-Step-DPO-Q4_K_M-GGUF

Updated Jul 12 • 1

QuantFactory/SeaLLM3-7B-Chat-GGUF

Text Generation • Updated Jul 13 • 231 • 1

NLPark/P-E4

nicolassaint/model

tiesenx14/LLaMA-2-translation-mixed-ep2-30APRIL2024.gguf

mradermacher/L3-Lunaris-v1-15B-i1-GGUF

Updated Aug 2 • 277 • 1

XelotX/Qwen2-72B-Instruct-XelotX-iQuants-BF16

Text Generation • Updated Jul 12 • 79

osukhoroslov-hw/starcoder2-15b-Q5_K_M-GGUF

Text Generation • Updated Jul 12 • 2

larenspear/mamba-2.8b-hf-GGUF

Updated Jul 12 • 9

larenspear/mamba-1.4b-hf-GGUF

Updated Jul 12 • 11

larenspear/mamba-790m-hf-GGUF

Updated Jul 12 • 6

larenspear/mamba-370m-hf-GGUF

Updated Jul 12 • 4

larenspear/mamba-130m-hf-GGUF

Updated Jul 12 • 7

mradermacher/Chaifighter-Latte-14B-GGUF

Updated Jul 12 • 3

XelotX/Hermes-2-Theta-Llama-3-70B-XelotX-iQuants

Updated Jul 12 • 331

XelotX/c4ai-command-r-plus-XelotX-iQuants

Text Generation • Updated Jul 12 • 218 • 3

mradermacher/natsumura-llama3-v1.1-8b-GGUF

Updated Jul 12 • 10 • 1

XelotX/Tess-v2.5.2-Qwen2-72B-XelotX-Quants-BF16

Text Generation • Updated Jul 12 • 49

XelotX/Tess-v2.5.2-Qwen2-72B-XelotX-iQuants

Updated Jul 12 • 99

QuantFactory/Llama-3-Patronus-Lynx-8B-Instruct-GGUF

Text Generation • Updated Jul 17 • 726 • 1

mradermacher/HelpingAI-15B-GGUF

Updated Jul 12 • 101 • 1

XelotX/WizardLM-2-8x22B-XelotX-iQuants

Text Generation • Updated Jul 12 • 22

XelotX/Midnight-Miqu-70B-v1.5-XelotX-iQuants

Updated Jul 12 • 93 • 1

XelotX/Midnight-Miqu-70B-v1.5-XelotX-Quants

Updated Jul 12 • 2