Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

Models

54,206

Full-text search

Active filters: gguf

mradermacher/Bagel-Hermes-2x34B-i1-GGUF

Updated Jun 29 • 544 • 1

QuantFactory/dolphin-2.9-llama3-8b-GGUF

Text Generation • Updated Jun 8 • 2.82k • 52

cognitivecomputations/dolphin-2.9-llama3-8b-gguf

Updated May 20 • 1.22k • 84

impactframes/llama3_if_ai_sdpromptmkr_q4km

Updated Apr 22 • 92 • 11

nitsuai/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated Apr 22 • 245 • 2

hfl/llama-3-chinese-8b-instruct-gguf

Updated Apr 30 • 1.1k • 24

victunes/TherapyLlama-8B-v1-GGUF

Updated Apr 29 • 1.28k • 12

mmnga/c4ai-command-r-plus-gguf

Updated Apr 23 • 1.26k • 4

microsoft/Phi-3-mini-4k-instruct-gguf

Text Generation • Updated Jul 2 • 26.9k • 464

Lewdiculous/Chaos_RP_l3_8B-GGUF-IQ-Imatrix

Updated May 4 • 359 • 19

hus960/Llama-3-8b.UNLEASHED-Q4_K_M-GGUF

Text Generation • Updated Apr 23 • 13 • 2

SanctumAI/Phi-3-mini-4k-instruct-GGUF

Text Generation • Updated Aug 6 • 1.62k • 16

QuantFactory/Phi-3-mini-128k-instruct-GGUF

Text Generation • Updated May 24 • 2.3k • 35

PrunaAI/Phi-3-mini-128k-instruct-GGUF-Imatrix-smashed

Updated Aug 2 • 3.03k • 67

QuantFactory/Llama3-8B-Chinese-Chat-GGUF

Text Generation • Updated Apr 24 • 1.26k • 11

bartowski/Lexi-Llama-3-8B-Uncensored-GGUF

Text Generation • Updated Apr 24 • 1.93k • 25

ChaoticNeutrals/LLaVA-Llama-3-8B-mmproj-Updated

Updated May 4 • 557 • 18

winninghealth/WiNGPT2-Llama-3-8B-Chat-GGUF

Updated Apr 25 • 664 • 5

art-from-the-machine/Mantella-Skyrim-Llama-3-8B

Text Generation • Updated Apr 24 • 45 • 2

art-from-the-machine/Mantella-Skyrim-Llama-3-8B-GGUF

Updated Apr 24 • 519 • 1

Undi95/Llama-3-LewdPlay-8B-evo-GGUF

Updated May 1 • 356 • 26

QuantFactory/saiga_llama3_8b-GGUF

Text Generation • Updated Apr 25 • 1.26k • 6

jpacifico/French-Alpaca-Phi-3-beta-GGUF

Updated Apr 24 • 9 • 3

teddylee777/Llama-3-Open-Ko-8B-gguf

Text Generation • Updated May 20 • 4.01k • 38

QuantFactory/Llama-3-Smaug-8B-GGUF

Updated 30 days ago • 798 • 2

Lewdiculous/SOVL_Llama3_8B-GGUF-IQ-Imatrix

Updated May 4 • 729 • 28

ariel-ml/SambaLingo-Hungarian-Chat-GGUF

Text Generation • Updated May 1 • 52 • 2

xtuner/llava-phi-3-mini-gguf

Image-to-Text • Updated Apr 29 • 4.09k • 125

mradermacher/Mistral_7B_CrewAI-GGUF

Updated May 5 • 161 • 1

teddylee777/EEVE-Korean-Instruct-10.8B-v1.0-gguf

Text Generation • Updated Apr 25 • 3.1k • 19