Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

27,377

Full-text search

Active filters: gguf

ChaoticNeutrals/LLaVA-Llama-3-8B-mmproj-Updated

Updated May 4 • 830 • 14

duyntnet/stablelm-zephyr-3b-imatrix-GGUF

Text Generation • Updated Apr 26 • 393 • 1

MoMonir/Phi-3-mini-128k-instruct-GGUF

Text Generation • Updated Apr 30 • 178 • 3

professorf/phi-3-mini-128k-f16-gguf

Text Generation • Updated May 8 • 717 • 4

sccastillo/llama3_router

Updated Apr 24 • 13 • 1

mmnga/Phi-3-mini-128k-instruct-gguf

Updated Apr 24 • 2.51k • 8

QuantFactory/saiga_llama3_8b-GGUF

Text Generation • Updated Apr 25 • 494 • 3

llmware/bling-phi-3-gguf

Updated May 2 • 488 • 13

teddylee777/Llama-3-Open-Ko-8B-gguf

Text Generation • Updated May 20 • 3.47k • 29

acon96/Home-1B-v3-GGUF

Text Generation • Updated Apr 25 • 250 • 2

QuantFactory/internistai-base-7b-v0.2-GGUF

Text Generation • Updated 20 days ago • 290 • 2

xtuner/llava-phi-3-mini-gguf

Image-to-Text • Updated Apr 29 • 7.02k • 102

hus960/Raiden-16x3.43B-Q4_K_M-GGUF

Updated Apr 25 • 15 • 1

teddylee777/EEVE-Korean-Instruct-10.8B-v1.0-gguf

Text Generation • Updated Apr 25 • 1.17k • 9

aaditya/OpenBioLLM-Llama3-8B-GGUF

Text Generation • Updated May 4 • 3.63k • 35

Orenguteng/Llama-3-8B-LexiFun-Uncensored-V1-GGUF

Updated Apr 28 • 7.51k • 40

lightblue/suzume-llama-3-8B-multilingual-orpo-borda-half-gguf

Updated May 30 • 106 • 7

mradermacher/Noromaid-13B-0.4-DPO-i1-GGUF

Updated May 5 • 276 • 4

mradermacher/OpenBioLLM-Llama3-8B-GGUF

Updated May 10 • 392 • 1

cjpais/moondream2-llamafile

Image-Text-to-Text • Updated May 9 • 517 • 24

mradermacher/Llama3-Aloe-8B-Alpha-GGUF

Updated May 14 • 1.41k • 2

mradermacher/OpenBioLLM-Llama3-70B-GGUF

Updated May 10 • 292 • 3

MoMonir/Llama-3-8B-Web-GGUF

Updated Apr 27 • 73 • 3

Qwen/Qwen1.5-110B-Chat-GGUF

Text Generation • Updated Apr 30 • 44 • 13

taide/Llama3-TAIDE-LX-8B-Chat-Alpha1-4bit

Updated Apr 29 • 314 • 40

molbal/drama-mistral

Text Generation • Updated Apr 28 • 87 • 3

QuantFactory/Llama-3-8B-Lexi-Uncensored-GGUF

Text Generation • Updated May 5 • 3.13k • 7

LiteLLMs/Llama3-OpenBioLLM-70B-GGUF

Updated May 28 • 666 • 3

crusoeai/Llama-3-8B-Instruct-Gradient-1048k-GGUF

Updated May 5 • 6.5k • 71

nitky/Megac4ai-command-r-plus-gguf

Text Generation • Updated Apr 30 • 1.62k • 2