Edit Models filters

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Other with no match

Models

15,208

Full-text search

Active filters: gguf

ddh0/Meta-Llama-3-8B-Instruct-bf16-GGUF

Text Generation • Updated 12 days ago • 1.9k • 42

bartowski/llama-3-70B-Instruct-abliterated-GGUF

Text Generation • Updated 7 days ago • 734 • 4

mmnga/stockmark-100b-gguf

Updated 4 days ago • 400 • 4

mradermacher/Dusk-Miqu-70B-GGUF

Updated 4 days ago • 279 • 4

mradermacher/L3_SnowStorm_4x8B-GGUF

Updated 2 days ago • 406 • 4

TheBloke/Llama-2-7B-GGUF

Text Generation • Updated Oct 24, 2023 • 61.4k • 161

TheBloke/Mistral-7B-Instruct-v0.2-GGUF

Text Generation • Updated Dec 11, 2023 • 186k • 344

sarvamai/OpenHathi-7B-Hi-v0.1-Base

Text Generation • Updated Dec 22, 2023 • 10.3k • 89

TheBloke/MixtralOrochi8x7B-GGUF

Updated Dec 26, 2023 • 253 • 14

Ttimofeyka/MistralRP-Noromaid-NSFW-Mistral-7B-GGUF

Text Generation • Updated Feb 10 • 7.87k • 17

mradermacher/Fimbulvetr-11B-v2-i1-GGUF

Updated 17 days ago • 2.74k • 19

gorilla-llm/gorilla-openfunctions-v2-gguf

Updated Apr 18 • 1.02k • 19

froggeric/WestLake-10.7B-v2-GGUF

Text Generation • Updated Mar 12 • 728 • 18

Qwen/Qwen1.5-32B-Chat-GGUF

Text Generation • Updated Apr 9 • 27.2k • 48

taide/TAIDE-LX-7B-Chat-4bit

Updated about 21 hours ago • 555 • 45

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16 • 20.8k • 103

bartowski/CodeQwen1.5-7B-Chat-GGUF

Text Generation • Updated Apr 17 • 685 • 7

QuantFactory/Meta-Llama-3-8B-GGUF

Text Generation • Updated Apr 20 • 49.7k • 85

instructlab/granite-7b-lab-GGUF

Updated 28 days ago • 3.74k • 13

PrunaAI/Phi-3-mini-128k-instruct-GGUF-Imatrix-smashed

Updated 22 days ago • 72.9k • 56

cjpais/moondream2-llamafile

Image-Text-to-Text • Updated 13 days ago • 745 • 22

google/codegemma-1.1-7b-it-GGUF

Text Generation • Updated 20 days ago • 100 • 7

Lewdiculous/Poppy_Porpoise-0.72-L3-8B-GGUF-IQ-Imatrix

Updated 3 days ago • 5.13k • 19

crusoeai/Llama-3-70B-Instruct-Gradient-1048k-GGUF

Updated 18 days ago • 2.07k • 11

failspy/Llama-3-8B-Instruct-abliterated-GGUF

Updated 15 days ago • 2.35k • 26

bartowski/Llama-3-11.5B-Instruct-Coder-v2-GGUF

Text Generation • Updated 14 days ago • 5.39k • 5

lmstudio-community/Meta-Llama-3-120B-Instruct-GGUF

Text Generation • Updated 13 days ago • 4.24k • 40

Monor/Nxcode-CQ-7B-orpo-gguf

Updated 7 days ago • 5.71k • 6

NikolayKozloff/pip-code-bandit-Q8_0-GGUF

Text Generation • Updated 9 days ago • 174 • 4

NikolayKozloff/llama3_8b_chat_brainstorm-Q6_K-GGUF

Text Generation • Updated 9 days ago • 50 • 3