Edit Models filters

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Other with no match

Models

19,179

Full-text search

Active filters: gguf

NousResearch/Hermes-2-Theta-Llama-3-8B-GGUF

Updated May 14 • 16.6k • 68

NorwAI/NorwAI-Mixtral-8x7B-instruct

Text Generation • Updated 1 day ago • 205 • 14

Undi95/Llama-3-Chatty-2x8B-GGUF

Updated 24 days ago • 818 • 7

lmstudio-community/aya-23-35B-GGUF

Text Generation • Updated 23 days ago • 40.8k • 10

failspy/Phi-3-mini-128k-instruct-abliterated-v3-GGUF

Updated 20 days ago • 2.23k • 7

failspy/Codestral-22B-v0.1-abliterated-v3-GGUF

Updated 12 days ago • 1.59k • 5

bartowski/Higgs-Llama-3-70B-GGUF

Text Generation • Updated 9 days ago • 735 • 5

MaziyarPanahi/Qwen2-7B-Instruct-GGUF

Text Generation • Updated 9 days ago • 70.5k • 6

bartowski/Qwen2-7B-Instruct-GGUF

Text Generation • Updated 9 days ago • 8.66k • 14

MaziyarPanahi/Qwen2-1.5B-Instruct-GGUF

Text Generation • Updated 9 days ago • 98.6k • 6

bartowski/Qwen2-72B-Instruct-GGUF

Text Generation • Updated 9 days ago • 6.47k • 6

secretmoon/Llama-3-8B-MLP-gguf

Text Generation • Updated 7 days ago • 65 • 3

mradermacher/Nous-Hermes-2-Mixtral-8x7B-DPO-i1-GGUF

Updated 6 days ago • 1.61k • 3

mradermacher/RP-Stew-v2.5-34B-i1-GGUF

Updated 6 days ago • 494 • 3

bartowski/Qwen2-7B-Instruct-deccp-GGUF

Text Generation • Updated 5 days ago • 9.82k • 3

bartowski/Hercules-5.0-Qwen2-1.5B-GGUF

Text Generation • Updated 3 days ago • 1.31k • 3

NikolayKozloff/Ko-Qwen2-7B-Instruct-Q8_0-GGUF

Updated 3 days ago • 31 • 3

mradermacher/L3-70B-Euryale-v2.1-i1-GGUF

Updated 1 day ago • 958 • 3

lmg-anon/vntl-llama3-8b-gguf

Updated 2 days ago • 184 • 3

bartowski/DiscoPOP-zephyr-7b-gemma-GGUF

Text Generation • Updated 2 days ago • 3.2k • 3

TheBloke/WizardCoder-Python-34B-V1.0-GGUF

Updated Sep 27, 2023 • 2.72k • 80

TheBloke/Phind-CodeLlama-34B-v2-GGUF

Updated Sep 27, 2023 • 10.8k • 159

TheBloke/Llama-2-7B-Chat-GGUF

Text Generation • Updated Oct 14, 2023 • 162k • 384

TheBloke/MythoMax-L2-13B-GGUF

Updated Sep 27, 2023 • 19.4k • 63

TheBloke/Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Dec 9, 2023 • 90.1k • 494

IlyaGusev/saiga_mistral_7b_gguf

Text Generation • Updated Apr 4 • 24.8k • 74

TheBloke/dolphin-2.1-mistral-7B-GGUF

Updated Oct 22, 2023 • 3.96k • 101

KoboldAI/LLaMA2-13B-Tiefighter-GGUF

Updated Oct 19, 2023 • 57.9k • 66

TheBloke/goliath-120b-GGUF

Text Generation • Updated Nov 9, 2023 • 276 • 125

TinyLlama/TinyLlama-1.1B-Chat-v0.6

Text Generation • Updated Nov 20, 2023 • 41k • 76