Edit Models filters

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Other with no match

Models

17,152

Full-text search

Active filters: gguf

crusoeai/dolphin-2.9.2-mixtral-8x22b-GGUF

Updated 6 days ago • 269 • 3

bartowski/Meta-Llama-3-8B-Instruct-abliterated-v3-GGUF

Text Generation • Updated 6 days ago • 3.12k • 3

h2oai/h2o-danube2-1.8b-chat-GGUF

Text Generation • Updated 5 days ago • 1.85k • 3

legraphista/Yuan2-M32-hf-IMat-GGUF

Text Generation • Updated 4 days ago • 399 • 3

failspy/Llama-3-8B-Instruct-MopeyMule-GGUF

Text Generation • Updated 4 days ago • 759 • 3

DavidAU/Fimbulvetr-11B-Ultra-Quality-plus-imatrix-GGUF

Updated 3 days ago • 451 • 3

mradermacher/dolphin-2.9.2-mixtral-8x22b-i1-GGUF

Updated 2 days ago • 186 • 3

mradermacher/L3-daybreak-TheSpice-8b-v0.1.3-i1-GGUF

Updated 2 days ago • 3.83k • 3

TheBloke/CodeLlama-7B-GGUF

Text Generation • Updated Sep 27, 2023 • 5.25k • 101

TheBloke/deepsex-34b-GGUF

Text Generation • Updated Dec 7, 2023 • 4.21k • 38

TheBloke/phi-2-GGUF

Text Generation • Updated Dec 18, 2023 • 32.1k • 184

TheBloke/Nous-Hermes-2-SOLAR-10.7B-GGUF

Updated Jan 2 • 3.59k • 106

rombodawg/Open_Gpt4_8x7B_v0.2_q8_0_gguf

Updated Jan 23 • 147 • 4

brittlewis12/Kunoichi-DPO-v2-7B-GGUF

Text Generation • Updated May 2 • 7.11k • 37

llmware/slim-sql-tool

Updated 7 days ago • 214 • 10

Qwen/Qwen1.5-72B-Chat-GGUF

Text Generation • Updated Apr 9 • 3.66k • 62

TeeZee/DarkForest-20B-v2.0-GGUF

Updated Feb 18 • 1.26k • 12

mzwing/NSFW_13B_sft-GGUF

Text Generation • Updated Feb 24 • 6.91k • 14

google/gemma-7b-it-GGUF

Updated Apr 10 • 3.62k • 34

gorilla-llm/gorilla-openfunctions-v2-gguf

Updated Apr 18 • 1.08k • 22

Lewdiculous/BuRP_7B-GGUF-IQ-Imatrix

Updated about 1 month ago • 1.06k • 17

koboldcpp/mmproj

Updated Apr 22 • 7.21k • 30

llmware/slim-extract-tool

Updated 8 days ago • 288 • 7

NeverSleep/NoromaidxOpenGPT4-2-GGUF-iMatrix

Updated Mar 26 • 3.31k • 16

botbot-ai/Cabra-72b

Text Generation • Updated 13 days ago • 26 • 3

mradermacher/IceLemonTeaRP-32k-7b-GGUF

Updated 29 days ago • 1.1k • 8

pmysl/c4ai-command-r-plus-GGUF

Text Generation • Updated Apr 19 • 6.86k • 31

mradermacher/Merged-RP-Stew-V2-34B-i1-GGUF

Updated 7 days ago • 2.11k • 15

openthaigpt/openthaigpt-1.0.0-70b-chat

Text Generation • Updated Apr 17 • 2.73k • 8

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

Text Generation • Updated Apr 15 • 11.7k • 73