Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

Models

34,780

Full-text search

Active filters: gguf

mradermacher/Fimbulvetr-11B-v2-i1-GGUF

Updated May 6 • 1.37k • 22

llmware/bling-phi-2-gguf

Updated 17 days ago • 42 • 1

llmware/slim-xsum-tool

Updated Mar 18 • 139 • 4

LoneStriker/OpenHermes-2.5-Code-290k-13B-GGUF

Updated Mar 2 • 107 • 3

FantasiaFoundry/GGUF-Quantization-Script

Text Generation • Updated about 1 month ago • 55

bartowski/dolphin-2.8-experiment26-7b-GGUF

Text Generation • Updated Mar 4 • 4.28k • 12

akaistormherald/ToxicMist-v0.2-7B-DPO-gguf

Updated Mar 5 • 7 • 1

stabilityai/stable-code-instruct-3b

Text Generation • Updated Jul 10 • 2.14k • 166

MayensGuds/SambaLingo-Arabic-Chat-GGUF

Updated Mar 7 • 61 • 12

mradermacher/Midnight-Miqu-103B-v1.0-i1-GGUF

Updated May 10 • 192 • 2

gorilla-llm/gorilla-openfunctions-v2-gguf

Updated Apr 18 • 423 • 35

mradermacher/Susanoo-10.7B-GGUF

Updated May 6 • 69 • 1

l3utterfly/phi-2-layla-v1-chatml-gguf

Updated 19 days ago • 45.6k • 9

koboldcpp/mmproj

Updated 21 days ago • 6.33k • 47

froggeric/WestLake-10.7B-v2-GGUF

Text Generation • Updated Mar 12 • 162 • 24

l3utterfly/mistral-7b-v0.1-layla-v4-chatml-gguf

Updated 19 days ago • 16.5k • 9

second-state/All-MiniLM-L6-v2-Embedding-GGUF

Feature Extraction • Updated May 1 • 2.46k • 4

FL33TW00D-HF/whisper-tiny

Automatic Speech Recognition • Updated Jun 17 • 10.9k • 3

FL33TW00D-HF/whisper-small

Automatic Speech Recognition • Updated May 15 • 541 • 1

FL33TW00D-HF/whisper-medium

Automatic Speech Recognition • Updated Jul 2 • 8.41k • 1

mychen76/openmixtral-6x7b-v2-GGUF

Updated Mar 13 • 23 • 1

mradermacher/maid-yuzu-v8-GGUF

Updated May 6 • 160 • 2

heegyu/EEVE-Korean-Instruct-10.8B-v1.0-GGUF

Updated Mar 14 • 1.47k • 57

second-state/E5-Mistral-7B-Instruct-Embedding-GGUF

Feature Extraction • Updated Jul 1 • 5.03k • 6

andrewcanis/c4ai-command-r-v01-GGUF

Updated Mar 16 • 3.19k • 76

Lewdiculous/Infinitely-Laydiculous-9B-GGUF-IQ-Imatrix

Updated Mar 15 • 492 • 15

mradermacher/Midnight-Miqu-70B-v1.5-GGUF

Updated May 6 • 3.57k • 22

leliuga/all-MiniLM-L6-v2-GGUF

Sentence Similarity • Updated Mar 15 • 566 • 2

Lewdiculous/Model-Requests

Updated Jul 26 • 36

SakuraLLM/Sakura-14B-Qwen2beta-v0.9-GGUF

Updated Apr 11 • 504 • 7