Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

Models

34,876

Full-text search

Active filters: gguf

Arc1el/Llama-3.1-Korean-8B-Instruct-MarkrAIKoCommercial-GGUF

Updated Jul 30 • 123

mradermacher/ChatWaifu_v1.1-i1-GGUF

Updated Aug 2 • 12 • 2

soma77/model10

Updated Jul 30 • 3

traviskds/llama-3-1-8b

Text Generation • Updated Jul 30 • 3

mradermacher/LeetCodeWizard_7B_V1.1-i1-GGUF

Updated Aug 2 • 34

RichardErkhov/EmbeddedLLM_-_Mistral-7B-Merge-14-v0.4-gguf

Updated Jul 30 • 1

QuantFactory/Llama-Guard-3-8B-GGUF

Text Generation • Updated Jul 30 • 101 • 1

second-state/Llama-3-Groq-70B-Tool-Use-GGUF

Text Generation • Updated Jul 31 • 178 • 1

gaianet/Llama-3-Groq-70B-Tool-Use-GGUF

Text Generation • Updated Jul 31 • 72

RichardErkhov/Edentns_-_DataVortexS-10.7B-dpo-v1.5-gguf

Updated Jul 30 • 25

Rivaidan/Nemomix-v1.0-12B-Q8_0-GGUF

Updated Jul 30 • 1

yh-0530/70bb

Updated Jul 30 • 1

RichardErkhov/ContextualAI_-_archangel_sft_pythia6-9b-gguf

Updated Jul 30 • 66

mradermacher/Llama3.1-70B-Chinese-Chat-i1-GGUF

Updated Aug 2 • 352

mradermacher/Loki-base-i1-GGUF

Updated Aug 2 • 46

mradermacher/tarnished-9b-i1-GGUF

Updated Aug 2 • 94

RichardErkhov/Edentns_-_DataVortexS-10.7B-dpo-v1.8-gguf

Updated Jul 30 • 10

RichardErkhov/Edentns_-_DataVortexS-10.7B-dpo-v1.7-gguf

Updated Jul 30 • 5

RichardErkhov/xellDart13_-_NebuIA-10.7B-DPO-v3-gguf

Updated Jul 30 • 14

RichardErkhov/macadeliccc_-_SOLAR-10.7b-Instruct-truthy-dpo-gguf

Updated Jul 30 • 22

RichardErkhov/Edentns_-_DataVortexS-10.7B-dpo-v1.4-gguf

Updated Jul 30 • 20

RichardErkhov/Edentns_-_DataVortexS-10.7B-dpo-v1.6-gguf

Updated Jul 30 • 5

RichardErkhov/ChaoticNeutrals_-_Lunar_10.7B-gguf

Updated Jul 30 • 38

RichardErkhov/FelixChao_-_WestSeverus-10.7B-gguf

Updated Jul 30 • 9

RichardErkhov/ContextualAI_-_archangel_dpo_pythia6-9b-gguf

Updated Jul 30 • 52

RichardErkhov/ContextualAI_-_archangel_sft-dpo_pythia6-9b-gguf

Updated Jul 30 • 77

SteelQuants/G2-DA-Nyxora-27b-V2-Q5_K_M-GGUF

Updated Jul 30 • 5 • 1

acen20/chartgemma_language_model_gguf

Updated Jul 30 • 9

zhanglt/model

Updated Jul 30 • 3

QuantFactory/Celeste-12B-V1.6-GGUF

Updated Jul 30 • 2.51k • 1