Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

Models

34,506

Full-text search

Active filters: gguf

mradermacher/Meta-Llama-3.1-8B-i1-GGUF

Updated Aug 2 • 261

saberbx/x0

Updated Jul 29 • 4

MarsupialAI/Gemmasutra-Pro-27B-v1_iMatrix_GGUF

Updated Jul 29 • 472 • 6

MrRobotoAI/llama3-8B-Special-Dark-RP1-Q4_K_M-GGUF

Updated Jul 28 • 4

tklohj/WindyLLM_kor_3.1-Q8_0-GGUF

Updated Jul 28 • 1

RichardErkhov/JY623_-_KoSOLAR-10.7B-merge-v3.2-gguf

Updated Jul 29 • 17

Felladrin/gguf-Lite-Oute-1-300M-Instruct

Updated Jul 28 • 4

mradermacher/Sekhmet_Bet-L3.1-8B-v0.2-i1-GGUF

Updated Aug 2 • 25

mradermacher/openbuddy-llama3.1-8b-v22.2-131k-i1-GGUF

Updated Aug 2 • 315 • 1

RichardErkhov/JY623_-_KoSOLAR-10.7B-merge-v3.4-gguf

Updated Jul 29 • 17

tklohj/WindyLLM_kor_jpn_eng-Q8_0-GGUF

Updated Jul 28 • 2

mradermacher/Lyraea-large-llama-3.1-i1-GGUF

Updated Aug 2 • 255

RichardErkhov/ihopper_-_I-SOLAR-10.7B-dpo-sft-v1.0-gguf

Updated Jul 29 • 1

mradermacher/AnchorCoder_v3-GGUF

Updated Jul 28 • 7

aaronday3/Celeste-12B-V1.6-Q4_K_M-GGUF

Updated Jul 28 • 2

aaronday3/Celeste-12B-V1.6-Q6_K-GGUF

Updated Jul 28 • 37

ambrosfitz/tiny_summarizer_v1

Updated Jul 28 • 18

mradermacher/BabyHercules-4x150M-GGUF

Updated Aug 2 • 20 • 1

MarsupialAI/Celeste-12B-V1.6_iMatrix_GGUF

Updated Jul 29 • 823 • 1

mradermacher/openbuddy-llama3.1-8b-v22.1-131k-i1-GGUF

Updated Aug 2 • 114

mradermacher/Lite-Oute-1-65M-GGUF

Updated Aug 2 • 13

Fischerboot/2b-gguf-tiny-llama

Updated Jul 28 • 6

mradermacher/Lite-Oute-1-65M-Instruct-GGUF

Updated Aug 2 • 16

mradermacher/magnum-32b-v1-GGUF

Updated Jul 29 • 28 • 1

mradermacher/BabyHercules-8x150M-GGUF

Updated Aug 2 • 2

mradermacher/BabyHercules-150M-GGUF

Updated Jul 28 • 7

LuisangelParra/Meta-Llama-3.1-8B-bnb-4bit-Uninorte-Admin

Text Generation • Updated Jul 29 • 1

mradermacher/Lite-Oute-1-300M-GGUF

Updated Aug 2 • 32

mradermacher/Lite-Oute-1-300M-Instruct-GGUF

Updated Aug 2 • 33

RichardErkhov/NotAiLOL_-_Boundary-Solar-Chat-2x10.7B-MoE-gguf

Updated Jul 29 • 10