Edit Models filters

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Other with no match

Models

20,295

Full-text search

Active filters: gguf

TheBloke/Rose-20B-GGUF

Text Generation • Updated Nov 24, 2023 • 594 • 23

maddes8cht/georgesung-open_llama_7b_qlora_uncensored-gguf

Updated Nov 25, 2023 • 511 • 1

Gryphe/MergeMonster

Updated Dec 9, 2023 • 310 • 25

maddes8cht/syzymon-long_llama_3b_v1_1-gguf

Text Generation • Updated Nov 26, 2023 • 410 • 2

google/madlad400-3b-mt

Translation • Updated Nov 27, 2023 • 14.8k • 70

google/madlad400-10b-mt

Translation • Updated Apr 12 • 7.47k • 62

TheBloke/LLaMA2-13B-Psyfighter2-GGUF

Updated Nov 30, 2023 • 1.19k • 14

TheBloke/Chronomaid-Storytelling-13B-GGUF

Updated Dec 4, 2023 • 775 • 21

TheBloke/meditron-70B-GGUF

Text Generation • Updated Nov 30, 2023 • 726 • 18

Trelis/Mistral-7B-Instruct-v0.1-function-calling-v3

Text Generation • Updated Dec 7, 2023 • 8

PsiPi/liuhaotian_llava-v1.5-13b-GGUF

Image-Text-to-Text • Updated Mar 11 • 2.98k • 32

Trelis/Llama-2-7b-chat-hf-function-calling-v3

Text Generation • Updated Feb 24 • 115 • 36

Trelis/Yi-34B-200K-Llamafied-chat-SFT-function-calling-v3

Text Generation • Updated Dec 12, 2023 • 2 • 5

TheBloke/sabia-7B-GGUF

Updated Dec 5, 2023 • 230 • 4

TheBloke/Mixtral-8x7B-v0.1-GGUF

Updated Dec 14, 2023 • 10.2k • 415

TheBloke/Mixtral-8x7B-Instruct-v0.1-GGUF

Updated Dec 14, 2023 • 125k • 569

lamm-mit/BioinspiredLLM

Text Generation • Updated Mar 9 • 194 • 4

sarvamai/OpenHathi-7B-Hi-v0.1-Base

Text Generation • Updated Dec 22, 2023 • 5.11k • 93

TheBloke/meditron-7B-chat-GGUF

Updated Dec 13, 2023 • 724 • 12

Sao10K/WinterGoddess-1.4x-70B-L2-GGUF

Updated Dec 13, 2023 • 187 • 3

TheBloke/dolphin-2.5-mixtral-8x7b-GGUF

Updated Dec 14, 2023 • 5.91k • 284

TheBloke/WinterGoddess-1.4x-70B-L2-GGUF

Updated Dec 15, 2023 • 283 • 4

PowerInfer/ReluLLaMA-7B-PowerInfer-GGUF

Updated Dec 26, 2023 • 911 • 12

PowerInfer/ReluLLaMA-70B-PowerInfer-GGUF

Updated Feb 2 • 641 • 8

TheBloke/SOLAR-10.7B-Instruct-v1.0-uncensored-GGUF

Updated Dec 19, 2023 • 9.49k • 67

vilm/vinallama-2.7b-chat-GGUF

Updated Dec 20, 2023 • 74 • 4

TheBloke/DaringMaid-20B-GGUF

Text Generation • Updated Dec 20, 2023 • 897 • 15

afrideva/phi-2-uncensored-GGUF

Text Generation • Updated Dec 21, 2023 • 385 • 8

afrideva/llama2_xs_460M_uncensored-GGUF

Text Generation • Updated Dec 21, 2023 • 168 • 1

nakodanei/ShareGPT4V-13B_GGUF

Updated Dec 21, 2023 • 583 • 6