Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,534

Full-text search

Active filters: instruct

ZeroXClem/Qwen2.5-7B-HomerAnvita-NerdMix-Q4_K_M-GGUF

Text Generation • Updated 26 days ago • 27

ZeroXClem/Qwen2.5-7B-HomerAnvita-NerdMix-Q4_0-GGUF

Text Generation • Updated 26 days ago • 62

mradermacher/Hermes-2-Pro-Mixtral-4x7B-GGUF

Updated 23 days ago • 210

tensorblock/Nous-Hermes-2-Yi-34B-GGUF

Updated 23 days ago • 346

Triangle104/Mistral-Small-Instruct-2409-abliterated-Q4_K_S-GGUF

Text Generation • Updated 23 days ago • 24

Triangle104/Mistral-Small-Instruct-2409-abliterated-Q4_K_M-GGUF

Text Generation • Updated 23 days ago • 18

Triangle104/Mistral-Small-Instruct-2409-abliterated-Q5_K_S-GGUF

Text Generation • Updated 23 days ago • 18

Triangle104/Mistral-Small-Instruct-2409-abliterated-Q5_K_M-GGUF

Text Generation • Updated 23 days ago • 27

Triangle104/Mistral-Small-Instruct-2409-abliterated-Q6_K-GGUF

Text Generation • Updated 23 days ago • 27

Triangle104/Mistral-Small-Instruct-2409-abliterated-Q8_0-GGUF

Text Generation • Updated 23 days ago • 21

mradermacher/Hermes-2-Pro-Mixtral-4x7B-i1-GGUF

Updated 23 days ago • 499

mradermacher/OpenHermes-Mixtral-8x7B-GGUF

Updated 22 days ago • 430

bartowski/Open-Insurance-LLM-Llama3-8B-GGUF

Text Generation • Updated 21 days ago • 791

tensorblock/Meta-Llama-3.1-8B-openhermes-2.5-GGUF

Updated 19 days ago • 348

tensorblock/Llama3-OpenBioLLM-8B-GGUF

Updated 19 days ago • 318

tensorblock/BgGPT-Gemma-2-2.6B-IT-v1.0-GGUF

Text Generation • Updated 15 days ago • 240

mav23/Hermes-Trismegistus-Mistral-7B-GGUF

Updated 14 days ago • 299

tensorblock/Hermes-3-Llama-3.1-70B-GGUF

Updated 14 days ago • 314

mradermacher/SmolLM2-Math-IIO-1.7B-Instruct-GGUF

Updated 14 days ago • 526

tensorblock/Llama3-70B-ShiningValiant2-GGUF

Text Generation • Updated 11 days ago • 290

zheyushen/Llama-3_1-8B-Instruct-orca-ORPO-F32-GGUF

Updated 11 days ago • 44

tensorblock/Llama3-70B-Fireplace-GGUF

Text Generation • Updated 11 days ago • 335

zheyushen/Llama-3_1-8B-Instruct-orca-ORPO-Q8_0-GGUF

Updated 11 days ago • 3

mradermacher/Genstruct-10.7B-GGUF

Updated 10 days ago • 189

Lucy-in-the-Sky/pygmalion-2-13b-Q2_K-GGUF

Text Generation • Updated 10 days ago • 19

Lucy-in-the-Sky/pygmalion-2-13b-Q8_0-GGUF

Text Generation • Updated 10 days ago • 39

mradermacher/Genstruct-10.7B-i1-GGUF

Updated 10 days ago • 375

SYNERDATA/Hermes-3-Llama-3.1-8B-Q8_0-GGUF

Updated 9 days ago • 7

mradermacher/Llama3-OpenBioLLM-70B-i1-GGUF

Updated 6 days ago • 567

mlx-community/Hermes-3-Llama-3.2-3B-4bit

Text Generation • Updated 6 days ago • 215