Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

77

Full-text search

Active filters: exllamav2

Vikhrmodels/it-5.3-fp16-32k-EXL2

Updated Jun 13, 2024 • 1

backyardai/Yi-34B-200K-RPMerge-GGUF

Updated Jul 18, 2024 • 468 • 2

WaveCut/WoonaV1.2-9b-EXL2

Text Generation • Updated Sep 1, 2024 • 2

Anthonyg5005/Llama-Guard-3-1B-exl2

Text Generation • Updated about 24 hours ago • 14

llmixer/ExllamaV2-Control-Vectors

Updated Oct 31, 2024 • 4

mradermacher/Yi-34B-200K-RPMerge-GGUF

Updated Nov 12, 2024 • 144

mradermacher/Yi-34B-200K-RPMerge-i1-GGUF

Updated Nov 12, 2024 • 506

TheMelonGod/Llama-3.1-8B-ArliAI-RPMax-v1.3-exl2

Text Generation • Updated Dec 28, 2024 • 20

TheMelonGod/dolphin-2.9.4-llama3.1-8b-exl2

Text Generation • Updated Dec 28, 2024 • 86

TheMelonGod/Llama-3.1-SuperNova-8B-Lite_TIES_with_Base-exl2

Text Generation • Updated Nov 23, 2024 • 18

TheMelonGod/NaturalLM-exl2

Text Generation • Updated Nov 24, 2024 • 19

TheMelonGod/dolphin-2.9.3-mistral-7B-32k-exl2

Text Generation • Updated Dec 17, 2024 • 73

TheMelonGod/MN-12B-Lyra-v4-exl2

Text Generation • Updated Dec 5, 2024 • 75

TheMelonGod/dolphin-2.9.4-gemma2-2b-exl2

Text Generation • Updated Dec 13, 2024 • 51

TheMelonGod/GRMR-2B-Instruct-exl2

Text Generation • Updated Dec 17, 2024 • 29

TheMelonGod/14B-Qwen2.5-Kunou-v1-exl2

Text Generation • Updated Dec 28, 2024 • 11

TheMelonGod/moxin-chat-7b-exl2

Text Generation • Updated Dec 31, 2024 • 54

TheMelonGod/moxin-llm-7b-exl2

Text Generation • Updated Dec 28, 2024 • 19

TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2

Text Generation • Updated Dec 31, 2024 • 92

gghfez/jukofyork_creative-writer-32b-preview-exl2-4.5bpw

Text Generation • Updated Dec 29, 2024 • 11

TheMelonGod/Falcon3-7B-Instruct-exl2

Text Generation • Updated Jan 4 • 56

TheMelonGod/Falcon3-1B-Base-exl2

Text Generation • Updated Jan 5 • 120

TheMelonGod/Dolphin3.0-Llama3.1-8B-exl2

Text Generation • Updated Jan 7 • 38

TheMelonGod/Dolphin3.0-Qwen2.5-0.5B-exl2

Text Generation • Updated Jan 8 • 66

TheMelonGod/Dolphin3.0-Qwen2.5-1.5B-exl2

Text Generation • Updated Jan 9 • 57

TheMelonGod/Dolphin3.0-Qwen2.5-3b-exl2

Text Generation • Updated Jan 10 • 245

TheMelonGod/Falcon3-1B-Instruct-exl2

Text Generation • Updated Jan 14 • 196

TheMelonGod/phi-4-exl2

Text Generation • Updated Jan 23 • 154

TheMelonGod/granite-3.1-8b-base-exl2

Text Generation • Updated Jan 29 • 132

altomek/RE-70B-AS3D-3.5bpw-EXL2

Updated Jan 29 • 19