Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

35

Full-text search

Active filters: exllamav2

matlok/lok-instruct-8b-llm3-exl2-8.0bpw

Text Generation • Updated Apr 20

Vikhrmodels/it-5.3-fp16-32k-EXL2

Updated Jun 13 • 1

backyardai/Yi-34B-200K-RPMerge-GGUF

Updated Jul 18 • 543 • 2

WaveCut/WoonaV1.2-9b-EXL2

Text Generation • Updated Sep 1 • 2

Anthonyg5005/Llama-Guard-3-1B-exl2

Text Generation • Updated 10 days ago • 2