Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

mixed-quantization

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

10

Base only

Active filters: mixed-quantization

Asystemoffields/IBM-granite-4.1-8b-heretic-PMRA-GGUF

Text Generation • 8B • Updated 3 days ago • 658 • 1

shieldstackllc/Step-3.5-Flash-REAP-128B-A11B-mlx-mixed-4-6

Text Generation • 121B • Updated Feb 16 • 143

GOBA-AI-Labs/PrunedHub-Qwen3-30B-A3B-EN-80pct-MxMoE

Text Generation • 25B • Updated Feb 23 • 18

GOBA-AI-Labs/PrunedHub-Qwen3-30B-A3B-JP-80pct-MxMoE

Text Generation • 25B • Updated Feb 23 • 20

Phipper/qwen3.5-27b-opus-distilled-proposal-c

Text Generation • 27B • Updated Apr 2 • 32

Asystemoffields/Qwen3-1.7B-PMRA-IQ3XS-budget-GGUF

Text Generation • 2B • Updated 3 days ago • 606

Asystemoffields/gemma-4-E2B-it-PMRA-GGUF

Text Generation • 5B • Updated 3 days ago • 2.24k

andrzejmontano/Qwen3-VL-Embedding-8B-mlx-8bit

Sentence Similarity • 3B • Updated 23 days ago • 1.63k

Asystemoffields/Huihui-Qwen3.5-4B-Abliterated-PMRA-GGUF

Text Generation • 4B • Updated 3 days ago • 1.35k

Asystemoffields/Ministral-3-8B-Instruct-PMRA-GGUF

Text Generation • 8B • Updated 3 days ago • 1.39k