Edit Models filters

Model Tree

anthracite-org/magnum-v4-12b

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

14

Full-text search

Active filters: anthracite-org/magnum-v4-12b

bartowski/magnum-v4-12b-GGUF

Text Generation • Updated Oct 20, 2024 • 5.04k • 4

mradermacher/magnum-v4-12b-GGUF

Updated Nov 26, 2024 • 14.4k • 4

mradermacher/magnum-v4-12b-i1-GGUF

Updated Nov 26, 2024 • 244 • 5

noneUsername/magnum-v4-12b-W8A8-Dynamic-Per-Token

Updated Oct 22, 2024 • 4

Triangle104/magnum-v4-12b-Q4_K_S-GGUF

Text Generation • Updated Oct 31, 2024 • 10

Triangle104/magnum-v4-12b-Q4_K_M-GGUF

Text Generation • Updated Oct 31, 2024 • 12

Triangle104/magnum-v4-12b-Q5_K_S-GGUF

Text Generation • Updated Oct 24, 2024 • 4

Triangle104/magnum-v4-12b-Q5_K_M-GGUF

Text Generation • Updated Oct 24, 2024 • 7

Triangle104/magnum-v4-12b-Q6_K-GGUF

Text Generation • Updated Oct 24, 2024 • 4

Triangle104/magnum-v4-12b-Q8_0-GGUF

Text Generation • Updated Oct 24, 2024 • 5

MaziyarPanahi/magnum-v4-12b-GGUF

Text Generation • Updated Nov 7, 2024 • 29

tensorblock/magnum-v4-12b-GGUF

Text Generation • Updated Nov 26, 2024 • 69

isv2lf/magnum-v4-12b-Q8-mlx

Text Generation • Updated 10 days ago • 7

isv2lf/magnum-v4-12b-Q6-mlx

Text Generation • Updated 10 days ago • 10