Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

8-bit precision

Mixture of Experts

Models

175

Full-text search

Active filters: llama-3.1

Triangle104/Llama3.1-8B-ShiningValiant2-Q5_K_M-GGUF

Text Generation • Updated Nov 24, 2024 • 3 • 1

Triangle104/Llama3.1-8B-ShiningValiant2-Q6_K-GGUF

Text Generation • Updated Nov 24, 2024 • 3 • 1

Triangle104/Llama3.1-8B-ShiningValiant2-Q8_0-GGUF

Text Generation • Updated Nov 24, 2024 • 2 • 1

NeuML/Llama-3.1_OpenScholar-8B-AWQ

Text Generation • Updated Nov 27, 2024 • 1.54k • 3

mradermacher/Llama-3.1-8B-Instruct-Zeus-GGUF

Updated Dec 1, 2024 • 137 • 1

mradermacher/Llama-3.1-8B-Instruct-Zeus-i1-GGUF

Updated Dec 1, 2024 • 215 • 1

T145/ZEUS-8B-V2

Text Generation • Updated 24 days ago • 325 • 2

mradermacher/ZEUS-8B-V2-GGUF

Updated about 1 month ago • 219 • 2

mradermacher/ZEUS-8B-V2-i1-GGUF

Updated about 1 month ago • 375 • 2

mradermacher/ZEUS-8B-V2L2-GGUF

Updated 30 days ago • 401 • 1

mradermacher/ZEUS-8B-V2L1-GGUF

Updated about 1 month ago • 342 • 1

mradermacher/ZEUS-8B-V2L2-i1-GGUF

Updated 30 days ago • 617 • 1

T145/KRONOS-8B-V1-P1

Text Generation • Updated 28 days ago • 53 • 1

mradermacher/KRONOS-8B-V1-P1-GGUF

Updated 28 days ago • 279 • 1

T145/KRONOS-8B-V1-P3

Text Generation • Updated 27 days ago • 97 • 1

mradermacher/KRONOS-8B-V1-P3-GGUF

Updated 27 days ago • 307 • 1

T145/ZEUS-8B-V2-abliterated

Text Generation • Updated 2 days ago • 33 • 1

mradermacher/ZEUS-8B-V2-abliterated-GGUF

Updated 1 day ago • 302 • 1

mradermacher/ZEUS-8B-V2-abliterated-i1-GGUF

Updated about 23 hours ago • 507 • 1

hugging-quants/Meta-Llama-3.1-405B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7, 2024 • 552 • 16

hugging-quants/Meta-Llama-3.1-405B-BNB-NF4

Text Generation • Updated Sep 16, 2024 • 63 • 2

hugging-quants/Meta-Llama-3.1-405B-Instruct-BNB-NF4

Text Generation • Updated Sep 16, 2024 • 1.05k • 5

hugging-quants/Meta-Llama-3.1-8B-Instruct-BNB-NF4

Text Generation • Updated Aug 8, 2024 • 4.16k • 7

hugging-quants/Meta-Llama-3.1-8B-BNB-NF4

Text Generation • Updated Aug 8, 2024 • 350

ModelCloud/Meta-Llama-3.1-8B-Instruct-gptq-4bit

Text Generation • Updated Jul 29, 2024 • 220 • 3

brittlewis12/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 27, 2024 • 41 • 1

ModelCloud/Meta-Llama-3.1-8B-gptq-4bit

Text Generation • Updated Jul 26, 2024 • 39

ModelCloud/Meta-Llama-3.1-70B-Instruct-gptq-4bit

Text Generation • Updated Jul 27, 2024 • 340 • 4

ValiantLabs/Llama3.1-8B-Fireplace2

Text Generation • Updated Sep 1, 2024 • 270 • 6

OpenBuddy/openbuddy-llama3.1-8b-v22.1-131k

Text Generation • Updated Jul 24, 2024 • 23 • 5