Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

8-bit precision

Mixture of Experts

Models

175

Full-text search

Active filters: llama-3.1

mradermacher/Llama3.1-8B-ShiningValiant2-GGUF

Updated Nov 15, 2024 • 64

mradermacher/Llama3.1-8B-ShiningValiant2-i1-GGUF

Updated Nov 15, 2024 • 43

tensorblock/openbuddy-llama3.1-8b-v22.3-131k-GGUF

Text Generation • Updated Nov 17, 2024 • 17

mav23/Llama3.1-70B-ShiningValiant2-GGUF

Text Generation • Updated Nov 17, 2024 • 56

Triangle104/AstroSage-8B-Q4_K_S-GGUF

Text Generation • Updated Nov 17, 2024 • 6

Triangle104/AstroSage-8B-Q5_K_S-GGUF

Text Generation • Updated Nov 17, 2024 • 2

Triangle104/AstroSage-8B-Q5_K_M-GGUF

Text Generation • Updated Nov 17, 2024 • 5

Triangle104/AstroSage-8B-Q6_K-GGUF

Text Generation • Updated Nov 17, 2024 • 8

Triangle104/AstroSage-8B-Q8_0-GGUF

Text Generation • Updated Nov 17, 2024 • 4

ckoozzzu/ebashyvkashyvsetaomoiblyatb2

Text Generation • Updated Nov 20, 2024 • 9

T145/Llama-3.1-8B-Instruct-Zeus

Text Generation • Updated Dec 2, 2024 • 16

T145/ZEUS-8B-V2

Text Generation • Updated 2 days ago • 313 • 2

Akerrules/swotmodelQA

Text2Text Generation • Updated Dec 3, 2024 • 9

T145/KRONOS-8B-V1-P2

Text Generation • Updated about 1 month ago • 61

mradermacher/KRONOS-8B-V1-P2-GGUF

Updated 30 days ago • 282

kishizaki-sci/Llama-3.1-405B-Instruct-AWQ-4bit-JP-EN

Text Generation • Updated 28 days ago • 58

doktorb/Configurable-Llama-3.1-8B-Instruct-GGUF

Updated 25 days ago • 105

matrixportal/Llama-3.1-Storm-8B-Q4_0-GGUF

Text Generation • Updated 13 days ago • 38

Triangle104/Llama3.1-8B-PlumMath-Q4_K_S-GGUF

Text Generation • Updated 9 days ago • 5

Triangle104/Llama3.1-8B-PlumMath-Q4_K_M-GGUF

Text Generation • Updated 9 days ago • 5

Triangle104/Llama3.1-8B-PlumMath-Q5_K_S-GGUF

Text Generation • Updated 9 days ago • 4

Triangle104/Llama3.1-8B-PlumMath-Q6_K-GGUF

Text Generation • Updated 9 days ago • 4

Triangle104/Llama3.1-8B-PlumMath-Q5_K_M-GGUF

Text Generation • Updated 9 days ago • 21

Triangle104/Llama3.1-8B-PlumMath-Q8_0-GGUF

Text Generation • Updated 9 days ago • 27

NeuroWhAI/Llama-VARCO-8B-Instruct-LLaMAfied-Q5_K_M-GGUF

Updated 3 days ago • 11