Edit Models filters

Model Tree

meta-llama/Llama-3.1-8B-Instruct

Inference Providers

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

352

Full-text search

Active filters: meta-llama/Llama-3.1-8B-Instruct

eric-musa/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 16, 2024

eric-musa/Meta-Llama-3.1-8B-Instruct-Q4_0-GGUF

Text Generation • Updated Sep 16, 2024 • 4

mariosorri/Meta-Llama-3.1-8B-Instruct-Q4_0-GGUF

Text Generation • Updated Sep 16, 2024 • 4

Aaron2599/Meta-Llama-3.1-8B-Instruct-TurboMind-AWQ-4bit

Updated Sep 18, 2024 • 11

rachelkluu/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 20, 2024 • 3

QuantFactory/Skywork-Critic-Llama-3.1-8B-GGUF

Text Generation • Updated Sep 24, 2024 • 183 • 2

VPTQ-community/Meta-Llama-3.1-8B-Instruct-v8-k65536-65536-woft

Updated Nov 18, 2024 • 45

VPTQ-community/Meta-Llama-3.1-8B-Instruct-v8-k65536-4096-woft

Updated Nov 18, 2024 • 25

VPTQ-community/Meta-Llama-3.1-8B-Instruct-v8-k65536-256-woft

Updated Nov 18, 2024 • 158

nm-testing/Meta-Llama-3.1-8B-Instruct-FP8-hf

Text Generation • Updated Sep 24, 2024 • 65

youkwan/Home-Llama-v2.0-GGUF

Updated Oct 26, 2024 • 14

QuantFactory/Vikhr-Llama3.1-8B-Instruct-R-21-09-24-GGUF

Updated Sep 25, 2024 • 88 • 1

rachelkluu/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25, 2024 • 4

lodm94/Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 26, 2024 • 1

hungun/Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 28, 2024 • 3

VPTQ-community/Meta-Llama-3.1-8B-Instruct-v12-k65536-4096-woft

Updated Jan 13 • 211 • 2

m2wws/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 29, 2024 • 3

hoorang/Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Sep 30, 2024 • 1

stramzik/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 2, 2024

jacobcarajo/Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 2, 2024 • 5

arzuhussein/atllama

Updated Jan 15 • 6 • 3

hongphucpham/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 7, 2024 • 3

cmchenry66/Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 8, 2024 • 6

josiahdavis/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 8, 2024

BitStreamX/Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 8, 2024 • 1

Jeethu/Meta-Llama-3.1-8B-Instruct-PLLM

Text Generation • Updated Oct 8, 2024 • 14

QuantFactory/Llama3.1-8B-Esper2-GGUF

Text Generation • Updated Oct 9, 2024 • 111 • 1

DaraV/LLaMA-3.1-8B-Instruct-INT4-GPTQ

Updated Oct 11, 2024 • 28

sheldonrobinson/Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • Updated Oct 11, 2024 • 2

mav23/Llama3.1-8B-Chinese-Chat-GGUF

Text Generation • Updated Oct 12, 2024 • 1.19k • 1