Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

arxiv: 2404.08634

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

21

Base only

Active filters: 2404.08634

prince-canuma/Llama-3-6B-v0

Text Generation • 6B • Updated May 24, 2024 • 19 • 4

prince-canuma/Llama-3-6B-v0.1

Text Generation • 6B • Updated May 24, 2024 • 14 • 14

Zoyd/prince-canuma_Llama-3-6B-v0.1-2_2bpw_exl2

Text Generation • Updated May 27, 2024 • 7

Zoyd/prince-canuma_Llama-3-6B-v0.1-2_5bpw_exl2

Text Generation • Updated May 27, 2024 • 8

Zoyd/prince-canuma_Llama-3-6B-v0.1-3_0bpw_exl2

Text Generation • Updated May 27, 2024 • 7

Zoyd/prince-canuma_Llama-3-6B-v0.1-3_5bpw_exl2

Text Generation • Updated May 27, 2024 • 8

Zoyd/prince-canuma_Llama-3-6B-v0.1-3_75bpw_exl2

Text Generation • Updated May 27, 2024 • 6

Zoyd/prince-canuma_Llama-3-6B-v0.1-4_0bpw_exl2

Text Generation • Updated May 27, 2024 • 5

Zoyd/prince-canuma_Llama-3-6B-v0.1-4_25bpw_exl2

Text Generation • Updated May 27, 2024 • 6

Zoyd/prince-canuma_Llama-3-6B-v0.1-5_0bpw_exl2

Text Generation • Updated May 27, 2024 • 7

Zoyd/prince-canuma_Llama-3-6B-v0.1-6_0bpw_exl2

Text Generation • Updated May 27, 2024 • 7

Zoyd/prince-canuma_Llama-3-6B-v0.1-8_0bpw_exl2

Text Generation • Updated May 27, 2024 • 8

Zoyd/prince-canuma_Llama-3-6B-v0.1-6_5bpw_exl2

Text Generation • Updated May 27, 2024 • 5

RichardErkhov/prince-canuma_-_Llama-3-6B-v0.1-gguf

6B • Updated Aug 21, 2024 • 1.1k

RichardErkhov/prince-canuma_-_Llama-3-6B-v0-4bits

6B • Updated Mar 23, 2025 • 8

RichardErkhov/prince-canuma_-_Llama-3-6B-v0-8bits

6B • Updated Mar 23, 2025 • 8

RichardErkhov/prince-canuma_-_Llama-3-6B-v0.1-4bits

6B • Updated Mar 23, 2025 • 8

RichardErkhov/prince-canuma_-_Llama-3-6B-v0.1-8bits

6B • Updated Mar 23, 2025 • 7

GuminiResearch/Gumini-1B-Base

Text Generation • 1B • Updated Dec 17, 2025 • 20 • 7

GuminiResearch/Gumini-1.5B-Base

Text Generation • 2B • Updated Dec 18, 2025 • 15 • 8

GuminiResearch/Gumini-1.5B-Base-i1-GGUF

Text Generation • 2B • Updated Dec 17, 2025 • 235 • 2