Edit Models filters

Model Tree

deepseek-ai/DeepSeek-R1-Distill-Llama-70B

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

58

Full-text search

Active filters: deepseek-ai/DeepSeek-R1-Distill-Llama-70B

mlx-community/DeepSeek-R1-Distill-Llama-70B-4bit

Text Generation • Updated Feb 26 • 838 • 8

unsloth/DeepSeek-R1-Distill-Llama-70B-bnb-4bit

Text Generation • Updated Feb 14 • 2.75k • 21

unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF

Updated Jan 29 • 10.2k • 78

lmstudio-community/DeepSeek-R1-Distill-Llama-70B-GGUF

Text Generation • Updated Jan 20 • 6.36k • 4

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q3_K_M-GGUF

Text Generation • Updated Jan 20 • 36 • 1

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q4_0-GGUF

Text Generation • Updated Jan 20 • 163 • 1

zhitels/DeepSeek-R1-Distill-Llama-70B-4bit

Updated Jan 20 • 10 • 1

Valdemardi/DeepSeek-R1-Distill-Llama-70B-AWQ

Text Generation • Updated Jan 20 • 2.54k • 17

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q6_K-GGUF

Text Generation • Updated Jan 21 • 56 • 1

mradermacher/DeepSeek-R1-Distill-Llama-70B-i1-GGUF

Updated Jan 23 • 206 • 3

second-state/DeepSeek-R1-Distill-Llama-70B-GGUF

Text Generation • Updated Jan 22 • 291 • 1

nm-testing/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic

Text Generation • Updated Feb 1 • 397 • 3

RedHatAI/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic

Text Generation • Updated Feb 27 • 66.2k • 8

novita/DeepSeek-R1-Distill-Llama-70B-w8a8kv8-s888

Updated Feb 7 • 1 • 2

RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8

Text Generation • Updated Feb 27 • 637 • 2

RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16

Text Generation • Updated Feb 27 • 1.4k • 4

WaveCut/deepseek-ai_DeepSeek-R1-Distill-Llama-70B_MLX-4bit

Updated Jan 20 • 14 • 1

bartowski/DeepSeek-R1-Distill-Llama-70B-GGUF

Text Generation • Updated Jan 22 • 3.29k • 34

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q2_K-GGUF

Text Generation • Updated Jan 20 • 37

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q3_K_S-GGUF

Text Generation • Updated Jan 20 • 10

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q3_K_L-GGUF

Text Generation • Updated Jan 20 • 6

mmnga/DeepSeek-R1-Distill-Llama-70B-gguf

Updated Jan 21 • 72

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q4_K_S-GGUF

Text Generation • Updated Jan 20 • 19

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q5_0-GGUF

Text Generation • Updated Jan 20 • 2

mlx-community/DeepSeek-R1-Distill-Llama-70B-8bit

Updated Feb 26 • 434 • 8

XelotX/DeepSeek-R1-Distill-Llama-70B-GGUF

Updated Jan 20 • 117

zhitels/DeepSeek-R1-Distill-Llama-70B-6bit

Updated Jan 20 • 5

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q8_0-GGUF

Text Generation • Updated Jan 21 • 80

mlc-ai/DeepSeek-R1-Distill-Llama-70B-q4f16_1-MLC

Updated Jan 21 • 3

mlc-ai/DeepSeek-R1-Distill-Llama-70B-q0f16-MLC

Updated Jan 21 • 2