neuralmagic 's Collections DeepSeek-R1-Distill Quantized
updated
RedHatAI/DeepSeek-R1-Distill-Llama-8B-FP8-dynamic
Text Generation
• 8B • Updated • 444
• 5
RedHatAI/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic
Text Generation
• 71B • Updated • 5.22k
• 10
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-FP8-dynamic
Text Generation
• 33B • Updated • 6.23k
• 10
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8
Text Generation
• 71B • Updated • 244
• 2
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-FP8-dynamic
Text Generation
• 15B • Updated • 482
• 3
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-FP8-dynamic
Text Generation
• 8B • Updated • 1.32k
• 1
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w8a8
Text Generation
• 2B • Updated • 68
• 2
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-FP8-dynamic
Text Generation
• 2B • Updated • 465
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w8a8
Text Generation
• 15B • Updated • 117
• 2
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8
Text Generation
• 8B • Updated • 311
• 5
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w4a16
Text Generation
• 8B • Updated • 423
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w8a8
Text Generation
• 8B • Updated • 415
• 2
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w4a16
Text Generation
• 15B • Updated • 288
• 1
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16
Text Generation
• 8B • Updated • 283
• 2
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w4a16
Text Generation
• 2B • Updated • 82
• 1
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16
Text Generation
• 71B • Updated • 6.73k
• 6
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16
Text Generation
• 33B • Updated • 871
• 5
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8
Text Generation
• 33B • Updated • 180
• 13