Hugging Face model: RedHatAI/DeepSeek-R1-0528-quantized.w4a16
Author: RedHatAI
Created: 2025-05-30 16:14:36
Last modified: 2026-04-28 22:26:50
Pipeline: text-generation
Likes: 13 | Downloads: 73
Tags: safetensors, deepseek_v3, deepseek, neuralmagic, redhat, llmcompressor, quantized, INT4, GPTQ, conversational, compressed-tensors, text-generation, custom_code, en, base_model:deepseek-ai/DeepSeek-R1-0528, base_model:quantized:deepseek-ai/DeepSeek-R1-0528, license:mit, region:us
Base model relation: quantized
Base models: id: deepseek-ai/DeepSeek-R1-0528
Card metadata:
language: en
base_model: deepseek-ai/DeepSeek-R1-0528
pipeline_tag: text-generation
tags: deepseek_v3, deepseek, neuralmagic, redhat, llmcompressor, quantized, INT4, GPTQ, conversational, compressed-tensors
license: mit
license_name: mit
name: RedHatAI/DeepSeek-R1-0528-quantized.w4a16
description: This model was obtained by quantizing weights of DeepSeek-R1-0528 to INT4 data type.
readme: https://huggingface.co/RedHatAI/DeepSeek-R1-0528-quantized.w4a16/main/README.md
tasks: text-to-text
provider: DeepSeek
license_link: https://choosealicense.com/licenses/mit/
validated_on: RHOAI 2.24, RHAIIS 3.2.1, vLLM v0.10.0