Hugging Face model: tensorblock/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-GGUF
Author: tensorblock
Created: 2025-03-08 22:05:35
Last modified: 2026-01-27 21:13:01
Library: transformers
Likes: 0 | Downloads: 28
Tags: transformers, gguf, deepseek, int4, vllm, llmcompressor, TensorBlock, GGUF, base_model:RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16, base_model:quantized:RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16, license:mit, endpoints_compatible, region:us, conversational
Base model relation: quantized
Base models: id: RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16
Card metadata:
license: mit
tags: deepseek, int4, vllm, llmcompressor, TensorBlock, GGUF
base_model: neuralmagic/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16
library_name: transformers