Hugging Face model: RedHatAI/Qwen3-Next-80B-A3B-Instruct-quantized.w4a16
Author: RedHatAI
Created: 2025-12-12 14:16:39
Last modified: 2026-04-28 22:18:00
Pipeline: text-generation
Library: transformers
Likes: 3 | Downloads: 31474
Tags: transformers, safetensors, qwen3_next, text-generation, neuralmagic, redhat, llmcompressor, quantized, INT4, conversational, arxiv:2210.17323, base_model:Qwen/Qwen3-Next-80B-A3B-Instruct, base_model:quantized:Qwen/Qwen3-Next-80B-A3B-Instruct, license:apache-2.0, endpoints_compatible, compressed-tensors, region:us
Base model relation: quantized
Base models: id: Qwen/Qwen3-Next-80B-A3B-Instruct
Card metadata:
library_name: transformers
license: apache-2.0
license_name: apache-2.0
name: RedHatAI/Qwen3-Next-80B-A3B-Instruct-quantized.w4a16
description: Latest Qwen3 architecture with hybrid attention, high-sparsity MoE, stability optimizations and multi-token prediction for great reasoning performance.
readme: https://huggingface.co/RedHatAI/Qwen3-Next-80B-A3B-Instruct-quantized.w4a16/main/README.md
license_link: https://huggingface.co/Qwen/Qwen3-Next-80B-A3B-Instruct/blob/main/LICENSE
provider: Alibaba Cloud
validated_on: RHOAI 3.3, RHAIIS 3.3, vLLM 0.13.0
pipeline_tag: text-generation
base_model: Qwen/Qwen3-Next-80B-A3B-Instruct
tags: neuralmagic, redhat, llmcompressor, quantized, INT4