Hugging Face model: RedHatAI/Kimi-K2-Instruct-quantized.w4a16
Author: RedHatAI
Created: 2025-07-15 16:33:05
Last modified: 2026-04-28 22:27:27
Pipeline: text-generation
Likes: 12 | Downloads: 258
Tags: safetensors, deepseek_v3, kimi-k2, MOE, neuralmagic, redhat, llmcompressor, quantized, INT4, GPTQ, conversational, compressed-tensors, text-generation, custom_code, en, base_model:moonshotai/Kimi-K2-Instruct, base_model:quantized:moonshotai/Kimi-K2-Instruct, license:other, region:us
Base model relation: quantized
Base models: id: moonshotai/Kimi-K2-Instruct
Card metadata:
language: en
base_model: moonshotai/Kimi-K2-Instruct
pipeline_tag: text-generation
tags: kimi-k2, MOE, neuralmagic, redhat, llmcompressor, quantized, INT4, GPTQ, conversational, compressed-tensors
license: other
license_name: modified-mit
name: RedHatAI/Kimi-K2-Instruct-quantized.w4a16
description: This model was obtained by quantizing weights of moonshotai/Kimi-K2-Instruct to INT4 data type.
readme: https://huggingface.co/RedHatAI/Kimi-K2-Instruct-quantized.w4a16/main/README.md
tasks: text-to-text
provider: Moonshot AI
license_link: https://huggingface.co/moonshotai/Kimi-K2-Instruct/blob/main/LICENSE
validated_on: RHOAI 2.24, RHAIIS 3.2.1, vLLM 0.10.0