Hugging Face model: MidnightPhreaker/KAT-Dev-72B-Exp-GPTQ-INT4-gs32
Author: MidnightPhreaker
Created: 2025-10-22 21:13:55
Last modified: 2025-10-22 21:18:13
Likes: 0 | Downloads: 4
Tags: safetensors, qwen2, gptq, quantized, vllm, 4bit, group_size_32, base_model:Kwaipilot/KAT-Dev-72B-Exp, base_model:quantized:Kwaipilot/KAT-Dev-72B-Exp, license:apache-2.0, compressed-tensors, region:us
Base model relation: quantized
Base models: id: Kwaipilot/KAT-Dev-72B-Exp
Card metadata:
license: apache-2.0
base_model: Kwaipilot/KAT-Dev-72B-Exp
tags: gptq, quantized, vllm, 4bit, group_size_32
quantization_config: quant_method: gptq
bits: 4
group_size: 32
damp_percent: 0.1