Hugging Face model: MidnightPhreaker/KAT-Dev-72B-Exp-GPTQ-INT4-gs128
Author: MidnightPhreaker
Created: 2025-10-22 22:33:55
Last modified: 2025-10-22 22:38:16
Likes: 0 | Downloads: 9
Tags: safetensors, qwen2, gptq, quantized, vllm, 4bit, group_size_128, base_model:Kwaipilot/KAT-Dev-72B-Exp, base_model:quantized:Kwaipilot/KAT-Dev-72B-Exp, license:apache-2.0, compressed-tensors, region:us
Base model relation: quantized
Base models: id: Kwaipilot/KAT-Dev-72B-Exp
Card metadata:
license: apache-2.0
base_model: Kwaipilot/KAT-Dev-72B-Exp
tags: gptq, quantized, vllm, 4bit, group_size_128
quantization_config: quant_method: gptq
bits: 4
group_size: 128
damp_percent: 0.1