Hugging Face model: MidnightPhreaker/KAT-Dev-72B-Exp-GPTQ-INT4-gs32-0.01
Author: MidnightPhreaker
Created: 2025-10-22 20:24:18
Last modified: 2025-10-22 20:29:07
Likes: 1 | Downloads: 4
Tags: safetensors, qwen2, gptq, quantized, vllm, 4bit, group_size_32, base_model:Kwaipilot/KAT-Dev-72B-Exp, base_model:quantized:Kwaipilot/KAT-Dev-72B-Exp, license:apache-2.0, compressed-tensors, region:us
Base model relation: quantized
Base models: id: Kwaipilot/KAT-Dev-72B-Exp
Card metadata:
license: apache-2.0
base_model: Kwaipilot/KAT-Dev-72B-Exp
tags: gptq, quantized, vllm, 4bit, group_size_32
quantization_config: quant_method: gptq
bits: 4
group_size: 32
damp_percent: 0.1