Hugging Face model: QuantTrio/KAT-V1-40B-GPTQ-Int4-Int8Mix
Author: QuantTrio
Created: 2025-07-31 05:21:01
Last modified: 2025-09-05 08:37:21
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 6
Tags: transformers, safetensors, qwen2, text-generation, AWQ, 量化修复, vLLM, conversational, arxiv:2507.08297, base_model:Kwaipilot/KAT-V1-40B, base_model:quantized:Kwaipilot/KAT-V1-40B, text-generation-inference, endpoints_compatible, 4-bit, gptq, region:us
Base model relation: quantized
Base models: id: Kwaipilot/KAT-V1-40B
Card metadata:
library_name: transformers
license_link: https://huggingface.co/Qwen/Qwen3-30B-A3B-Thinking-2507/blob/main/LICENSE
pipeline_tag: text-generation
tags: AWQ, 量化修复, vLLM
base_model: Kwaipilot/KAT-V1-40B
base_model_relation: quantized