GitHub repository: ClubieDong/QAQ-KVCacheQuantization
Primary language: Python
Description: QAQ: Quality Adaptive Quantization for LLM KV Cache