GitHub repository: opengear-project/GEAR
Primary language: Python
Description: GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM