GitHub repository: kvcache-ai/ktransformers
Primary language: Python
Description: A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations