GitHub repository: ovg-project/kvcached
Primary language: Python
Description: kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference.