GitHub repository: wseaton/llm-d
Description: llm-d is a Kubernetes-native high-performance distributed LLM inference framework