GitHub repository: mlsys-io/kv.run
Primary language: C++
Description: A model serving framework for various research and production scenarios. Seamlessly built upon the PyTorch and HuggingFace ecosystem.