GitHub repository: kemingy/mosec
Primary language: Python
Description: A high-performance serving framework for ML models, offers dynamic batching and multi-stage pipeline to fully exploit your compute machine