GitHub repository: nexr/MLServer
Description: An inference server for your machine learning models, including support for multiple frameworks, multi-model serving and more