GitHub repository: jsamantaucd/BentoML
Primary language: Python
Description: The easiest way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Multi-model Inference Graph/Pipelines, LLM/RAG apps, and more!