openllm (pypi): OpenLLM: REST/gRPC API server for running any open Large-Language Model - StableLM, Llama, Alpaca, Dolly, Flan-T5, Custom
Keywords: AI|Alpaca|BentoML|Generative AI|LLMOps|Large Language Model|MLOps|Model Deployment|Model Serving|PyTorch|Stable Diffusion|StableLM|Transformers