GitHub repository: lasotaagency/EricLLM
Description: A fast batching API to serve LLM models