GitHub repository: wesley7137/EricLLM
Description: A fast batching API to serve LLM models