kinpatchii/batchi: 🚀 Enable efficient deep learning serving with dynamic batching that optimizes batch size and reduces latency while isolating invalid requests.
Language: Go
Topics: ai-agents, algorithm, automation, aws, batch, batching, cli-flags, dag, developer-tools, digraph, directed-acyclic-graph, dynamic-batch, graph, llm-tools, mcp, model-context-protocol, swift, toposort
Category: llm-orchestration-routing