GitHub repository: mixedbread-ai/batched
Primary language: Python
Description: The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching of inference workloads.