batched-fn (cargo): Middleware for serving deep learning models with batched prediction
Keywords: server|deep-learning|batched-prediction|backpressure|batching|rust