GitHub repository: JeffWigger/FastDynamicBatcher
Primary language: Python
Description: FastDynamicBatcher is a library for batching inputs across requests to accelerate machine learning workloads