GitHub repository: CarlosGolvano/DynamicBatch
Primary language: Python
Created: 2024-10-31T07:48:09Z
Description: Dynamic Batch Inference Library for LLMs