GitHub repository: HughWen/ServingAgent
Primary language: Python
Created: 2021-01-01T02:06:14Z
Description: A simple middleware to improving GPU utilization then speedup online inference.