GitHub repository: microsoft/DeepSpeed-MII
Primary language: Python
Description: MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.