GitHub repository: mightyhouseinc/DeepSpeed-MII
Description: MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.