GitHub repository: rotorliu/triton-inference-server
Primary language: C++
Description: The Triton Inference Server provides a cloud inferencing solution optimized for NVIDIA GPUs.