GitHub repository: mrjackbo/tensorrt-inference-server
Primary language: C++
Description: The TensorRT Inference Server provides a cloud inferencing solution optimized for NVIDIA GPUs.