GitHub repository: prickly-u/inference-server
Primary language: C++
Description: Asynchronous multithreading inference server on TensorRT and boost beast/boost asio.