torchdeploy (pypi): torch::deploy (multipy) is a C++ library that makes it easier to run eager PyTorch models in production by using independent python interpreters to avoid the GIL.
Keywords: pytorch|machine learning|inference