GitHub repository: triton-inference-server/local_cache
Primary language: C++
Description: Implementation of a local in-memory cache for Triton Inference Server's TRITONCACHE API