GitHub repository: zifeng175mo/dynamo
Description: A Datacenter Scale Distributed Inference Serving Framework