GitHub repository: seopbo/llmss
Primary language: Python
Created: 2023-07-18T11:58:16Z
Description: LLM simple serving (tensor model parallel, pubsub, grpc)