GitHub repository: tensorchord/inference-benchmark
Primary language: Python
Created: 2023-06-12T09:39:43Z
Description: WIP Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)