GitHub repository: modelscope/dash-infer
Primary language: C
Description: DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including CUDA,  x86 and ARMv9.