GitHub repository: xiaomaoaichiyu/expert-kit
Primary language: Rust
Description: Expert Kit is an efficient foundation of Expert Parallelism (EP) for MoE model Inference on heterogenous hardware