GitHub repository: InftyAI/puma
Primary language: Rust
Description: A lightweight, high-performance inference engine for heterogeneous devices.