GitHub repository: AI-Hypercomputer/JetStream
Primary language: Python
Description: JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).