PowerInfer-2: Fast Large Language Model Inference on a Smartphone Paper • 2406.06282 • Published 19 days ago • 35
Turbo Sparse: Achieving LLM SOTA Performance with Minimal Activated Parameters Paper • 2406.05955 • Published 20 days ago • 21
PowerInfer: Fast Large Language Model Serving with a Consumer-grade GPU Paper • 2312.12456 • Published Dec 16, 2023 • 40