TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding Paper • 2404.11912 • Published 21 days ago • 15
SnapKV: LLM Knows What You are Looking for Before Generation Paper • 2404.14469 • Published 16 days ago • 23
LLM in a flash: Efficient Large Language Model Inference with Limited Memory Paper • 2312.11514 • Published Dec 12, 2023 • 252