RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval
Paper
•
2409.10516
•
Published
•
42
kevinzeng
Kevinzbw
AI & ML interests
Machine Learning System, Databases
Organizations
None yet