Adapting Language Models to Compress Contexts
Paper
•
2305.14788
•
Published
•
1
LLM-LongContext-Compression
Papers in terms of LLM LongContext Compression way, Reading Details: https://www.notion.so/LLM-LongContext-Compression-323cc6da39124c3a97d3502e1bf61b7
Note Done
Soaring from 4K to 400K: Extending LLM's Context with Activation Beacon
Paper • 2401.03462 • Published • 25Note Done
-
Flexibly Scaling Large Language Models Contexts Through Extensible Tokenization
Paper • 2401.07793 • Published • 3 -
Say More with Less: Understanding Prompt Learning Behaviors through Gist Compression
Paper • 2402.16058 • Published
System 2 Attention (is something you might need too)
Paper • 2311.11829 • Published • 38Note Done
-
LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models
Paper • 2310.05736 • Published • 4 -
LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression
Paper • 2310.06839 • Published • 3 -
Recurrent Memory Transformer
Paper • 2207.06881 • Published • 1 -
Scaling Transformer to 1M tokens and beyond with RMT
Paper • 2304.11062 • Published • 2 -
In Search of Needles in a 10M Haystack: Recurrent Memory Finds What LLMs Miss
Paper • 2402.10790 • Published • 39
GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM
Paper • 2403.05527 • PublishedNote Done
Compressing Context to Enhance Inference Efficiency of Large Language Models
Paper • 2310.06201 • PublishedNote Done
-
Learning to Compress Prompts with Gist Tokens
Paper • 2304.08467 • Published • 3
Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs
Paper • 2310.01801 • Published • 3Note Done
-
An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Models
Paper • 2403.06764 • Published • 24