RoFormer: Enhanced Transformer with Rotary Position Embedding
Paper
•
2104.09864
•
Published
•
7
Language model papers
-
-
Attention Is All You Need
Paper • 1706.03762 • Published • 37 -
LoRA: Low-Rank Adaptation of Large Language Models
Paper • 2106.09685 • Published • 25 -
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
Paper • 2205.14135 • Published • 8 -
8-bit Optimizers via Block-wise Quantization
Paper • 2110.02861 • Published -
LLaMA: Open and Efficient Foundation Language Models
Paper • 2302.13971 • Published • 11 -
Efficiently Modeling Long Sequences with Structured State Spaces
Paper • 2111.00396 • Published • 1 -
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
Paper • 2210.17323 • Published • 6 -
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
Paper • 2312.00752 • Published • 132 -
The Unreasonable Ineffectiveness of the Deeper Layers
Paper • 2403.17887 • Published • 75 -
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Paper • 1907.11692 • Published • 7 -
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Paper • 1810.04805 • Published • 12 -
Universal Language Model Fine-tuning for Text Classification
Paper • 1801.06146 • Published • 6 -
Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphs
Paper • 1603.09320 • Published • 1 -
Efficient Tool Use with Chain-of-Abstraction Reasoning
Paper • 2401.17464 • Published • 15 -
Language Models are Few-Shot Learners
Paper • 2005.14165 • Published • 10 -
AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation Framework
Paper • 2308.08155 • Published • 2