-
Attention Is All You Need
Paper ā¢ 1706.03762 ā¢ Published ā¢ 41 -
FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning
Paper ā¢ 2307.08691 ā¢ Published ā¢ 7 -
Mixtral of Experts
Paper ā¢ 2401.04088 ā¢ Published ā¢ 157 -
Mistral 7B
Paper ā¢ 2310.06825 ā¢ Published ā¢ 47
Collections
Discover the best community collections!
Collections including paper arxiv:1706.03762
-
Detecting Pretraining Data from Large Language Models
Paper ā¢ 2310.16789 ā¢ Published ā¢ 10 -
Let's Synthesize Step by Step: Iterative Dataset Synthesis with Large Language Models by Extrapolating Errors from Small Models
Paper ā¢ 2310.13671 ā¢ Published ā¢ 18 -
AutoMix: Automatically Mixing Language Models
Paper ā¢ 2310.12963 ā¢ Published ā¢ 14 -
An Emulator for Fine-Tuning Large Language Models using Small Language Models
Paper ā¢ 2310.12962 ā¢ Published ā¢ 14
-
Efficient Memory Management for Large Language Model Serving with PagedAttention
Paper ā¢ 2309.06180 ā¢ Published ā¢ 25 -
LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models
Paper ā¢ 2308.16137 ā¢ Published ā¢ 39 -
Scaling Transformer to 1M tokens and beyond with RMT
Paper ā¢ 2304.11062 ā¢ Published ā¢ 2 -
DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models
Paper ā¢ 2309.14509 ā¢ Published ā¢ 17
-
Attention Is All You Need
Paper ā¢ 1706.03762 ā¢ Published ā¢ 41 -
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Paper ā¢ 2005.11401 ā¢ Published ā¢ 11 -
LoRA: Low-Rank Adaptation of Large Language Models
Paper ā¢ 2106.09685 ā¢ Published ā¢ 26 -
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
Paper ā¢ 2205.14135 ā¢ Published ā¢ 9
-
SIMPL: A Simple and Efficient Multi-agent Motion Prediction Baseline for Autonomous Driving
Paper ā¢ 2402.02519 ā¢ Published -
Mixtral of Experts
Paper ā¢ 2401.04088 ā¢ Published ā¢ 157 -
Optimal Transport Aggregation for Visual Place Recognition
Paper ā¢ 2311.15937 ā¢ Published -
GOAT: GO to Any Thing
Paper ā¢ 2311.06430 ā¢ Published ā¢ 14
-
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
Paper ā¢ 2402.17764 ā¢ Published ā¢ 587 -
Mixtral of Experts
Paper ā¢ 2401.04088 ā¢ Published ā¢ 157 -
Mistral 7B
Paper ā¢ 2310.06825 ā¢ Published ā¢ 47 -
Don't Make Your LLM an Evaluation Benchmark Cheater
Paper ā¢ 2311.01964 ā¢ Published ā¢ 1
-
Neural Machine Translation of Rare Words with Subword Units
Paper ā¢ 1508.07909 ā¢ Published ā¢ 4 -
Attention Is All You Need
Paper ā¢ 1706.03762 ā¢ Published ā¢ 41 -
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Paper ā¢ 1810.04805 ā¢ Published ā¢ 14 -
Generating Wikipedia by Summarizing Long Sequences
Paper ā¢ 1801.10198 ā¢ Published ā¢ 3
-
Attention Is All You Need
Paper ā¢ 1706.03762 ā¢ Published ā¢ 41 -
Language Models are Few-Shot Learners
Paper ā¢ 2005.14165 ā¢ Published ā¢ 11 -
Learning to summarize from human feedback
Paper ā¢ 2009.01325 ā¢ Published ā¢ 2 -
Training language models to follow instructions with human feedback
Paper ā¢ 2203.02155 ā¢ Published ā¢ 13