MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training
Paper
•
2403.09611
•
Published
•
119
To read... eventually
-
-
Evolutionary Optimization of Model Merging Recipes
Paper • 2403.13187 • Published • 44 -
MobileVLM V2: Faster and Stronger Baseline for Vision Language Model
Paper • 2402.03766 • Published • 9 -
LLM Agent Operating System
Paper • 2403.16971 • Published • 62 -
Jamba: A Hybrid Transformer-Mamba Language Model
Paper • 2403.19887 • Published • 99 -
ReALM: Reference Resolution As Language Modeling
Paper • 2403.20329 • Published • 20 -
Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models
Paper • 2403.20331 • Published • 14 -
Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention
Paper • 2404.07143 • Published • 92 -
TransformerFAM: Feedback attention is working memory
Paper • 2404.09173 • Published • 42 -
FABLES: Evaluating faithfulness and content selection in book-length summarization
Paper • 2404.01261 • Published • 3 -
GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints
Paper • 2305.13245 • Published • 5 -
Video as the New Language for Real-World Decision Making
Paper • 2402.17139 • Published • 17 -
OpenELM: An Efficient Language Model Family with Open-source Training and Inference Framework
Paper • 2404.14619 • Published • 120 -
Pegasus-v1 Technical Report
Paper • 2404.14687 • Published • 29 -
Transformers Can Represent n-gram Language Models
Paper • 2404.14994 • Published • 17 -
FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores
Paper • 2311.05908 • Published • 11 -
Question Aware Vision Transformer for Multimodal Reasoning
Paper • 2402.05472 • Published • 6 -
STaRK: Benchmarking LLM Retrieval on Textual and Relational Knowledge Bases
Paper • 2404.13207 • Published -
Make Your LLM Fully Utilize the Context
Paper • 2404.16811 • Published • 51 -
LoRA Land: 310 Fine-tuned LLMs that Rival GPT-4, A Technical Report
Paper • 2405.00732 • Published • 109 -
Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models
Paper • 2405.01535 • Published • 94 -
You Only Cache Once: Decoder-Decoder Architectures for Language Models
Paper • 2405.05254 • Published • 5 -
SUTRA: Scalable Multilingual Language Model Architecture
Paper • 2405.06694 • Published • 34 -
What matters when building vision-language models?
Paper • 2405.02246 • Published • 81 -
Xmodel-VLM: A Simple Baseline for Multimodal Vision Language Model
Paper • 2405.09215 • Published • 13 -
LoRA Learns Less and Forgets Less
Paper • 2405.09673 • Published • 61 -
Many-Shot In-Context Learning in Multimodal Foundation Models
Paper • 2405.09798 • Published • 24 -
MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning
Paper • 2405.12130 • Published • 30