Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies
Paper
•
2407.13623
•
Published
•
37
Mahdi Pourmirzaei
Mahdip72
·
AI & ML interests
None yet
Organizations
None yet
Mahdip72's activity
upvoted
2
papers
2 days ago
upvoted
a
paper
5 days ago
upvoted
2
papers
9 days ago
upvoted
a
paper
12 days ago
upvoted
a
paper
19 days ago
upvoted
a
paper
20 days ago
upvoted
an
article
24 days ago
Article
Welcome Gemma 2 - Google's new open LLM
•
97
upvoted
a
paper
25 days ago
upvoted
5
papers
about 1 month ago
An Image is Worth 32 Tokens for Reconstruction and Generation
Paper
•
2406.07550
•
Published
•
54
MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark
Paper
•
2406.01574
•
Published
•
42
Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training
Paper
•
2405.15319
•
Published
•
23
ConvLLaVA: Hierarchical Backbones as Visual Encoder for Large Multimodal Models
Paper
•
2405.15738
•
Published
•
43
Depth Anything V2
Paper
•
2406.09414
•
Published
•
88
upvoted
a
paper
about 2 months ago
upvoted
2
papers
2 months ago
upvoted
5
papers
3 months ago
Better & Faster Large Language Models via Multi-token Prediction
Paper
•
2404.19737
•
Published
•
72
KAN: Kolmogorov-Arnold Networks
Paper
•
2404.19756
•
Published
•
102
The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions
Paper
•
2404.13208
•
Published
•
38
Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
Paper
•
2404.14219
•
Published
•
243
Rho-1: Not All Tokens Are What You Need
Paper
•
2404.07965
•
Published
•
80
upvoted
9
papers
4 months ago
Mixture-of-Depths: Dynamically allocating compute in transformer-based language models
Paper
•
2404.02258
•
Published
•
102
Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction
Paper
•
2404.02905
•
Published
•
63
ViTAR: Vision Transformer with Any Resolution
Paper
•
2403.18361
•
Published
•
49
SceneScript: Reconstructing Scenes With An Autoregressive Structured Language Model
Paper
•
2403.13064
•
Published
•
31
MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?
Paper
•
2403.14624
•
Published
•
50
MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training
Paper
•
2403.09611
•
Published
•
123
Gemma: Open Models Based on Gemini Research and Technology
Paper
•
2403.08295
•
Published
•
45
DrugAssist: A Large Language Model for Molecule Optimization
Paper
•
2401.10334
•
Published
•
4
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Paper
•
2403.03507
•
Published
•
180
upvoted
6
papers
5 months ago
Scaling Rectified Flow Transformers for High-Resolution Image Synthesis
Paper
•
2403.03206
•
Published
•
47
Learning and Leveraging World Models in Visual Representation Learning
Paper
•
2403.00504
•
Published
•
28
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
Paper
•
2402.17764
•
Published
•
581
AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling
Paper
•
2402.12226
•
Published
•
37
Neural Network Diffusion
Paper
•
2402.13144
•
Published
•
94
Grandmaster-Level Chess Without Search
Paper
•
2402.04494
•
Published
•
65
upvoted
2
papers
6 months ago
upvoted
4
papers
7 months ago
Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperation
Paper
•
2401.02117
•
Published
•
26
Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision, Language, Audio, and Action
Paper
•
2312.17172
•
Published
•
26
VideoPoet: A Large Language Model for Zero-Shot Video Generation
Paper
•
2312.14125
•
Published
•
41
SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention
Paper
•
2312.07987
•
Published
•
40