19 30 67

Li Dong

unilm

AI & ML interests

Language Model Pre-Training

Recent Activity

liked a dataset 1 day ago

open-thoughts/OpenThoughts-114k

liked a dataset 1 day ago

open-r1/OpenThoughts-114k-math

liked a dataset 1 day ago

simplescaling/s1K

View all activity

Organizations

unilm's activity

upvoted a paper 9 days ago

Chain-of-Retrieval Augmented Generation

Paper • 2501.14342 • Published 12 days ago • 47

upvoted 2 papers 27 days ago

rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinking

Paper • 2501.04519 • Published 28 days ago • 253

Towards System 2 Reasoning in LLMs: Learning How to Think With Meta Chain-of-Though

Paper • 2501.04682 • Published 28 days ago • 90

upvoted 2 papers about 2 months ago

Apollo: An Exploration of Video Understanding in Large Multimodal Models

Paper • 2412.10360 • Published Dec 13, 2024 • 139

Multimodal Latent Language Modeling with Next-Token Diffusion

Paper • 2412.08635 • Published Dec 11, 2024 • 44

upvoted a paper 3 months ago

OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models

Paper • 2411.04905 • Published Nov 7, 2024 • 115

upvoted 3 papers 4 months ago

upvoted a paper 6 months ago

DataComp-LM: In search of the next generation of training sets for language models

Paper • 2406.11794 • Published Jun 17, 2024 • 50

upvoted a paper 7 months ago

Direct Preference Knowledge Distillation for Large Language Models

Paper • 2406.19774 • Published Jun 28, 2024 • 22

upvoted a paper 8 months ago

BEiT: BERT Pre-Training of Image Transformers

Paper • 2106.08254 • Published Jun 15, 2021 • 2

upvoted 2 papers 9 months ago

ALPINE: Unveiling the Planning Capability of Autoregressive Learning in Language Models

Paper • 2405.09220 • Published May 15, 2024 • 27

You Only Cache Once: Decoder-Decoder Architectures for Language Models

Paper • 2405.05254 • Published May 8, 2024 • 10

upvoted a paper 10 months ago

Multi-Head Mixture-of-Experts

Paper • 2404.15045 • Published Apr 23, 2024 • 60

upvoted 3 papers 11 months ago

Algorithmic progress in language models

Paper • 2403.05812 • Published Mar 9, 2024 • 18

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27, 2024 • 608

Towards Optimal Learning of Language Models

Paper • 2402.17759 • Published Feb 27, 2024 • 17

upvoted 2 papers about 1 year ago

TEAL: Tokenize and Embed ALL for Multi-modal Large Language Models

Paper • 2311.04589 • Published Nov 8, 2023 • 19

Does GPT-4 Pass the Turing Test?

Paper • 2310.20216 • Published Oct 31, 2023 • 17