NLPBada (Sun Donghae)

upvoted a paper about 11 hours ago

Chameleon: Mixed-Modal Early-Fusion Foundation Models

Paper • 2405.09818 • Published 4 days ago • 67

upvoted a paper 4 days ago

ALPINE: Unveiling the Planning Capability of Autoregressive Learning in Language Models

Paper • 2405.09220 • Published 5 days ago • 20

upvoted 2 papers 6 days ago

What matters when building vision-language models?

Paper • 2405.02246 • Published 17 days ago • 77

RLHF Workflow: From Reward Modeling to Online RLHF

Paper • 2405.07863 • Published 7 days ago • 52

upvoted a paper 13 days ago

LoRA Land: 310 Fine-tuned LLMs that Rival GPT-4, A Technical Report

Paper • 2405.00732 • Published 21 days ago • 109

upvoted a paper 15 days ago

Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models

Paper • 2405.01535 • Published 18 days ago • 92

upvoted a paper 23 days ago

Layer Skip: Enabling Early Exit Inference and Self-Speculative Decoding

Paper • 2404.16710 • Published 25 days ago • 55

upvoted a paper 24 days ago

How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suites

Paper • 2404.16821 • Published 25 days ago • 49

upvoted a paper 25 days ago

OpenELM: An Efficient Language Model Family with Open-source Training and Inference Framework

Paper • 2404.14619 • Published 28 days ago • 120

upvoted a paper 26 days ago

SnapKV: LLM Knows What You are Looking for Before Generation

Paper • 2404.14469 • Published 28 days ago • 23

upvoted a paper 27 days ago

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Paper • 2404.14219 • Published 28 days ago • 230

upvoted 18 papers about 1 month ago

Learn Your Reference Model for Real Good Alignment

Paper • 2404.09656 • Published Apr 15 • 79

Neural Network Diffusion

Paper • 2402.13144 • Published Feb 20 • 92

MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Cases

Paper • 2402.14905 • Published Feb 22 • 80

Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

Paper • 2404.07143 • Published Apr 10 • 92

Chain-of-Thought Reasoning Without Prompting

Paper • 2402.10200 • Published Feb 15 • 90

StarCoder 2 and The Stack v2: The Next Generation

Paper • 2402.19173 • Published Feb 29 • 124

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

Paper • 2403.03507 • Published Mar 6 • 172

Stealing Part of a Production Language Model

Paper • 2403.06634 • Published Mar 11 • 85

LLM Agent Operating System

Paper • 2403.16971 • Published Mar 25 • 62

The Unreasonable Ineffectiveness of the Deeper Layers

Paper • 2403.17887 • Published Mar 26 • 75

Jamba: A Hybrid Transformer-Mamba Language Model

Paper • 2403.19887 • Published Mar 28 • 99

Mixture-of-Depths: Dynamically allocating compute in transformer-based language models

Paper • 2404.02258 • Published Apr 2 • 101

ReFT: Representation Finetuning for Language Models

Paper • 2404.03592 • Published Apr 4 • 72

upvoted a collection about 2 months ago

Korean Pretraining Dataset

Collection

13 items • Updated Feb 28 • 6

upvoted 5 papers 3 months ago

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27 • 566

LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens

Paper • 2402.13753 • Published Feb 21 • 104

Speculative Streaming: Fast LLM Inference without Auxiliary Models

Paper • 2402.11131 • Published Feb 16 • 41

Generative Representational Instruction Tuning

Paper • 2402.09906 • Published Feb 15 • 50

Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning

Paper • 2402.06619 • Published Feb 9 • 47

upvoted 2 papers 4 months ago

Large Language Models are Superpositions of All Characters: Attaining Arbitrary Role-play via Self-Alignment

Paper • 2401.12474 • Published Jan 23 • 33

Self-Rewarding Language Models

Paper • 2401.10020 • Published Jan 18 • 135

upvoted 11 papers 5 months ago

TinyLlama: An Open-Source Small Language Model

Paper • 2401.02385 • Published Jan 4 • 81

LLaMA Beyond English: An Empirical Study on Language Capability Transfer

Paper • 2401.01055 • Published Jan 2 • 50

Improving Text Embeddings with Large Language Models

Paper • 2401.00368 • Published Dec 31, 2023 • 72

LLM in a flash: Efficient Large Language Model Inference with Limited Memory

Paper • 2312.11514 • Published Dec 12, 2023 • 253

Amphion: An Open-Source Audio, Music and Speech Generation Toolkit

Paper • 2312.09911 • Published Dec 15, 2023 • 51

LLM360: Towards Fully Transparent Open-Source LLMs

Paper • 2312.06550 • Published Dec 11, 2023 • 52

Alignment for Honesty

Paper • 2312.07000 • Published Dec 12, 2023 • 11

SparQ Attention: Bandwidth-Efficient LLM Inference

Paper • 2312.04985 • Published Dec 8, 2023 • 35

Schrodinger Bridges Beat Diffusion Models on Text-to-Speech Synthesis

Paper • 2312.03491 • Published Dec 6, 2023 • 34

Contrastive Chain-of-Thought Prompting

Paper • 2311.09277 • Published Nov 15, 2023 • 31

OneLLM: One Framework to Align All Modalities with Language

Paper • 2312.03700 • Published Dec 6, 2023 • 20

upvoted 2 papers 6 months ago

GAIA: a benchmark for General AI Assistants

Paper • 2311.12983 • Published Nov 21, 2023 • 171

Exponentially Faster Language Modelling

Paper • 2311.10770 • Published Nov 15, 2023 • 117

Sun Donghae

AI & ML interests

Organizations

NLPBada's activity