taufiqdp (Taufiq Dwi Purnomo)

upvoted a paper about 16 hours ago

CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts

Paper • 2405.05949 • Published 1 day ago • 1

upvoted a paper 2 days ago

You Only Cache Once: Decoder-Decoder Architectures for Language Models

Paper • 2405.05254 • Published 3 days ago • 3

upvoted 2 papers 3 days ago

vAttention: Dynamic Memory Management for Serving LLMs without PagedAttention

Paper • 2405.04437 • Published 4 days ago • 2

xLSTM: Extended Long Short-Term Memory

Paper • 2405.04517 • Published 4 days ago • 5

upvoted a paper 4 days ago

Is Flash Attention Stable?

Paper • 2405.02803 • Published 6 days ago • 1

upvoted an article 5 days ago

Article

SeeMoE: Implementing a MoE Vision Language Model from Scratch

By

•

5 days ago

• 23

upvoted 2 papers 8 days ago

LoRA Land: 310 Fine-tuned LLMs that Rival GPT-4, A Technical Report

Paper • 2405.00732 • Published 12 days ago • 92

Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models

Paper • 2405.01535 • Published 9 days ago • 79

upvoted 2 papers 9 days ago

A Careful Examination of Large Language Model Performance on Grade School Arithmetic

Paper • 2405.00332 • Published 10 days ago • 22

Automatic Creative Selection with Cross-Modal Matching

Paper • 2405.00029 • Published Feb 28 • 7

upvoted 5 papers 10 days ago

upvoted 2 papers 11 days ago

BlenderAlchemy: Editing 3D Graphics with Vision-Language Models

Paper • 2404.17672 • Published 15 days ago • 17

Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models

Paper • 2404.18796 • Published 12 days ago • 61

upvoted an article 12 days ago

Article

⚗️ 🧑🏼‍🌾 Let's grow some Domain Specific Datasets together

By

•

12 days ago

• 25

upvoted a paper 12 days ago

AdvPrompter: Fast Adaptive Adversarial Prompting for LLMs

Paper • 2404.16873 • Published 19 days ago • 23

upvoted an article 14 days ago

Article

🦙⚗️ Using Llama3 and distilabel to build fine-tuning datasets

By

•

14 days ago

• 49

upvoted 2 papers 15 days ago

Layer Skip: Enabling Early Exit Inference and Self-Speculative Decoding

Paper • 2404.16710 • Published 16 days ago • 54

CatLIP: CLIP-level Visual Recognition Accuracy with 2.7x Faster Pre-training on Web-scale Image-Text Data

Paper • 2404.15653 • Published 17 days ago • 24

upvoted 2 articles 17 days ago

Article

seemore: Implement a Vision Language Model from Scratch

By

•

10 days ago

• 41

Article

Easy JAX training loops with Flax and Optax

By

•

Dec 3, 2023

• 2

upvoted a paper 17 days ago

Multi-Head Mixture-of-Experts

Paper • 2404.15045 • Published 18 days ago • 49

upvoted a collection 17 days ago

OpenELM Pretrained Models

Collection

4 items • Updated 17 days ago • 35

upvoted a paper 17 days ago

OpenELM: An Efficient Language Model Family with Open-source Training and Inference Framework

Paper • 2404.14619 • Published 18 days ago • 118

upvoted 3 papers 18 days ago

Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesis

Paper • 2404.13686 • Published 20 days ago • 25

The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions

Paper • 2404.13208 • Published 21 days ago • 37

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Paper • 2404.14219 • Published 19 days ago • 228

upvoted a paper 22 days ago

EdgeFusion: On-Device Text-to-Image Generation

Paper • 2404.11925 • Published 23 days ago • 19

upvoted an article 22 days ago

Article

Welcome Llama 3 - Meta's new open LLM

23 days ago

• 234

upvoted a paper 22 days ago

Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models

Paper • 2404.12387 • Published 23 days ago • 34

upvoted a paper 23 days ago

Long-form music generation with latent diffusion

Paper • 2404.10301 • Published 25 days ago • 22

upvoted a paper 25 days ago

Video2Game: Real-time, Interactive, Realistic and Browser-Compatible Environment from a Single Video

Paper • 2404.09833 • Published 26 days ago • 27

upvoted 2 papers 26 days ago

COCONut: Modernizing COCO Segmentation

Paper • 2404.08639 • Published 29 days ago • 25

Pre-training Small Base LMs with Fewer Tokens

Paper • 2404.08634 • Published 29 days ago • 32

upvoted a collection 28 days ago

[lecture artifacts] aligning open language models

Collection

artifacts referenced in the talk timeline! Slides: https://docs.google.com/presentation/d/1quMyI4BAx4rvcDfk8jjv063bmHg4RxZd9mhQloXpMn0/edit?usp=sharin • 63 items • Updated 23 days ago • 39

upvoted 4 papers 29 days ago

Rho-1: Not All Tokens Are What You Need

Paper • 2404.07965 • Published 30 days ago • 79

HGRN2: Gated Linear RNNs with State Expansion

Paper • 2404.07904 • Published 30 days ago • 16

RecurrentGemma: Moving Past Transformers for Efficient Open Language Models

Paper • 2404.07839 • Published 30 days ago • 36

Ferret-v2: An Improved Baseline for Referring and Grounding with Large Language Models

Paper • 2404.07973 • Published 30 days ago • 28

upvoted an article 29 days ago

Article

Mixture of Depth is Vibe

By

•

19 days ago

• 35

upvoted 17 papers about 1 month ago

RULER: What's the Real Context Size of Your Long-Context Language Models?

Paper • 2404.06654 • Published Apr 9 • 31

Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

Paper • 2404.07143 • Published about 1 month ago • 92

Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence

Paper • 2404.05892 • Published Apr 8 • 28

MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies

Paper • 2404.06395 • Published Apr 9 • 18

OmniFusion Technical Report

Paper • 2404.06212 • Published Apr 9 • 73

LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders

Paper • 2404.05961 • Published Apr 9 • 61

Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs

Paper • 2404.05719 • Published Apr 8 • 56

IndoCulture: Exploring Geographically-Influenced Cultural Commonsense Reasoning Across Eleven Indonesian Provinces

Paper • 2404.01854 • Published Apr 2 • 1

Direct Nash Optimization: Teaching Language Models to Self-Improve with General Preferences

Paper • 2404.03715 • Published Apr 4 • 57

Sailor: Open Language Models for South-East Asia

Paper • 2404.03608 • Published Apr 4 • 17

DoRA: Weight-Decomposed Low-Rank Adaptation

Paper • 2402.09353 • Published Feb 14 • 18

ReFT: Representation Finetuning for Language Models

Paper • 2404.03592 • Published Apr 4 • 70

Training LLMs over Neurally Compressed Text

Paper • 2404.03626 • Published Apr 4 • 21

Mixture-of-Depths: Dynamically allocating compute in transformer-based language models

Paper • 2404.02258 • Published Apr 2 • 99

ChatGLM-Math: Improving Math Problem-Solving in Large Language Models with a Self-Critique Pipeline

Paper • 2404.02893 • Published Apr 3 • 19

Octopus v2: On-device language model for super agent

Paper • 2404.01744 • Published Apr 2 • 52

Poro 34B and the Blessing of Multilinguality

Paper • 2404.01856 • Published Apr 2 • 12

Taufiq Dwi Purnomo

AI & ML interests

Organizations

taufiqdp's activity

SeeMoE: Implementing a MoE Vision Language Model from Scratch

⚗️ 🧑🏼‍🌾 Let's grow some Domain Specific Datasets together

🦙⚗️ Using Llama3 and distilabel to build fine-tuning datasets

seemore: Implement a Vision Language Model from Scratch

Easy JAX training loops with Flax and Optax

Welcome Llama 3 - Meta's new open LLM

Mixture of Depth is Vibe