1 7

Zhe Gan

zhegan27

http://zhegan27.github.io/

zhegan27

AI & ML interests

multimodal learning, vision and language

Recent Activity

upvoted a paper 16 days ago

STIV: Scalable Text and Image Conditioned Video Generation

authored a paper about 1 month ago

Multimodal Autoregressive Pre-training of Large Vision Encoders

View all activity

Organizations

None yet

zhegan27's activity

upvoted a paper 16 days ago

STIV: Scalable Text and Image Conditioned Video Generation

Paper • 2412.07730 • Published 17 days ago • 69

authored a paper about 1 month ago

Multimodal Autoregressive Pre-training of Large Vision Encoders

Paper • 2411.14402 • Published Nov 21 • 43

upvoted a paper 2 months ago

Improve Vision Language Model Chain-of-thought Reasoning

Paper • 2410.16198 • Published Oct 21 • 22

authored a paper 3 months ago

MM-Ego: Towards Building Egocentric Multimodal LLMs

Paper • 2410.07177 • Published Oct 9 • 21

upvoted 2 papers 3 months ago

Revisit Large-Scale Image-Caption Data in Pre-training Multimodal Foundation Models

Paper • 2410.02740 • Published Oct 3 • 52

Contrastive Localized Language-Image Pre-Training

Paper • 2410.02746 • Published Oct 3 • 33

authored a paper 3 months ago

MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuning

Paper • 2409.20566 • Published Sep 30 • 53

upvoted a paper 3 months ago

MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuning

Paper • 2409.20566 • Published Sep 30 • 53

authored a paper 5 months ago

SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Models

Paper • 2407.15841 • Published Jul 22 • 40

upvoted a paper 6 months ago

Understanding Alignment in Multimodal LLMs: A Comprehensive Study

Paper • 2407.02477 • Published Jul 2 • 21

authored a paper 6 months ago

Understanding Alignment in Multimodal LLMs: A Comprehensive Study

Paper • 2407.02477 • Published Jul 2 • 21

authored a paper 8 months ago

Ferret-v2: An Improved Baseline for Referring and Grounding with Large Language Models

Paper • 2404.07973 • Published Apr 11 • 30

upvoted a paper 9 months ago

Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs

Paper • 2404.05719 • Published Apr 8 • 82

authored a paper 10 months ago

How Easy is It to Fool Your Multimodal LLMs? An Empirical Analysis on Deceptive Prompts

Paper • 2402.13220 • Published Feb 20 • 13

authored a paper over 1 year ago

Multimodal Foundation Models: From Specialists to General-Purpose Assistants

Paper • 2309.10020 • Published Sep 18, 2023 • 40