AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling
Paper
•
2402.12226
•
Published
•
37
Models - Multimodal
-
-
M2-CLIP: A Multimodal, Multi-task Adapting Framework for Video Action Recognition
Paper • 2401.11649 • Published • 3 -
Gen4Gen: Generative Data Pipeline for Generative Multi-Concept Composition
Paper • 2402.15504 • Published • 19 -
EMO: Emote Portrait Alive - Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditions
Paper • 2402.17485 • Published • 182 -
OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Web
Paper • 2402.17553 • Published • 21 -
Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning
Paper • 2309.02591 • Published • 12 -
ChatMusician: Understanding and Generating Music Intrinsically with LLM
Paper • 2402.16153 • Published • 53 -
Valley: Video Assistant with Large Language model Enhanced abilitY
Paper • 2306.07207 • Published • 2 -
LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Model
Paper • 2304.15010 • Published • 3 -
Otter: A Multi-Modal Model with In-Context Instruction Tuning
Paper • 2305.03726 • Published • 5 -
DeepSeek-VL: Towards Real-World Vision-Language Understanding
Paper • 2403.05525 • Published • 36 -
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
Paper • 2403.05530 • Published • 49 -
EVE: Efficient Vision-Language Pre-training with Masked Prediction and Modality-Aware MoE
Paper • 2308.11971 • Published • 2 -
Qwen/Qwen-VL-Chat
Text Generation • Updated • 90.3k • 241 -
google/siglip-so400m-patch14-384
Zero-Shot Image Classification • Updated • 150k • 61