Collections

9

DocLLM: A layout-aware generative language model for multimodal document understanding

Paper • 2401.00908 • Published Dec 31, 2023 • 181
COSMO: COntrastive Streamlined MultimOdal Model with Interleaved Pre-Training

Paper • 2401.00849 • Published Jan 1, 2024 • 16
LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agents

Paper • 2311.05437 • Published Nov 9, 2023 • 48
LLaVA-Interactive: An All-in-One Demo for Image Chat, Segmentation, Generation and Editing

Paper • 2311.00571 • Published Nov 1, 2023 • 41

DocLLM: A layout-aware generative language model for multimodal document understanding

COSMO: COntrastive Streamlined MultimOdal Model with Interleaved Pre-Training

LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agents

LLaVA-Interactive: An All-in-One Demo for Image Chat, Segmentation, Generation and Editing

LongVILA: Scaling Long-Context Visual Language Models for Long Videos

xGen-MM (BLIP-3): A Family of Open Large Multimodal Models

Building and better understanding vision-language models: insights and future directions

Show-o: One Single Transformer to Unify Multimodal Understanding and Generation

LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs

LongVILA: Scaling Long-Context Visual Language Models for Long Videos

Dolphin: Long Context as a New Modality for Energy-Efficient On-Device Language Models

INT-FP-QSim: Mixed Precision and Formats For Large Language Models and Vision Transformers

Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters

Arcee's MergeKit: A Toolkit for Merging Large Language Models

LongVILA: Scaling Long-Context Visual Language Models for Long Videos

Goldfish: Vision-Language Understanding of Arbitrarily Long Videos

SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Models

LongVILA: Scaling Long-Context Visual Language Models for Long Videos

Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMs

Understanding Alignment in Multimodal LLMs: A Comprehensive Study

LongVILA: Scaling Long-Context Visual Language Models for Long Videos

Building and better understanding vision-language models: insights and future directions

RLHF Workflow: From Reward Modeling to Online RLHF

Chameleon: Mixed-Modal Early-Fusion Foundation Models

Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Models

An Introduction to Vision-Language Modeling

iVideoGPT: Interactive VideoGPTs are Scalable World Models

Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Models

An Introduction to Vision-Language Modeling

Matryoshka Multimodal Models

BLINK: Multimodal Large Language Models Can See but Not Perceive

TextSquare: Scaling up Text-Centric Visual Instruction Tuning

Groma: Localized Visual Tokenization for Grounding Multimodal Large Language Models

InternLM-XComposer2-4KHD: A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HD

MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs

Rainbow Teaming: Open-Ended Generation of Diverse Adversarial Prompts

FuseChat: Knowledge Fusion of Chat Models

Multi-LoRA Composition for Image Generation