promptam (Vincent)

upvoted a paper 8 days ago

Xmodel-VLM: A Simple Baseline for Multimodal Vision Language Model

Paper • 2405.09215 • Published 9 days ago • 14

upvoted 2 collections 9 days ago

Searching for Better ViT Baselines

Collection

Exploring ViT hparams and model shapes for the GPU poor (between tiny and base). • 17 items • Updated 3 days ago • 8

SFR-Instruct-LLaMA-3-8B-R

Collection

3 items • Updated 10 days ago • 13

upvoted a paper 10 days ago

Plot2Code: A Comprehensive Benchmark for Evaluating Multi-modal Large Language Models in Code Generation from Scientific Plots

Paper • 2405.07990 • Published 10 days ago • 15

upvoted a collection 11 days ago

Yi-1.5 (2024/05)

Collection

10 items • Updated 4 days ago • 70

upvoted a collection 13 days ago

Neo-Models

Collection

Neo • 7 items • Updated 15 days ago • 5

upvoted a paper 17 days ago

What matters when building vision-language models?

Paper • 2405.02246 • Published 20 days ago • 85

upvoted a collection 17 days ago

Granite Code Models

Collection

A series of code models trained by IBM licensed under Apache 2.0 license. We release both the base pretrained and instruct models. • 14 items • Updated 1 day ago • 126

upvoted a paper 20 days ago

WildChat: 1M ChatGPT Interaction Logs in the Wild

Paper • 2405.01470 • Published 21 days ago • 53

upvoted a paper 21 days ago

LoRA Land: 310 Fine-tuned LLMs that Rival GPT-4, A Technical Report

Paper • 2405.00732 • Published 25 days ago • 111

upvoted an article 23 days ago

Article

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

25 days ago

• 69

upvoted a paper 27 days ago

Insights into Alignment: Evaluating DPO and its Variants Across Multiple Tasks

Paper • 2404.14723 • Published about 1 month ago • 9

upvoted 2 papers about 1 month ago

A Multimodal Automated Interpretability Agent

Paper • 2404.14394 • Published Apr 22 • 19

The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions

Paper • 2404.13208 • Published Apr 19 • 37

upvoted 2 articles about 1 month ago

Article

seemore: Implement a Vision Language Model from Scratch

By

•

11 days ago

• 41

Article

Jack of All Trades, Master of Some, a Multi-Purpose Transformer Agent

Apr 22

• 71

upvoted 3 papers about 1 month ago

Groma: Localized Visual Tokenization for Grounding Multimodal Large Language Models

Paper • 2404.13013 • Published Apr 19 • 26

TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding

Paper • 2404.11912 • Published Apr 18 • 16

Video2Game: Real-time, Interactive, Realistic and Browser-Compatible Environment from a Single Video

Paper • 2404.09833 • Published Apr 15 • 27

upvoted 2 collections about 1 month ago

Idefics2 🐶

Collection

Idefics2-8B is a foundation vision-language model. In this collection, you will find the models, datasets and demo related to its creation. • 11 items • Updated 17 days ago • 81

WizardLM

Collection

0 items • Updated 15 days ago • 97

upvoted 3 papers about 1 month ago

OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

Paper • 2404.07972 • Published Apr 11 • 41

MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding

Paper • 2404.05726 • Published Apr 8 • 18

Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs

Paper • 2404.05719 • Published Apr 8 • 57

upvoted 2 papers about 2 months ago

MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training

Paper • 2403.09611 • Published Mar 14 • 119

LLaVA-Gemma: Accelerating Multimodal Foundation Models with a Compact Language Model

Paper • 2404.01331 • Published Mar 29 • 22

upvoted 2 collections about 2 months ago

Aurora-M models

Collection

Aurora-M models (base, biden-harris redteams and instruct) • 5 items • Updated 18 days ago • 15

PDF Document / OCR Datasets

Collection

Document datasets with .pdf files that are usable with pixparse libraries and tools. • 2 items • Updated Mar 30 • 36

upvoted a paper about 2 months ago

Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models

Paper • 2403.20331 • Published Mar 29 • 14

upvoted a collection about 2 months ago

MGM

Collection

Official model collection for the paper "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models" • 13 items • Updated 21 days ago • 43

upvoted 2 papers 2 months ago

GiT: Towards Generalist Vision Transformer through Universal Language Interface

Paper • 2403.09394 • Published Mar 14 • 25

Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understanding

Paper • 2403.09626 • Published Mar 14 • 11

upvoted 2 papers 3 months ago

BeTAIL: Behavior Transformer Adversarial Imitation Learning from Human Racing Gameplay

Paper • 2402.14194 • Published Feb 22 • 4

AgentScope: A Flexible yet Robust Multi-Agent Platform

Paper • 2402.14034 • Published Feb 21 • 12

Vincent

AI & ML interests

Organizations

promptam's activity

Xmodel-VLM: A Simple Baseline for Multimodal Vision Language Model

Searching for Better ViT Baselines

SFR-Instruct-LLaMA-3-8B-R

Plot2Code: A Comprehensive Benchmark for Evaluating Multi-modal Large Language Models in Code Generation from Scientific Plots

Yi-1.5 (2024/05)

Neo-Models

What matters when building vision-language models?

Granite Code Models

WildChat: 1M ChatGPT Interaction Logs in the Wild

LoRA Land: 310 Fine-tuned LLMs that Rival GPT-4, A Technical Report

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

Insights into Alignment: Evaluating DPO and its Variants Across Multiple Tasks

A Multimodal Automated Interpretability Agent

The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions

seemore: Implement a Vision Language Model from Scratch

Jack of All Trades, Master of Some, a Multi-Purpose Transformer Agent

Groma: Localized Visual Tokenization for Grounding Multimodal Large Language Models

TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding

Video2Game: Real-time, Interactive, Realistic and Browser-Compatible Environment from a Single Video

Idefics2 🐶

WizardLM

OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding

Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs

MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training

LLaVA-Gemma: Accelerating Multimodal Foundation Models with a Compact Language Model

Aurora-M models

PDF Document / OCR Datasets

Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models

MGM

GiT: Towards Generalist Vision Transformer through Universal Language Interface

Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understanding

BeTAIL: Behavior Transformer Adversarial Imitation Learning from Human Racing Gameplay

AgentScope: A Flexible yet Robust Multi-Agent Platform