175 54 155

Victor Sanh PRO

VictorSanh

SanhEstPasMoi

VictorSanh

AI & ML interests

None yet

Articles

Introducing Idefics2: A Powerful 8B Vision-Language Model for the community

13 days ago

• 88

Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Dataset

Mar 15

• 2

Introducing IDEFICS: An Open Reproduction of State-of-the-art Visual Language Model

Aug 22, 2023

• 5

Organizations

VictorSanh's activity

upvoted an article 2 days ago

Article

Welcome Llama 3 - Meta's new open LLM

10 days ago

• 222

upvoted a collection 3 days ago

Zephyr ORPO

Collection

Models and datasets to align LLMs with Odds Ratio Preference Optimisation (ORPO). Recipes here: https://github.com/huggingface/alignment-handbook • 3 items • Updated 16 days ago • 12

upvoted 2 collections 4 days ago

Vision Language Models Papers 🖼️💬📝

Collection

Papers about vision-language models, most important ones are on top of the list. • 24 items • Updated 6 days ago • 20

LLM Leaderboard best models ❤️‍🔥

Collection

A daily uploaded list of models with best evaluations on the LLM leaderboard: • 63 items • Updated 2 days ago • 283

upvoted a collection 8 days ago

DistilBERT release

Collection

Original DistilBERT model, checkpoints obtained from using teacher-student learning from the original BERT checkpoints. • 6 items • Updated 10 days ago • 10

upvoted a collection 9 days ago

Meta Llama 3

Collection

This collection hosts the transformers and original repos of the Meta Llama 3 and Llama Guard 2 releases • 5 items • Updated 10 days ago • 422

upvoted a collection 11 days ago

🐶 IDEFICS 🐶

Collection

Collection assembling all the models and spaces related to IDEFICS • 6 items • Updated 13 days ago • 7

upvoted an article 12 days ago

Article

Introducing Idefics2: A Powerful 8B Vision-Language Model for the community

13 days ago

• 88

upvoted a collection 12 days ago

WizardLM

Collection

0 items • Updated 11 days ago • 89

upvoted a collection 13 days ago

Idefics2 🐶

Collection

Idefics2-8B is a foundation vision-language model. In this collection, you will find the models, datasets and demo related to its creation. • 8 items • Updated 10 days ago • 57

upvoted a paper 16 days ago

MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training

Paper • 2403.09611 • Published Mar 14 • 119

upvoted 3 papers about 1 month ago

Chart-based Reasoning: Transferring Capabilities from LLMs to VLMs

Paper • 2403.12596 • Published Mar 19 • 9

mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understanding

Paper • 2403.12895 • Published Mar 19 • 27

Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Dataset

Paper • 2403.09029 • Published Mar 14 • 51

upvoted a paper about 2 months ago

Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset

Paper • 2402.14804 • Published Feb 22 • 2

upvoted a collection about 2 months ago

From screenshots to HTML

Collection

WebSight is a dataset of 823,000 HTML/CSS codes representing synthetically generated English websites, each accompanied by a corresponding screenshot. • 4 items • Updated 13 days ago • 15

upvoted a paper about 2 months ago

Design2Code: How Far Are We From Automating Front-End Engineering?

Paper • 2403.03163 • Published Mar 5 • 92

upvoted a paper 2 months ago

CoLLaVO: Crayon Large Language and Vision mOdel

Paper • 2402.11248 • Published Feb 17 • 15

upvoted a paper 3 months ago

ViGoR: Improving Visual Grounding of Large Vision Language Models with Fine-Grained Reward Modeling

Paper • 2402.06118 • Published Feb 9 • 12

upvoted 2 collections 3 months ago

LLaVA-1.6

Collection

A collection of LLaVA-1.6 checkpoints • 4 items • Updated Jan 31 • 43

ZeroGPU Spaces

Collection

ZeroGPU Spaces made by the community • 13 items • Updated 28 days ago • 58

upvoted 2 papers 4 months ago

Gemini vs GPT-4V: A Preliminary Comparison and Combination of Vision-Language Models Through Qualitative Cases

Paper • 2312.15011 • Published Dec 22, 2023 • 15

G-LLaVA: Solving Geometric Problem with Multi-Modal Large Language Model

Paper • 2312.11370 • Published Dec 18, 2023 • 17

upvoted 6 papers 5 months ago

MegaBlocks: Efficient Sparse Training with Mixture-of-Experts

Paper • 2211.15841 • Published Nov 29, 2022 • 7

OneLLM: One Framework to Align All Modalities with Language

Paper • 2312.03700 • Published Dec 6, 2023 • 20

GAIA: a benchmark for General AI Assistants

Paper • 2311.12983 • Published Nov 21, 2023 • 170

Exponentially Faster Language Modelling

Paper • 2311.10770 • Published Nov 15, 2023 • 117

ShareGPT4V: Improving Large Multi-Modal Models with Better Captions

Paper • 2311.12793 • Published Nov 21, 2023 • 18

Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal Models

Paper • 2311.06607 • Published Nov 11, 2023 • 3

upvoted a paper 6 months ago

Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Models

Paper • 2311.06783 • Published Nov 12, 2023 • 25

upvoted a collection 6 months ago

Handbook v0.1 models and datasets

Collection

Models and datasets for v0.1 of the alignment handbook • 6 items • Updated Nov 10, 2023 • 20

upvoted 2 papers 6 months ago

Zephyr: Direct Distillation of LM Alignment

Paper • 2310.16944 • Published Oct 25, 2023 • 116

In-Context Pretraining: Language Modeling Beyond Document Boundaries

Paper • 2310.10638 • Published Oct 16, 2023 • 26

upvoted 2 collections 7 months ago

Text-to-Image Models 🥑

Collection

16 items • Updated Sep 19, 2023 • 2

Image-to-Text Models 📝

Collection

This collection contains image captioning and OCR models. • 15 items • Updated Sep 19, 2023 • 5

upvoted 6 papers 7 months ago

Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images

Paper • 2303.07274 • Published Mar 13, 2023 • 2

Vision Transformers Need Registers

Paper • 2309.16588 • Published Sep 28, 2023 • 69

Efficient Streaming Language Models with Attention Sinks

Paper • 2309.17453 • Published Sep 29, 2023 • 13

Effective Long-Context Scaling of Foundation Models

Paper • 2309.16039 • Published Sep 27, 2023 • 28

AnyMAL: An Efficient and Scalable Any-Modality Augmented Language Model

Paper • 2309.16058 • Published Sep 27, 2023 • 53

Emu: Enhancing Image Generation Models Using Photogenic Needles in a Haystack

Paper • 2309.15807 • Published Sep 27, 2023 • 30

upvoted a collection 7 months ago

Foundation Models for Vision 🧩

Collection

Foundation models for computer vision. • 24 items • Updated Mar 11 • 15

upvoted a paper 8 months ago

ImageBind-LLM: Multi-modality Instruction Tuning

Paper • 2309.03905 • Published Sep 7, 2023 • 15

upvoted 4 papers 9 months ago

OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Models

Paper • 2308.01390 • Published Aug 2, 2023 • 30

MMBench: Is Your Multi-modal Model an All-around Player?

Paper • 2307.06281 • Published Jul 12, 2023 • 2

Llama 2: Open Foundation and Fine-Tuned Chat Models

Paper • 2307.09288 • Published Jul 18, 2023 • 232

Retentive Network: A Successor to Transformer for Large Language Models

Paper • 2307.08621 • Published Jul 17, 2023 • 165

upvoted 6 papers 10 months ago

M^3IT: A Large-Scale Dataset towards Multi-Modal Multilingual Instruction Tuning

Paper • 2306.04387 • Published Jun 7, 2023 • 6

Flamingo: a Visual Language Model for Few-Shot Learning

Paper • 2204.14198 • Published Apr 29, 2022 • 13

Secrets of RLHF in Large Language Models Part I: PPO

Paper • 2307.04964 • Published Jul 11, 2023 • 26

BloombergGPT: A Large Language Model for Finance

Paper • 2303.17564 • Published Mar 30, 2023 • 15

What Matters in Training a GPT4-Style Language Model with Multimodal Inputs?

Paper • 2307.02469 • Published Jul 5, 2023 • 11

OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents

Paper • 2306.16527 • Published Jun 21, 2023 • 40

upvoted a paper 11 months ago

The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only

Paper • 2306.01116 • Published Jun 1, 2023 • 27

Victor Sanh PRO

AI & ML interests

Articles

Introducing Idefics2: A Powerful 8B Vision-Language Model for the community

Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Dataset

Introducing IDEFICS: An Open Reproduction of State-of-the-art Visual Language Model

What Makes a Dialog Agent Useful?

Putting ethical principles at the core of research lifecycle

Hugging Face Reads, Feb. 2021 - Long-range Transformers

Simple considerations for simple people building fancy neural networks

Organizations

VictorSanh's activity

Welcome Llama 3 - Meta's new open LLM

Introducing Idefics2: A Powerful 8B Vision-Language Model for the community