Introducing Idefics2: A Powerful 8B Vision-Language Model for the community
•
109
Victor Sanh PRO
VictorSanh
AI & ML interests
None yet
Articles
Organizations
Posts
7
Post
1409
💬🔥Releasing idefics2-8b-chatty, the chat-optimized version of Idefics2!
It is a very efficient (8B parameters) state-of-the-art VLM, has been red-teamed, and comes with a few surprises:
- 📖Paper dissecting a lot of the experimental insights we learned building Idefics2:
- 🏎️TGI integration for blazing-fast inference (you can already run it locally with < 24GB GPU memory)
- 🏆 Ranking 2nd in its category (< 10B, open weights) in the awesome Open VLM Leaderboard, and now appearing in the incredible Vision Arena
Ressources:
⏯️Playground: HuggingFaceM4/idefics2_playground
📖Paper: What matters when building vision-language models? (2405.02246)
🏋️♂️Model and red-teaming analysis: HuggingFaceM4/idefics2-8b-chatty
👀Ressources to get started: HuggingFaceM4/idefics2-8b-chatty
🏆Open VLM Leaderboard: opencompass/open_vlm_leaderboard
🏟️Vision arena: WildVision/vision-arena
It is a very efficient (8B parameters) state-of-the-art VLM, has been red-teamed, and comes with a few surprises:
- 📖Paper dissecting a lot of the experimental insights we learned building Idefics2:
- 🏎️TGI integration for blazing-fast inference (you can already run it locally with < 24GB GPU memory)
- 🏆 Ranking 2nd in its category (< 10B, open weights) in the awesome Open VLM Leaderboard, and now appearing in the incredible Vision Arena
Ressources:
⏯️Playground: HuggingFaceM4/idefics2_playground
📖Paper: What matters when building vision-language models? (2405.02246)
🏋️♂️Model and red-teaming analysis: HuggingFaceM4/idefics2-8b-chatty
👀Ressources to get started: HuggingFaceM4/idefics2-8b-chatty
🏆Open VLM Leaderboard: opencompass/open_vlm_leaderboard
🏟️Vision arena: WildVision/vision-arena
Post
2048
Glad to see Idefics2 making its way into the awesome OpenVLM Leaderboard which ranks VLMs. 🏆
2nd in its category (<10B parameters and open weights)!
While InternLM-XComposer2 uses proprietary data, Idefics2 is built solely using openly available data.
Leaderboard: opencompass/open_vlm_leaderboard
Model: HuggingFaceM4/idefics2-8b
2nd in its category (<10B parameters and open weights)!
While InternLM-XComposer2 uses proprietary data, Idefics2 is built solely using openly available data.
Leaderboard: opencompass/open_vlm_leaderboard
Model: HuggingFaceM4/idefics2-8b
Collections
1
spaces
1
models
6
VictorSanh/test-victor
Updated
•
36
VictorSanh/idefics2-8b-docvqa-finetuned-tutorial
Updated
VictorSanh/vsft-idefics2-8b-hf
Updated
VictorSanh/idefics2-8b-docvqa-finetuned
Updated
VictorSanh/roberta-base-finetuned-yelp-polarity
Text Classification
•
Updated
•
89
•
2
VictorSanh/bart-base-finetuned-xsum
Text2Text Generation
•
Updated
•
4
datasets
8
VictorSanh/obelisc_20000_tr_199_w_xattn_opt_step-65000
Viewer
•
Updated
VictorSanh/LrvInstruction
Preview
•
Updated
•
12
•
6
VictorSanh/obelisc_850k_w_ldatopics_tr_199_w_xattn_opt_step-28000
Viewer
•
Updated
VictorSanh/obelisc_23k_w_ldatopics_tr_199_w_xattn_opt_step-28000
Viewer
•
Updated
VictorSanh/obelisc_23k_tr_190_01_64n_opt_step-34000
Viewer
•
Updated
VictorSanh/obelisc_23k_tr_199_w_xattn_opt_step-28000
Viewer
•
Updated
VictorSanh/obelisc_embedded_10k_v0
Updated
VictorSanh/dummy_test
Updated