Update README.md
Browse files
README.md
CHANGED
@@ -16,18 +16,9 @@ In the v1.5 (08/2024) release, we present a series of XGen-MM models including:
|
|
16 |
- [π€ xGen-MM-instruct](https://huggingface.co/Salesforce/xgen-mm-phi3-mini-instruct-singleimg-r-v1.5): `xgen-mm-phi3-mini-instruct-singleimg-r-v1.5`
|
17 |
- [π€ xGen-MM-instruct-dpo](https://huggingface.co/Salesforce/xgen-mm-phi3-mini-instruct-dpo-r-v1.5): `xgen-mm-phi3-mini-instruct-dpo-r-v1.5`
|
18 |
|
19 |
-
<! --In addition to the models, our team also released a series of datasets for multi-modal pre-training, including:
|
20 |
-
- [π MINT-1T: Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens](https://arxiv.org/abs/2406.11271)
|
21 |
-
- [π€ BLIP3-OCR-200M](https://huggingface.co/datasets/Salesforce/blip3-ocr-200m): a dataset with dense OCR annotations.
|
22 |
-
- [π€ BLIP3-GROUNDING-50M](https://huggingface.co/datasets/Salesforce/blip3-grounding-50m): a dataset for enhancing the ability to ground semantic concepts in images.
|
23 |
-
- BLIP3-KALE (stay tuned): a large-scale curated high-quality caption dataset.
|
24 |
-
|
25 |
For more details, check out our [tech report](https://arxiv.org/pdf/2408.08872), [fine-tuning code](https://github.com/salesforce/LAVIS/tree/xgen-mm), and [project page](https://www.salesforceairesearch.com/opensource/xGen-MM/index.html).
|
26 |
|
27 |
|
28 |
-
# Data
|
29 |
-
The instruct model is fine-tuned on a mixture of around 1 million samples from multiple domains. All the fine-tuning data are from public sources, most of which are covered in [The Cauldron](https://huggingface.co/datasets/HuggingFaceM4/the_cauldron).
|
30 |
-
-->
|
31 |
# Results
|
32 |
|
33 |
### Single-image benchmarks
|
|
|
16 |
- [π€ xGen-MM-instruct](https://huggingface.co/Salesforce/xgen-mm-phi3-mini-instruct-singleimg-r-v1.5): `xgen-mm-phi3-mini-instruct-singleimg-r-v1.5`
|
17 |
- [π€ xGen-MM-instruct-dpo](https://huggingface.co/Salesforce/xgen-mm-phi3-mini-instruct-dpo-r-v1.5): `xgen-mm-phi3-mini-instruct-dpo-r-v1.5`
|
18 |
|
|
|
|
|
|
|
|
|
|
|
|
|
19 |
For more details, check out our [tech report](https://arxiv.org/pdf/2408.08872), [fine-tuning code](https://github.com/salesforce/LAVIS/tree/xgen-mm), and [project page](https://www.salesforceairesearch.com/opensource/xGen-MM/index.html).
|
20 |
|
21 |
|
|
|
|
|
|
|
22 |
# Results
|
23 |
|
24 |
### Single-image benchmarks
|