weiwu-ww commited on
Commit
2b87dd0
·
verified ·
1 Parent(s): 9f1a679

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +65 -3
README.md CHANGED
@@ -1,3 +1,65 @@
1
- ---
2
- license: cc-by-4.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-4.0
3
+ ---
4
+
5
+ # Model Card for LoTLIP ViT-B/32
6
+
7
+ ## Model Details
8
+
9
+ ### Model Description
10
+
11
+ LoTLIP ViT-B/32 model pre-trained on 100M scale dataset.
12
+
13
+
14
+
15
+ ### Direct Use
16
+
17
+ Zero-shot long text-image retrieval, short text-image retrieval, and image classification, among others.
18
+
19
+
20
+ ## How to Get Started with the Model
21
+
22
+ Use the [code](https://github.com/wuw2019/LoTLIP) to get started with the model.
23
+
24
+
25
+ ## Training Details
26
+
27
+ ### Training Data
28
+
29
+ The models are trained with 100M scale dataset which contains long text-image pairs.
30
+
31
+
32
+ ## Evaluation
33
+
34
+ Please refer to https://github.com/wuw2019/LoTLIP.
35
+
36
+ ### Testing Details
37
+
38
+ #### Testing Data
39
+
40
+ The testing is performed with [DCI](https://github.com/facebookresearch/DCI), [IIW](https://github.com/google/imageinwords/) and [ShareGPT4V](https://sharegpt4v.github.io/) for long text-image retrieval and ImageNet1k for classification.
41
+
42
+
43
+ ### Results
44
+
45
+ | Model |Pre-training Data Scale | DCI I2T | DCI T2I| IIW I2T |IIW T2I| SV-10k I2T | SV-10k T2I |
46
+ | :----: | :----: | :----: | :----: | :----: | :----: | :----: | :----: |
47
+ | LoTLIP-ViT-B-32 | 100M | 59.90 | 56.36 | 93.14| 91.83 | 83.76 | 78.97|
48
+
49
+
50
+
51
+
52
+
53
+ ## Citation
54
+
55
+
56
+ BibTeX:
57
+
58
+ ```bibtex
59
+ @inproceedings{LoTLIP,
60
+ title={LoTLIP: Improving Language-Image Pre-training for Long Text Understanding},
61
+ author={Wu, Wei and Zheng, Kecheng and Ma, Shuailei and Lu, Fan and Guo, Yuxin and Zhang, Yifei and Chen, Wei and Guo, Qingpei and Shen, Yujun and Zheng-Jun, Zha},
62
+ booktitle={arXiv},
63
+ year={2024}
64
+ }
65
+ ```