Update README.md
Browse files
README.md
CHANGED
@@ -50,25 +50,21 @@ TODO
|
|
50 |
|
51 |
**MultiModal Benchmark**
|
52 |
|
53 |
-
|
|
54 |
-
|
|
55 |
-
|
|
56 |
-
|
57 |
-
| model | MMMU<sub>val/test</sub> | CMMMU<sub>val/test</sub> | Tiny<sub>LVLM</sub> | LLaVA<sub>bench</sub> |
|
58 |
-
| --------------------------------------------------------------------------------- | ----------------------- | ------------------------ | ------------------- | --------------------- |
|
59 |
-
| [InternVL-Chat-V1.1](https://huggingface.co/OpenGVLab/InternVL-Chat-Chinese-V1.1) | 39.1 / 35.3 | | 344.5 | 76.3 |
|
60 |
|
61 |
**Visual Question Answering**
|
62 |
|
63 |
-
|
|
64 |
-
|
|
65 |
-
|
|
66 |
|
67 |
**Image Captioning**
|
68 |
|
69 |
-
|
|
70 |
-
|
|
71 |
-
|
|
72 |
|
73 |
|
74 |
## Citation
|
|
|
50 |
|
51 |
**MultiModal Benchmark**
|
52 |
|
53 |
+
| MME | MMB<sub>dev/test</sub> | MMB-CN<sub>dev/test</sub> | POPE | MMMU<sub>val/test</sub> | CMMMU<sub>val/test</sub> | Tiny<sub>LVLM</sub> | LLaVA<sub>bench</sub> |
|
54 |
+
| -------------- | ---------------------- | ------------------------- | ---- | ----------------------- | ------------------------ | ------------------- | --------------------- |
|
55 |
+
| 1672.3 / 341.1 | 76.6 / 75.4 | 71.5 / 70.1 | 87.2 | 39.1 / 35.3 | TODO | 344.5 | 76.3 |
|
|
|
|
|
|
|
|
|
56 |
|
57 |
**Visual Question Answering**
|
58 |
|
59 |
+
| VQAv2<sub>test</sub> | OKVQA<sub>val</sub> | TextVQA<sub>val</sub> | VizWiz<sub>val/test</sub> | AI2D<sub>test</sub> | GQA<sub>test</sub> | SQA<sub>test</sub> |
|
60 |
+
| -------------------- | ------------------- | --------------------- | ------------------------- | ------------------- | ------------------ | ------------------ |
|
61 |
+
| 80.9 | 64.2 | 65.8 | 58.3 / 57.3 | 70.23 | 62.4 | 91.2 |
|
62 |
|
63 |
**Image Captioning**
|
64 |
|
65 |
+
| COCO<sub>test</sub> | Flickr30K<sub>test</sub> | NoCaps<sub>val</sub> |
|
66 |
+
| ------------------- | ------------------------ | -------------------- |
|
67 |
+
| 141.8 | 84.3 | 120.4 |
|
68 |
|
69 |
|
70 |
## Citation
|