czczup commited on
Commit
fc807c9
·
verified ·
1 Parent(s): 9a9ef7c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -19
README.md CHANGED
@@ -11,10 +11,6 @@ language:
11
  - multilingual
12
  tags:
13
  - internvl
14
- - vision
15
- - ocr
16
- - multi-image
17
- - video
18
  - custom_code
19
  ---
20
 
@@ -81,8 +77,6 @@ InternVL 2.0 is a multimodal large language model series, featuring models of va
81
 
82
  - We simultaneously use [InternVL](https://github.com/OpenGVLab/InternVL) and [VLMEvalKit](https://github.com/open-compass/VLMEvalKit) repositories for model evaluation. Specifically, the results reported for DocVQA, ChartQA, InfoVQA, TextVQA, MME, AI2D, MMBench, CCBench, MMVet (GPT-4-0613), and SEED-Image were tested using the InternVL repository. MMMU, OCRBench, RealWorldQA, HallBench, MMVet (GPT-4-Turbo), and MathVista were evaluated using the VLMEvalKit.
83
 
84
- - Please note that evaluating the same model using different testing toolkits like [InternVL](https://github.com/OpenGVLab/InternVL) and [VLMEvalKit](https://github.com/open-compass/VLMEvalKit) can result in slight differences, which is normal. Updates to code versions and variations in environment and hardware can also cause minor discrepancies in results.
85
-
86
  ### Video Benchmarks
87
 
88
  | Benchmark | GPT-4V | VILA-1.5 | LLaVA-NeXT-Video | InternVL2-26B | InternVL2-40B |
@@ -119,16 +113,10 @@ InternVL 2.0 is a multimodal large language model series, featuring models of va
119
 
120
  Limitations: Although we have made efforts to ensure the safety of the model during the training process and to encourage the model to generate text that complies with ethical and legal requirements, the model may still produce unexpected outputs due to its size and probabilistic generation paradigm. For example, the generated responses may contain biases, discrimination, or other harmful content. Please do not propagate such content. We are not responsible for any consequences resulting from the dissemination of harmful information.
121
 
122
- ### Invitation to Evaluate InternVL
123
-
124
- We welcome MLLM benchmark developers to assess our InternVL1.5 and InternVL2 series models. If you need to add your evaluation results here, please contact me at [wztxy89@163.com](mailto:wztxy89@163.com).
125
-
126
  ## Quick Start
127
 
128
  We provide an example code to run InternVL2-40B using `transformers`.
129
 
130
- We also welcome you to experience the InternVL2 series models in our [online demo](https://internvl.opengvlab.com/).
131
-
132
  > Please use transformers>=4.37.2 to ensure the model works normally.
133
 
134
  ### Model Loading
@@ -629,7 +617,7 @@ print(response)
629
 
630
  ## License
631
 
632
- This project is released under the MIT license, while InternLM2 is licensed under the Apache-2.0 license.
633
 
634
  ## Citation
635
 
@@ -642,16 +630,16 @@ If you find this project useful in your research, please consider citing:
642
  journal={arXiv preprint arXiv:2410.16261},
643
  year={2024}
644
  }
645
- @article{chen2023internvl,
646
- title={InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks},
647
- author={Chen, Zhe and Wu, Jiannan and Wang, Wenhai and Su, Weijie and Chen, Guo and Xing, Sen and Zhong, Muyan and Zhang, Qinglong and Zhu, Xizhou and Lu, Lewei and Li, Bin and Luo, Ping and Lu, Tong and Qiao, Yu and Dai, Jifeng},
648
- journal={arXiv preprint arXiv:2312.14238},
649
- year={2023}
650
- }
651
  @article{chen2024far,
652
  title={How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suites},
653
  author={Chen, Zhe and Wang, Weiyun and Tian, Hao and Ye, Shenglong and Gao, Zhangwei and Cui, Erfei and Tong, Wenwen and Hu, Kongzhi and Luo, Jiapeng and Ma, Zheng and others},
654
  journal={arXiv preprint arXiv:2404.16821},
655
  year={2024}
656
  }
 
 
 
 
 
 
657
  ```
 
11
  - multilingual
12
  tags:
13
  - internvl
 
 
 
 
14
  - custom_code
15
  ---
16
 
 
77
 
78
  - We simultaneously use [InternVL](https://github.com/OpenGVLab/InternVL) and [VLMEvalKit](https://github.com/open-compass/VLMEvalKit) repositories for model evaluation. Specifically, the results reported for DocVQA, ChartQA, InfoVQA, TextVQA, MME, AI2D, MMBench, CCBench, MMVet (GPT-4-0613), and SEED-Image were tested using the InternVL repository. MMMU, OCRBench, RealWorldQA, HallBench, MMVet (GPT-4-Turbo), and MathVista were evaluated using the VLMEvalKit.
79
 
 
 
80
  ### Video Benchmarks
81
 
82
  | Benchmark | GPT-4V | VILA-1.5 | LLaVA-NeXT-Video | InternVL2-26B | InternVL2-40B |
 
113
 
114
  Limitations: Although we have made efforts to ensure the safety of the model during the training process and to encourage the model to generate text that complies with ethical and legal requirements, the model may still produce unexpected outputs due to its size and probabilistic generation paradigm. For example, the generated responses may contain biases, discrimination, or other harmful content. Please do not propagate such content. We are not responsible for any consequences resulting from the dissemination of harmful information.
115
 
 
 
 
 
116
  ## Quick Start
117
 
118
  We provide an example code to run InternVL2-40B using `transformers`.
119
 
 
 
120
  > Please use transformers>=4.37.2 to ensure the model works normally.
121
 
122
  ### Model Loading
 
617
 
618
  ## License
619
 
620
+ This project is released under the MIT License. This project uses the pre-trained Nous-Hermes-2-Yi-34B as a component, which is licensed under the Apache License 2.0.
621
 
622
  ## Citation
623
 
 
630
  journal={arXiv preprint arXiv:2410.16261},
631
  year={2024}
632
  }
 
 
 
 
 
 
633
  @article{chen2024far,
634
  title={How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suites},
635
  author={Chen, Zhe and Wang, Weiyun and Tian, Hao and Ye, Shenglong and Gao, Zhangwei and Cui, Erfei and Tong, Wenwen and Hu, Kongzhi and Luo, Jiapeng and Ma, Zheng and others},
636
  journal={arXiv preprint arXiv:2404.16821},
637
  year={2024}
638
  }
639
+ @article{chen2023internvl,
640
+ title={InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks},
641
+ author={Chen, Zhe and Wu, Jiannan and Wang, Wenhai and Su, Weijie and Chen, Guo and Xing, Sen and Zhong, Muyan and Zhang, Qinglong and Zhu, Xizhou and Lu, Lewei and Li, Bin and Luo, Ping and Lu, Tong and Qiao, Yu and Dai, Jifeng},
642
+ journal={arXiv preprint arXiv:2312.14238},
643
+ year={2023}
644
+ }
645
  ```