chenlin commited on
Commit
882b7ab
2 Parent(s): f0a18a0 c8af031

update readme

Browse files
Files changed (1) hide show
  1. README.md +47 -45
README.md CHANGED
@@ -1,45 +1,47 @@
1
- ---
2
- license: apache-2.0
3
- inference: false
4
- pipeline_tag: image-text-to-text
5
- ---
6
- <br>
7
- <br>
8
-
9
- # open-llava-next-vicuna-7b Model Card
10
-
11
- ## Model details
12
-
13
- **Model type:**
14
- open-llava-next-vicuna-7b is an open-source implementation chatbot trained by fine-tuning the entire model on open-source [Open-LLaVA-Next-mix1M](https://huggingface.co/datasets/Lin-Chen/Open-LLaVA-NeXT-mix1M) data.
15
-
16
- **Model date:**
17
- open-llava-next-vicuna-7b was trained in May 2024.
18
-
19
- **Paper or resources for more information:**
20
- [[Code](https://github.com/xiaoachen98/Open-LLaVA-NeXT)]
21
-
22
- | Name | LLM | Checkpoint | MME | SEED-image | SQA-image | MMBench | MMBench-CN | TextVQA | GQA |
23
- |---|---|---|---|---|---|---|---|---|---|
24
- | llava-next-vicuna-7b | Vicuna-7B | [HF](https://huggingface.co/liuhaotian/llava-v1.6-vicuna-7b) | 1519 | 70.2 | 70.1 | 67.4 | 60.6 | 64.9 | 64.2 |
25
- | open-llava-next-vicuna-7b | Vicuna-7B | [HF](https://huggingface.co/Lin-Chen/open-llava-next-vicuna-7b) | **1540** | **71.1** | **70.7** | **68.5** | **60.7** | **67.2** | **64.3** |
26
-
27
- ## Usage
28
-
29
- You can utilize this model as we provide in our [[repository](https://github.com/xiaoachen98/Open-LLaVA-NeXT)]. Moreover, you can direct load this model and use it in the [[LLaVA repository](https://github.com/haotian-liu/LLaVA)].
30
-
31
- ## Training dataset
32
-
33
- All training data are open-sourced in our [repository](https://github.com/xiaoachen98/Open-LLaVA-NeXT).
34
-
35
- - [ShareGPT4V Mix665K](https://huggingface.co/datasets/Lin-Chen/ShareGPT4V)
36
- - 200K GPT4V-generated instruction data (ALLaVA)
37
- - 200K various VQA data
38
-
39
- ## Intended use
40
-
41
- **Primary intended uses:**
42
- The primary use of open-llava-next-vicuna-7b is research on large multimodal models and chatbots.
43
-
44
- **Primary intended users:**
45
- The primary intended users of the model are researchers and hobbyists in computer vision, natural language processing, machine learning, and artificial intelligence.
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ inference: false
4
+ datasets:
5
+ - Lin-Chen/ShareGPT4V
6
+ pipeline_tag: image-text-to-text
7
+ ---
8
+ <br>
9
+ <br>
10
+
11
+ # open-llava-next-vicuna-7b Model Card
12
+
13
+ ## Model details
14
+
15
+ **Model type:**
16
+ open-llava-next-vicuna-7b is an open-source implementation chatbot trained by fine-tuning the entire model on open-source [Open-LLaVA-Next-mix1M](https://huggingface.co/datasets/Lin-Chen/Open-LLaVA-NeXT-mix1M) data.
17
+
18
+ **Model date:**
19
+ open-llava-next-vicuna-7b was trained in May 2024.
20
+
21
+ **Paper or resources for more information:**
22
+ [[Code](https://github.com/xiaoachen98/Open-LLaVA-NeXT)]
23
+
24
+ | Name | LLM | Checkpoint | MME | SEED-image | SQA-image | MMBench | MMBench-CN | TextVQA | GQA |
25
+ |---|---|---|---|---|---|---|---|---|---|
26
+ | llava-next-vicuna-7b | Vicuna-7B | [HF](https://huggingface.co/liuhaotian/llava-v1.6-vicuna-7b) | 1519 | 70.2 | 70.1 | 67.4 | 60.6 | 64.9 | 64.2 |
27
+ | open-llava-next-vicuna-7b | Vicuna-7B | [HF](https://huggingface.co/Lin-Chen/open-llava-next-vicuna-7b) | **1540** | **71.1** | **70.7** | **68.5** | **60.7** | **67.2** | **64.3** |
28
+
29
+ ## Usage
30
+
31
+ You can utilize this model as we provide in our [[repository](https://github.com/xiaoachen98/Open-LLaVA-NeXT)]. Moreover, you can direct load this model and use it in the [[LLaVA repository](https://github.com/haotian-liu/LLaVA)].
32
+
33
+ ## Training dataset
34
+
35
+ All training data are open-sourced in our [repository](https://github.com/xiaoachen98/Open-LLaVA-NeXT).
36
+
37
+ - [ShareGPT4V Mix665K](https://huggingface.co/datasets/Lin-Chen/ShareGPT4V)
38
+ - 200K GPT4V-generated instruction data (ALLaVA)
39
+ - 200K various VQA data
40
+
41
+ ## Intended use
42
+
43
+ **Primary intended uses:**
44
+ The primary use of open-llava-next-vicuna-7b is research on large multimodal models and chatbots.
45
+
46
+ **Primary intended users:**
47
+ The primary intended users of the model are researchers and hobbyists in computer vision, natural language processing, machine learning, and artificial intelligence.