toshi456 commited on
Commit
d9093c4
1 Parent(s): 23a3e06

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -0
README.md CHANGED
@@ -28,6 +28,18 @@ In the second phase, it was fine-tuned with LLaVA-v1.5-Instruct-620K-JA.
28
 
29
  resources for more information: https://github.com/tosiyuki/LLaVA-JP/tree/main
30
 
 
 
 
 
 
 
 
 
 
 
 
 
31
  ## How to use the model
32
  **1. Download dependencies**
33
  ```
 
28
 
29
  resources for more information: https://github.com/tosiyuki/LLaVA-JP/tree/main
30
 
31
+ **Comparing VLMs**
32
+ |Model|JA-VG-VQA-500<br>(ROUGE-L)|JA-VLM-Bench-In-the-Wild<br>(ROUGE-L)|Heron-Bench(Detail)|Heron-Bench(Conv)|Heron-Bench(Complex)|Heron-Bench(Average)
33
+ |-|-|-|-|-|-|-|
34
+ |[Japanese Stable VLM](https://huggingface.co/stabilityai/japanese-stable-vlm)|-|40.50|25.15|51.23|37.84|38.07|
35
+ |[EvoVLM-JP-v1-7B](https://huggingface.co/SakanaAI/EvoVLM-JP-v1-7B)|19.70|51.25|50.31|44.42|40.47|45.07|
36
+ |[Heron BLIP Japanese StableLM Base 7B llava-620k](https://huggingface.co/turing-motors/heron-chat-blip-ja-stablelm-base-7b-v1-llava-620k)|14.51|33.26|49.09|41.51|45.72|45.44|
37
+ |[Heron GIT Japanese StableLM Base 7B](https://huggingface.co/turing-motors/heron-chat-git-ja-stablelm-base-7b-v1)|15.18|37.82|42.77|54.20|43.53|46.83|
38
+ |[llava-jp-1.3b-v1.0-620k](https://huggingface.co/toshi456/llava-jp-1.3b-v1.0-620k)|12.69|44.58|51.21|41.05|45.95|44.84|
39
+ |[llava-jp-1.3b-v1.1](https://huggingface.co/toshi456/llava-jp-1.3b-v1.1)|13.33|44.40|50.00|51.83|48.98|**50.39**|
40
+
41
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/630af71ffaaea618ebc973db/rnzCN-LFpK4iDL5RZ9oyI.png)
42
+
43
  ## How to use the model
44
  **1. Download dependencies**
45
  ```