tttoaster commited on
Commit
4cc210d
1 Parent(s): f56497f

Upload 2 files

Browse files
Files changed (2) hide show
  1. file/result_v2.csv +1 -0
  2. file/result_v2_task.csv +1 -0
file/result_v2.csv CHANGED
@@ -28,3 +28,4 @@ Model,Language Model,Model Size,Evaluation Method,Avg. Single,Avg. Multi,Avg. Vi
28
  [Video-ChatGPT](https://github.com/mbzuai-oryx/Video-ChatGPT),LLaMA-7B,7B,PPL,38.3,49.8,31.6,36.9,33.7,0.0,44.1,37.0,35.8,30.7,44.2,31.1,29.9,49.9,39.8,49.7,40.6,22.0,33.2,37.2,22.4,25.0,46.1,61.4,42.6,32.2,27.0,19.0,37.5,24.5,0.0,0.0,0.0
29
  [Valley](https://github.com/RupertLuo/Valley),LLaMA-13B,13B,PPL,35.3,40.7,28.5,33.9,33.7,0.0,45.3,36.4,33.7,30.6,27.1,31.5,35.1,52.0,35.2,44.9,43.4,23.8,33.2,37.2,26.0,22.7,37.1,52.2,31.5,32.1,21.9,26.5,35.8,28.6,0.0,0.0,0.0
30
  VisionLLaMA,LLaMA-13B,13B,Generate,66.1,61.7,49.4,62.1,0.0,0.0,74.4,70.8,68.4,58.9,58.2,50.5,69.1,79.2,59.8,83.6,86.0,32.1,62.8,55.6,62.9,30.3,63.5,56.0,58.3,49.2,43.8,42.3,0.0,0.0,0.0,0.0,0.0
 
 
28
  [Video-ChatGPT](https://github.com/mbzuai-oryx/Video-ChatGPT),LLaMA-7B,7B,PPL,38.3,49.8,31.6,36.9,33.7,0.0,44.1,37.0,35.8,30.7,44.2,31.1,29.9,49.9,39.8,49.7,40.6,22.0,33.2,37.2,22.4,25.0,46.1,61.4,42.6,32.2,27.0,19.0,37.5,24.5,0.0,0.0,0.0
29
  [Valley](https://github.com/RupertLuo/Valley),LLaMA-13B,13B,PPL,35.3,40.7,28.5,33.9,33.7,0.0,45.3,36.4,33.7,30.6,27.1,31.5,35.1,52.0,35.2,44.9,43.4,23.8,33.2,37.2,26.0,22.7,37.1,52.2,31.5,32.1,21.9,26.5,35.8,28.6,0.0,0.0,0.0
30
  VisionLLaMA,LLaMA-13B,13B,Generate,66.1,61.7,49.4,62.1,0.0,0.0,74.4,70.8,68.4,58.9,58.2,50.5,69.1,79.2,59.8,83.6,86.0,32.1,62.8,55.6,62.9,30.3,63.5,56.0,58.3,49.2,43.8,42.3,0.0,0.0,0.0,0.0,0.0
31
+ MindAD,GPT,-,Generate,72.4,0,0,0,0,0,80,76.8,73.9,70.5,67.6,60.5,73.7,80.9,63.1,89.8,86.9,34.2,61.3,60.9,71,40.3,0,0,0,0,0,0,0,0,0,0,0
file/result_v2_task.csv CHANGED
@@ -28,3 +28,4 @@ Model,Language Model,Model Size,Evaluation Method,Avg. Single,Avg. Multi,Avg. Vi
28
  [Video-ChatGPT](https://github.com/mbzuai-oryx/Video-ChatGPT),LLaMA-7B,7B,PPL,35.8,53.8,30.2,36.4,31.0,0.0,44.1,37.0,35.8,30.7,44.2,31.1,29.9,49.9,39.8,49.7,40.6,22.0,33.2,37.2,22.4,25.0,46.1,61.4,42.6,32.2,27.0,19.0,37.5,24.5,0.0,0.0,0.0
29
  [Valley](https://github.com/RupertLuo/Valley),LLaMA-13B,13B,PPL,34.9,44.7,28.0,34.5,32.2,0.0,45.3,36.4,33.7,30.6,27.1,31.5,35.1,52.0,35.2,44.9,43.4,23.8,33.2,37.2,26.0,22.7,37.1,52.2,31.5,32.1,21.9,26.5,35.8,28.6,0.0,0.0,0.0
30
  VisionLLaMA,LLaMA-13B,13B,Generate,62.7,59.8,48.4,59.8,0.0,0.0,74.4,70.8,68.4,58.9,58.2,50.5,69.1,79.2,59.8,83.6,86.0,32.1,62.8,55.6,62.9,30.3,63.5,56.0,58.3,49.2,43.8,42.3,0.0,0.0,0.0,0.0,0.0
 
 
28
  [Video-ChatGPT](https://github.com/mbzuai-oryx/Video-ChatGPT),LLaMA-7B,7B,PPL,35.8,53.8,30.2,36.4,31.0,0.0,44.1,37.0,35.8,30.7,44.2,31.1,29.9,49.9,39.8,49.7,40.6,22.0,33.2,37.2,22.4,25.0,46.1,61.4,42.6,32.2,27.0,19.0,37.5,24.5,0.0,0.0,0.0
29
  [Valley](https://github.com/RupertLuo/Valley),LLaMA-13B,13B,PPL,34.9,44.7,28.0,34.5,32.2,0.0,45.3,36.4,33.7,30.6,27.1,31.5,35.1,52.0,35.2,44.9,43.4,23.8,33.2,37.2,26.0,22.7,37.1,52.2,31.5,32.1,21.9,26.5,35.8,28.6,0.0,0.0,0.0
30
  VisionLLaMA,LLaMA-13B,13B,Generate,62.7,59.8,48.4,59.8,0.0,0.0,74.4,70.8,68.4,58.9,58.2,50.5,69.1,79.2,59.8,83.6,86.0,32.1,62.8,55.6,62.9,30.3,63.5,56.0,58.3,49.2,43.8,42.3,0.0,0.0,0.0,0.0,0.0
31
+ MindAD,GPT,-,Generate,68.2,0,0,0,0,0,80,76.8,73.9,70.5,67.6,60.5,73.7,80.9,63.1,89.8,86.9,34.2,61.3,60.9,71,40.3,0,0,0,0,0,0,0,0,0,0,0