Model: lmms-lab/LLaVA-Video-7B-Qwen2
Author: lmms-lab
Pipeline: video-text-to-text
Library: transformers
Tags: transformers, safetensors, llava, text-generation, multimodal, video-text-to-text, en, dataset:lmms-lab/LLaVA-OneVision-Data, dataset:lmms-lab/LLaVA-Video-178K, arxiv:2410.02713, base_model:lmms-lab/llava-onevision-qwen2-7b-si, base_model:finetune:lmms-lab/llava-onevision-qwen2-7b-si, license:apache-2.0, model-index, autotrain_compatible, endpoints_compatible, region:us
Base models (finetune): id: lmms-lab/llava-onevision-qwen2-7b-si
Card metadata: datasets: lmms-lab/LLaVA-OneVision-Data, lmms-lab/LLaVA-Video-178K
language: en
library_name: transformers
license: apache-2.0
metrics: accuracy
tags: multimodal
pipeline_tag: video-text-to-text
model-index: name: LLaVA-Video-7B-Qwen2
results: task: type: multimodal
dataset: name: ActNet-QA
type: actnet-qa
metrics: type: accuracy
value: 56.5
name: accuracy
verified: no, task: type: multimodal
dataset: name: EgoSchema
type: egoschema
metrics: type: accuracy
value: 57.3
name: accuracy
verified: no, task: type: multimodal
dataset: name: MLVU
type: mlvu
metrics: type: accuracy
value: 70.8
name: accuracy
verified: no, task: type: multimodal
dataset: name: MVBench
type: mvbench
metrics: type: accuracy
value: 58.6
name: accuracy
verified: no, task: type: multimodal
dataset: name: NextQA
type: nextqa
metrics: type: accuracy
value: 83.2
name: accuracy
verified: no, task: type: multimodal
dataset: name: PercepTest
type: percepTest
metrics: type: accuracy
value: 67.9
name: accuracy
verified: no, task: type: multimodal
dataset: name: VideoChatGPT
type: videochatgpt
metrics: type: score
value: 3.52
name: score
verified: no, task: type: multimodal
dataset: name: VideoDC
type: videodc
metrics: type: score
value: 3.66
name: score
verified: no, task: type: multimodal
dataset: name: LongVideoBench
type: longvideobench
metrics: type: accuracy
value: 58.2
name: accuracy
verified: no, task: type: multimodal
dataset: name: VideoMME
type: videomme
metrics: type: accuracy
value: 63.3
name: accuracy
verified: no
base_model: lmms-lab/llava-onevision-qwen2-7b-si
Likes: 121 | All-time downloads: 1065777
Created: 2024-09-02 06:36:42