Model: Inst-IT/LLaVA-Next-Inst-It-Vicuna-7B
Author: Inst-IT
Pipeline: video-text-to-text
Tags: safetensors, llama, multimodal, fine-grained, instance-understanding, video-text-to-text, en, dataset:Inst-IT/Inst-IT-Dataset, dataset:lmms-lab/LLaVA-NeXT-Data, arxiv:2412.03565, arxiv:2310.11441, base_model:liuhaotian/llava-v1.6-vicuna-7b, base_model:finetune:liuhaotian/llava-v1.6-vicuna-7b, license:apache-2.0, model-index, region:us
Base models (finetune): id: liuhaotian/llava-v1.6-vicuna-7b
Card metadata: license: apache-2.0
datasets: Inst-IT/Inst-IT-Dataset, lmms-lab/LLaVA-NeXT-Data
language: en
metrics: accuracy
base_model: liuhaotian/llava-v1.6-vicuna-7b
pipeline_tag: video-text-to-text
tags: multimodal, fine-grained, instance-understanding
model-index: name: LLaVA-Next-Inst-It-Vicuna-7B
results: task: type: multimodal
dataset: name: Inst-IT-Bench-I-OE
type: Open-Ended
metrics: type: accuracy
value: 68.6
name: accuracy
verified: no, task: type: multimodal
dataset: name: Inst-IT-Bench-I-MC
type: Multi-Choice
metrics: type: accuracy
value: 63
name: accuracy
verified: no, task: type: multimodal
dataset: name: AI2D
type: ai2d
metrics: type: accuracy
value: 71
name: accuracy
verified: no, task: type: multimodal
dataset: name: MMMU
type: mmmu
metrics: type: accuracy
value: 37.4
name: accuracy
verified: no, task: type: multimodal
dataset: name: POPE
type: pope
metrics: type: accuracy
value: 87.2
name: accuracy
verified: no, task: type: multimodal
dataset: name: GQA
type: gqa
metrics: type: accuracy
value: 65.9
name: accuracy
verified: no, task: type: multimodal
dataset: name: MM-Vet
type: mm-vet
metrics: type: accuracy
value: 38.1
name: accuracy
verified: no, task: type: multimodal
dataset: name: Inst-IT-Bench-V-OE
type: Open-Ended
metrics: type: accuracy
value: 49.3
name: accuracy
verified: no, task: type: multimodal
dataset: name: Inst-IT-Bench-V-MC
type: Multi-Choice
metrics: type: accuracy
value: 42.1
name: accuracy
verified: no, task: type: multimodal
dataset: name: ActNet-QA
type: actnet-qa
metrics: type: accuracy
value: 53.7
name: accuracy
verified: no, task: type: multimodal
dataset: name: EgoSchema
type: egoschema
metrics: type: accuracy
value: 57.8
name: accuracy
verified: no, task: type: multimodal
dataset: name: NextQA
type: nextqa
metrics: type: accuracy
value: 70.2
name: accuracy
verified: no, task: type: multimodal
dataset: name: VideoMME
type: videomme
metrics: type: accuracy
value: 44.3
name: accuracy
verified: no, task: type: multimodal
dataset: name: TempoCompass
type: tempocompass
metrics: type: accuracy
value: 59.8
name: accuracy
verified: no
Likes: 2 | All-time downloads: 260
Created: 2024-12-05 01:49:13