Model: wchai/AuroraCap-7B-VID-xtuner
Author: wchai
Pipeline: video-text-to-text
Tags: safetensors, llama, caption, video-text-to-text, dataset:wchai/AuroraCap-trainset, arxiv:2410.03051, base_model:lmsys/vicuna-7b-v1.5-16k, base_model:finetune:lmsys/vicuna-7b-v1.5-16k, license:apache-2.0, model-index, region:us
Base models (finetune): id: lmsys/vicuna-7b-v1.5-16k
Card metadata: license: apache-2.0
datasets: wchai/AuroraCap-trainset
base_model: lmsys/vicuna-7b-v1.5-16k
tags: caption
model-index: name: AuroraCap-7B
results: task: type: video detailed caption
dataset: type: VDC
name: VDC
metrics: type: Acc
value: 38.21
name: VDCScore
verified: no, type: Acc
value: 48.33
name: VDD
verified: no, type: cider
value: 9.51
verified: no, type: bleu
value: 30.9
name: bleu@1
verified: no, type: bleu
value: 4.06
name: bleu@4
verified: no, type: meteor
value: 19.09
verified: no, type: rouge
value: 21.58
name: rouge-l
verified: no, task: type: video caption
dataset: type: MSR-VTT
name: NSR-VTT
metrics: type: cider
value: 33.1
verified: no, type: bleu
value: 58.6
name: bleu@1
verified: no, type: bleu
value: 21
name: bleu@4
verified: no, type: meteor
value: 23.9
verified: no, type: rouge
value: 49.5
name: rouge-l
verified: no, task: type: video caption
dataset: type: VATEX
name: VATEX
metrics: type: cider
value: 33.8
verified: no, type: bleu
value: 57.1
name: bleu@1
verified: no, type: bleu
value: 18.4
name: bleu@4
verified: no, type: meteor
value: 19
verified: no, type: rouge
value: 40.8
name: rouge-l
verified: no, task: type: video question anwering
dataset: type: ActivityNet
name: ActivityNet
metrics: type: Acc
value: 61.8
verified: no, task: type: video question anwering
dataset: type: MSVD
name: MSVD
metrics: type: Acc
value: 62.6
verified: no, task: type: video question anwering
dataset: type: MSR-VTT
name: MSR-VTT
metrics: type: Acc
value: 43.5
verified: no, task: type: video question anwering
dataset: type: iVQA
name: iVQA
metrics: type: Acc
value: 55.2
verified: no
pipeline_tag: video-text-to-text
Likes: 6 | All-time downloads: 2029
Created: 2024-09-24 17:19:14