Repository: open-compass/VLMEvalKit
Issue: [BUG] 加载VDC数据集报错
Root cause: Validation Gap

数据集下载完成了，也拼接了，在解压时报下面的错误：

数据集文件结构：
```text
总计 130G
-rw-r--r-- 1 root root  12M  5月  7 15:12 VDC.tsv
-rw-r--r-- 1 root root  65G  5月  7 15:50 videos.tar
-rw-r--r-- 1 root root  10G  5月  7 15:48 videos.tar.part.ab
-rw-r--r-- 1 root root  10G  5月  7 15:48 videos.tar.part.ac
-rw-r--r-- 1 root root  10G  5月  7 15:48 videos.tar.part.ad
-rw-r--r-- 1 root root  10G  5月  7 15:48 videos.tar.part.ae
-rw-r--r-- 1 root root  10G  5月  7 15:48 videos.tar.part.af
-rw-r--r-- 1 root root  10G  5月  7 15:48 videos.tar.part.ag
-rw-r--r-- 1 root root 4.6G  5月  7 15:31 videos.tar.part.ah
```

```text
Traceback (most recent call last):
  File "/mnt/data/data/user/maoyunlin.myl/VLMEvalKit/vlmeval/run.py", line 276, in run_task
    dataset = build_dataset(dataset_name, **dataset_kwargs)
  File "/mnt/data/data/user/maoyunlin.myl/VLMEvalKit/vlmeval/dataset/__init__.py", line 241, in build_dataset
    return cls(dataset=dataset_name, **filtered_kwargs)
  File "/mnt/data/data/user/maoyunlin.myl/VLMEvalKit/vlmeval/dataset/vdc.py", line 124, in __init__
    super().__init__(dataset=dataset, pack=pack, nframe=nframe, fps=fps)
  File "/mnt/data/data/user/maoyunlin.myl/VLMEvalKit/vlmeval/dataset/video_base.py", line 21, in __init__
    ret = self.prepare_dataset(dataset)
  File "/mnt/data/data/user/maoyunlin.myl/VLMEvalKit/vlmeval/dataset/vdc.py", line 217, in prepare_dataset
    untar_video_data(output_tar, cache_path)
  File "/mnt/data/data/user/maoyunlin.myl/VLMEvalKit/vlmeval/dataset/vdc.py", line 185, in untar_video_data
    with tarfile.open(tar_file, "r") as tar_ref:
  File "/mnt/data/data/shared/public/miniconda/envs/eval/lib/python3.10/tarfile.py", line 1811, in open
    raise ReadError(f"file could not be opened successfully:\n{error_msgs_summary}")
tarfile.ReadError: file could not be opened successfully:
- method gz: ReadError('not a gzip file')
- method bz2: ReadError('not a bzip2 file')
- method xz: ReadError('not an lzma file')
- method tar: ReadError('invalid header')
```

same problem

@FangXinyu-0913  plz help look at this issue

Sorry for the late reply—I was quite busy over the past two weeks. We have checked your issue, and it seems that the video archive might be corrupted after packaging. We are currently re-uploading the data and will notify you as soon as it is ready. Thanks a lot for your patience!

Hi @tyxqc @Yunnglin, This bug has already been fixed by https://github.com/open-compass/VLMEvalKit/pull/1001, Thanks @Espere-1119-Song for your help! We will close this issue and merge the PR within 2 days. If you have other questions when using the VDC dataset, please feel free to raise them under this issue and reopen it.

> Sorry for the late reply—I was quite busy over the past two weeks. We have checked your issue, and it seems that the video archive might be corrupted after packaging. We are currently re-uploading the data and will notify you as soon as it is ready. Thanks a lot for your patience!

Hi. I download VDC from https://huggingface.co/datasets/Enxin/VLMEval-VDC/tree/main but run into 
```
FileNotFoundError: [Errno 2] No such file or directory: '/mnt/dolphinfs/ssd_pool/docker/user/hadoop-hldy-nlp/3A/multimodal/fengkaituo/eval/hub/datasets--Enxin--VLMEval-VDC/snapshots/9fd0ffe0d7b530aec7a64d456daa0d67707fc2eb/VDC.tsv'
```
I wonder where can I get this VDC.tsv file. Thank you for any help!