Hugging Face's logo

Spaces:
competitions
/
SnakeCLEF2023
Paused

App Files Community
19

Ambiguity in Medium dataset [Image not available in folder]

#10
by arti00 - opened
Discussion
arti00

I have been running training and using medium size data for which I am using same metadata file (as there is only one for training/val). Few examples ran and I got following error -

Screenshot 2023-04-18 at 9.34.21 PM.png

Is it only larger dataset folders contain all images mentioned in metadata files?

picekl

Hi @arti00 ,

Probably the image is corrupted or was corrupted while we were downloading it. Just don't use it. There might be a small fraction of those images. I would say ~100.

Best,
Lukas

arti00
•
edited Apr 19, 2023

Hi @picekl ,

I see. I will drop those rows.

Update : I checked and yes they were around 100 as you mentioned, 156.

Thanks,

arti00

A snippet of code to filter out data from train/val metafile(csv) in case any one falls into this error -

Screenshot 2023-04-19 at 11.57.40 AM.png

Sign up or log in to comment