model strangely overfit one image

#6
by Xiang-cd - opened

I tried to finetune the model with pokemon data at https://huggingface.co/datasets/lambdalabs/pokemon-blip-captions, but strangely that when sample or at val step of the train process. this butterfly is very often to appear, even with None prompt(un conditional generate), the example was here
butter.png

My guess is that there were more images of it in the dataset than other Pokemon, since there are 18 different versions of Vivillon.

Sign up or log in to comment