model strangely overfit one image

#5
by Xiang-cd - opened

I tried to finetune the model with pokemon data at https://huggingface.co/datasets/lambdalabs/pokemon-blip-captions, but strangely that when sample or at val step of the train process. this butterfly is very often to appear, even with None prompt(un conditional generate), the example was

this is the butterfly
butter.png

Sign up or log in to comment