finetune fuyu8b text location with image size of 1920x1080 always got OOM even on A100*8

#63

by Nooodles - opened Dec 7, 2023

Dec 7, 2023

I used huggingface Trainer+deepspeed(stage3) to finetune it and I had to downsample the image to 1536x864 to avoid OOM.
Is there any way to use the original resolution to finetune?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment