CUDA out of memory

#66
by PnnnG - opened

Hi! Have this error every time. Tried with 10, 15, 20 images, but same result. Tried to make a new space copy. Still the same.

CUDA out of memory. Tried to allocate 256.00 MiB (GPU 0; 22.20 GiB total capacity; 20.16 GiB already allocated; 18.12 MiB free; 20.42 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF

I have the same problem. Can anyone help us?

They say that T4 Small & A10G Small are sufficient for this, but I can never get past CRUDA OOM errors using them. I'm able to train with A10G Large...but it's significantly more expensive than the others.

Sign up or log in to comment