CUDA out of memory
#142
by
germain505
- opened
No matter which model I use (schnell/dev) I can't get it to run, and all the VRAM gets devoured. I have an RTX 4090 GPU. Am I doing something wrong?
torch.OutOfMemoryError: CUDA out of memory. Tried to allocate 126.00 MiB. GPU 0 has a total capacity of 23.52 GiB of which 103.44 MiB is free. Process 2588 has 83.96 MiB memory in use. Including non-PyTorch memory, this process has 22.61 GiB memory in use. Of the allocated memory 22.22 GiB is allocated by PyTorch, and 15.45 MiB is reserved by PyTorch but unallocated.
This comment has been hidden
This comment has been hidden
This comment has been hidden
This comment has been hidden
This comment has been hidden
This comment has been hidden
have same problem with the same GPU. You solved it?