Had to hack it to use fp16 to work on my 24GB 4090 with OOM

#4
by aifartist - opened

Had to hack it to use fp16 to work on my 24GB 4090 with OOM
and I'd like to know what motion_bucket_id does.

Had to hack it to use fp16 to work on my 24GB 4090 with OOM
and I'd like to know what motion_bucket_id does.

Hey I also have a 4090 what did you hack so I can get this running on my machine as well many thanks!

Had to hack it to use fp16 to work on my 24GB 4090 with OOM
and I'd like to know what motion_bucket_id does.

Hey I also have a 4090 what did you hack so I can get this running on my machine as well many thanks!

Set this line to True
https://github.com/Stability-AI/generative-models/blob/059d8e9cd9c55aea1ef2ece39abf605efb8b7cc9/scripts/demo/streamlit_helpers.py#L61

Also set the "decode t frames" to lower like 7, would fit 24GB VRAM easily

Will this work with 16gb cards ?

14297MiB with low vram mode and "Decode t frames at a time (set small if you are low on VRAM)" set to 1

Had to hack it to use fp16 to work on my 24GB 4090 with OOM
and I'd like to know what motion_bucket_id does.

Hey I also have a 4090 what did you hack so I can get this running on my machine as well many thanks!

Set this line to True
https://github.com/Stability-AI/generative-models/blob/059d8e9cd9c55aea1ef2ece39abf605efb8b7cc9/scripts/demo/streamlit_helpers.py#L61

Also set the "decode t frames" to lower like 7, would fit 24GB VRAM easily

what's mean "set the 'decode t frames' to lower like 7"?
how to set 'decode t frames' ?

It's the last option when you launch the web interface

I dont get it, how come i can create nice animations with only 6gb of VRAM RTX 2060 and 16 GB RAM, using COMFY UI, it takes 15 minutes for 5 second animation, but at least DOES WORK, look here

Sign up or log in to comment