VRAM requirements
#2
by
dipjeb
- opened
Hi,
Would this run on a single instance of 4090 ? (24 GB )
@dipjeb the 3.5bpw might run barely with little context but i believe 4bpw might be a bit too big. maybe it might run if you dont have any vram being used up by other processes.