VRAM requirement
#5
by
jithinmukundan
- opened
Can this run on an L40S GPU with 48 GB VRAM? I am using VLLM.
Nope.
What could be the minimum VRAM required?
it probably needs more than 64gb, I can confirm that at least.