VRAM usage & card recommendations
#1
by
tensiondriven
- opened
Great to see this! Would you consider updating the card to provide some more information about running it, such as:
- Approx total VRAM usage at a recommended context length
- Recommended GPU split
This kind of info, even if it seems silly, is helpful for some people, silly people, like me.
Hi, thanks!
It's not silly, its useful info. I updated this card and I will try to include some recommendations going forward.
For this model you will need a 24gb card or 24gb total at least, I have not used multiple cards and splits so I have no recommendations for that kind of setup.