Single 4090 system
#3
by
cleverest
- opened
Will this run in OobaBooga (Text-generation-webui) on a system with a single 4090?
Any recommended settings to optimize it, if so? Thank you.
*NM, I noticed, "They are are not yet compatible with any other third-party UIS, libraries or utilities but this is expected to change very soon." - but will it still run on a single 4090 system?
it does work quite well on single 4090. Both gguf and gptq versions from Bloke - tested em both
Thanks for confirming!