Brett S
cleverest
·
AI & ML interests
None yet
Organizations
None yet
cleverest's activity
Is there a working/quantized/exl2 (etc) version that will fit on a single 24GB video card (4090)
2
#170 opened 10 months ago
by
cleverest
Single 4090 system
2
#3 opened over 1 year ago
by
cleverest
Will this model work in OobaBooga (text-generation-webui) on a single 4090 card system with any settings?
#1 opened over 1 year ago
by
cleverest
which one do I choose? Thanks...
3
#4 opened over 1 year ago
by
cleverest
MODEL FILE
2
#2 opened over 1 year ago
by
suridov
Tips on running on 3090 24gb VRAM?
7
#1 opened over 1 year ago
by
luthis
Using Oogabooga and a 4090 (windows install) - which model of the two available do I use?
1
#1 opened over 1 year ago
by
cleverest
Is there any chance of getting this into a 4bit quantized (GPTQ as well?) version?
#1 opened over 1 year ago
by
cleverest
Oobagooda error, changed from a working 5.1 model to 4.0 and now I can no longer load the model at all
#1 opened over 1 year ago
by
cleverest
Any description of this model anywhere? Changes from V7 to V9?
#1 opened over 1 year ago
by
cleverest
In text-generation-webui I don't see where to set the LOADER to ExLlama
2
#1 opened over 1 year ago
by
cleverest
Any feedback on what this model is particularly good at? Not good at?
#1 opened over 1 year ago
by
cleverest
Did anyone manage to run it with oobabooga? It's very slow
1
#7 opened over 1 year ago
by
ilnurshams
Can you please provide the quantize_config.json file?
5
#1 opened over 1 year ago
by
ishotoli
Why is this model so sloooooooow in text-generation-webui?
3
#6 opened over 1 year ago
by
cleverest
RTX 4090 Windows system with 96GB of RAM - I cannot get this model to load in OobaBooga - ERROR
2
#1 opened over 1 year ago
by
cleverest
4090 test with OobaBooga (In Windows) fails to load the model
4
#2 opened over 1 year ago
by
cleverest
What are the best 4090 settings to use for this in OobaBooga / Text-Generation-WebUI?
#3 opened over 1 year ago
by
cleverest
Great speed, great answers, great work. But only runs limited on rtx 4090...?
1
#2 opened over 1 year ago
by
aLanaMiau
4090 system, i9-13900k, 96GB RAM - I could not launch this model (trying the 4.0 GGML one)
2
#1 opened over 1 year ago
by
cleverest