Brett S

#170 opened 3 months ago by

New activity in TheBloke/WizardCoder-Python-34B-V1.0-GGUF 8 months ago

Single 4090 system

#3 opened 9 months ago by

New activity in LaconicAI/falcon-40b-instruct-gptq 10 months ago

Will this model work in OobaBooga (text-generation-webui) on a single 4090 card system with any settings?

#1 opened 10 months ago by

New activity in TheBloke/galpaca-30B-GPTQ 11 months ago

which one do I choose? Thanks...

#4 opened 11 months ago by

New activity in twilightBOO/pov-skin-textures-dreamlike-r34-v2 11 months ago

MODEL FILE

#2 opened about 1 year ago by

suridov

New activity in TheBloke/WizardLM-33B-V1-0-Uncensored-SuperHOT-8K-GPTQ 11 months ago

Tips on running on 3090 24gb VRAM?

7

#1 opened 12 months ago by

luthis

New activity in TheBloke/samantha-1.1-llama-33B-GPTQ 11 months ago

Using Oogabooga and a 4090 (windows install) - which model of the two available do I use?

1

#1 opened 11 months ago by

New activity in TheBloke/chronos-33b-GPTQ 11 months ago

Is there any chance of getting this into a 4bit quantized (GPTQ as well?) version?

#1 opened 11 months ago by

New activity in Aeala/Alpaca-elina-65b-ggml 11 months ago

Oobagooda error, changed from a working 5.1 model to 4.0 and now I can no longer load the model at all

#1 opened 11 months ago by

New activity in zombihed/ZombiMix-v6 11 months ago

Any description of this model anywhere? Changes from V7 to V9?

#1 opened 11 months ago by

New activity in TheBloke/GPlatty-30B-SuperHOT-8K-GPTQ 11 months ago

In text-generation-webui I don't see where to set the LOADER to ExLlama

#1 opened 12 months ago by

New activity in allenai/tulu-30b 11 months ago

Any feedback on what this model is particularly good at? Not good at?

#1 opened 11 months ago by

New activity in Zicara/OPT-30B-Erebus-4bit-128g 12 months ago

Did anyone manage to run it with oobabooga? It's very slow

1

#7 opened about 1 year ago by

ilnurshams

New activity in CalderaAI/30B-Lazarus-GPTQ4bit 12 months ago

Can you please provide the quantize_config.json file?

5

#1 opened about 1 year ago by

ishotoli

New activity in Zicara/OPT-30B-Erebus-4bit-128g about 1 year ago

Why is this model so sloooooooow in text-generation-webui?

#6 opened about 1 year ago by

New activity in benjicolby/WizardLM-30B-Guanaco-SuperCOT-GPTQ-4bit about 1 year ago

RTX 4090 Windows system with 96GB of RAM - I cannot get this model to load in OobaBooga - ERROR

#1 opened about 1 year ago by

New activity in Monero/WizardLM-SuperCOT-StoryTelling-30b-4bit about 1 year ago

4090 test with OobaBooga (In Windows) fails to load the model

4

#2 opened about 1 year ago by

New activity in askmyteapot/GPT4-x-AlpacaDente2-30b-4bit about 1 year ago

What are the best 4090 settings to use for this in OobaBooga / Text-Generation-WebUI?

#3 opened about 1 year ago by

Great speed, great answers, great work. But only runs limited on rtx 4090...?

1

#2 opened about 1 year ago by

aLanaMiau

New activity in Aeala/VicUnlocked-alpaca-65b-GGML about 1 year ago

4090 system, i9-13900k, 96GB RAM - I could not launch this model (trying the 4.0 GGML one)

#1 opened about 1 year ago by

New activity in mosaicml/mpt-7b-instruct about 1 year ago

Optimal 4090 settings? System has 96GB of ram (I9-13900k)

5

#35 opened about 1 year ago by

New activity in TheBloke/WizardLM-30B-Uncensored-GPTQ about 1 year ago

Have a problem with rtx4090

17

#6 opened about 1 year ago by

crainto

New activity in avictus/oasst-sft-7-llama-30b-4bit about 1 year ago

Using in with oobabooga/text-generation-webui

#1 opened about 1 year ago by

latent-variable

New activity in Zicara/OPT-30B-Erebus-4bit-128g about 1 year ago

Will there be a non-group sized (not 128g) version released?

#5 opened about 1 year ago by

New activity in MetaIX/GPT4-X-Alpasta-30b-4bit about 1 year ago

Best optimized settings for 24GB VRAM video card?

#3 opened about 1 year ago by

benfy

New activity in Charleshsliao/artius_v21 about 1 year ago

Info?

#1 opened about 1 year ago by