Brett S

#170 opened 6 months ago by

New activity in TheBloke/WizardCoder-Python-34B-V1.0-GGUF 11 months ago

Single 4090 system

#3 opened 12 months ago by

New activity in LaconicAI/falcon-40b-instruct-gptq about 1 year ago

Will this model work in OobaBooga (text-generation-webui) on a single 4090 card system with any settings?

#1 opened about 1 year ago by

New activity in TheBloke/galpaca-30B-GPTQ about 1 year ago

which one do I choose? Thanks...

#4 opened about 1 year ago by

New activity in twilightBOO/pov-skin-textures-dreamlike-r34-v2 about 1 year ago

MODEL FILE

#2 opened over 1 year ago by

suridov

New activity in TheBloke/WizardLM-33B-V1-0-Uncensored-SuperHOT-8K-GPTQ about 1 year ago

Tips on running on 3090 24gb VRAM?

7

#1 opened about 1 year ago by

luthis

New activity in TheBloke/samantha-1.1-llama-33B-GPTQ about 1 year ago

Using Oogabooga and a 4090 (windows install) - which model of the two available do I use?

1

#1 opened about 1 year ago by

New activity in TheBloke/chronos-33b-GPTQ about 1 year ago

Is there any chance of getting this into a 4bit quantized (GPTQ as well?) version?

#1 opened about 1 year ago by

New activity in Aeala/Alpaca-elina-65b-ggml about 1 year ago

Oobagooda error, changed from a working 5.1 model to 4.0 and now I can no longer load the model at all

#1 opened about 1 year ago by

New activity in zombihed/ZombiMix-v6 about 1 year ago

Any description of this model anywhere? Changes from V7 to V9?

#1 opened about 1 year ago by

New activity in TheBloke/GPlatty-30B-SuperHOT-8K-GPTQ about 1 year ago

In text-generation-webui I don't see where to set the LOADER to ExLlama

#1 opened about 1 year ago by

New activity in allenai/tulu-30b about 1 year ago

Any feedback on what this model is particularly good at? Not good at?

#1 opened about 1 year ago by

New activity in Zicara/OPT-30B-Erebus-4bit-128g about 1 year ago

Did anyone manage to run it with oobabooga? It's very slow

1

#7 opened about 1 year ago by

ilnurshams

New activity in CalderaAI/30B-Lazarus-GPTQ4bit about 1 year ago

Can you please provide the quantize_config.json file?

5

#1 opened about 1 year ago by

ishotoli

New activity in Zicara/OPT-30B-Erebus-4bit-128g about 1 year ago

Why is this model so sloooooooow in text-generation-webui?

#6 opened over 1 year ago by

New activity in benjicolby/WizardLM-30B-Guanaco-SuperCOT-GPTQ-4bit about 1 year ago

RTX 4090 Windows system with 96GB of RAM - I cannot get this model to load in OobaBooga - ERROR

#1 opened about 1 year ago by

New activity in Monero/WizardLM-SuperCOT-StoryTelling-30b-4bit about 1 year ago

4090 test with OobaBooga (In Windows) fails to load the model

4

#2 opened about 1 year ago by

New activity in askmyteapot/GPT4-x-AlpacaDente2-30b-4bit about 1 year ago

What are the best 4090 settings to use for this in OobaBooga / Text-Generation-WebUI?

#3 opened about 1 year ago by

Great speed, great answers, great work. But only runs limited on rtx 4090...?

1

#2 opened over 1 year ago by

aLanaMiau

New activity in Aeala/VicUnlocked-alpaca-65b-GGML about 1 year ago

4090 system, i9-13900k, 96GB RAM - I could not launch this model (trying the 4.0 GGML one)

#1 opened about 1 year ago by

New activity in mosaicml/mpt-7b-instruct about 1 year ago

Optimal 4090 settings? System has 96GB of ram (I9-13900k)

5

#35 opened over 1 year ago by

New activity in TheBloke/WizardLM-30B-Uncensored-GPTQ about 1 year ago

Have a problem with rtx4090

17

#6 opened over 1 year ago by

crainto

New activity in avictus/oasst-sft-7-llama-30b-4bit over 1 year ago

Using in with oobabooga/text-generation-webui

#1 opened over 1 year ago by

latent-variable

New activity in Zicara/OPT-30B-Erebus-4bit-128g over 1 year ago

Will there be a non-group sized (not 128g) version released?

#5 opened over 1 year ago by

New activity in MetaIX/GPT4-X-Alpasta-30b-4bit over 1 year ago

Best optimized settings for 24GB VRAM video card?

#3 opened over 1 year ago by

benfy

New activity in Charleshsliao/artius_v21 over 1 year ago

Info?

#1 opened over 1 year ago by