KoboldAI
/

OPT-30B-Erebus

Text Generation

text-generation-inference

Model card Files Files and versions Community

Resources

View closed (1)

(Request) Anybody able to make a 4bit quantized version

#3 opened over 1 year ago by

Less than 0.05 Tokens/s on a 4090?

#2 opened over 1 year ago by

Hardware Question

#1 opened over 1 year ago by