hivemind
/

gpt-j-6B-8bit

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Resources

View closed (4)

Adding `safetensors` variant of this model

#17 opened about 1 year ago by

NameError: name 'init_empty_weights' is not defined

#16 opened over 1 year ago by

interstellarninja

Can't download the tokenizer

#15 opened over 1 year ago by

RuntimeError: probability tensor contains either `inf`, `nan` or element < 0

#14 opened over 1 year ago by

How to properly save/load the 8-bit model?

#12 opened over 1 year ago by

hivemind / gpt-j-6B-8bit , How can i use Multiple GPU , I treid using accelerate and also using torch.nn.dataparallel() nothing works out

#11 opened about 2 years ago by

error with example inference

#9 opened about 2 years ago by

xaq

superceded bloom int8 optimized model doesnt do sampling

#8 opened about 2 years ago by

xaq

load_in_8bit fine-tuning requires more memory than this notebook

#6 opened about 2 years ago by

When will the error get resolved ?Can't load tokenizer using from_pretrained, please update its configuration

#5 opened about 2 years ago by

bitsandbytes-cuda111==0.26.0 not found

#4 opened about 2 years ago by

Error at the moment of training

#3 opened over 2 years ago by

Broken kaggle link in model card

#1 opened over 2 years ago by