Text Generation
Transformers
PyTorch
English
llama
Inference Endpoints
text-generation-inference

RuntimeError

#12
by User1232123 - opened

I'm so glad to use your amazing model.

When I use your code snippet, it has an error "RuntimeError: shape '[1, 59, 64, 128]' is invalid for input of size 60416".

It happens on Linux and multiple GPUs(It is automatically assigned to multiple GPUs).

What should I do for this error?

Same error too.

Same error too.

Update transformers to 4.31.0 solved this error.

Sign up or log in to comment