Text Generation
Transformers
PyTorch
English
gpt_neox
Inference Endpoints
text-generation-inference

Unable to run the example code on ubuntu

#8
by KadirErturk - opened

Tried to run example code on ubuntu, unfortunately i got following error,

[Failed to import transformers.models.gpt_neox.modeling_gpt_neox because of the following error]

(RuntimeError: Failed to import transformers.models.gpt_neox.modeling_gpt_neox because of the following error (look up to see its traceback):
No module named 'torch._six')

any idea what could be wrong?

It happens due to the version change of Pytorch, see here for more detials, I would suggest trying to replace torch._six with torch and see if it resolves the issue.

Sign up or log in to comment