How can I run pretrained model on multi GPUs?

#38

by NorzY - opened Feb 27

Feb 27

As title. I used device_map="auto" while call SpeechT5ForTextToSpeech.from_pretrained(), but got error
"An error occurred while model initilization: SpeechT5ForTextToSpeech does not support device_map='auto'. To implement support, the model class needs to implement the _no_split_modules attribute."

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment