minimal HW requirements
#52
by
minarth
- opened
Hello everyone. I have troubles running the model in SageMaker. Every try gets "Killed" on out-of-memory. Even ml.m5.4xlarge. I am trying to use code from the example:
from transformers import AutoProcessor, SeamlessM4Tv2Model
import torchaudio
processor = AutoProcessor.from_pretrained("facebook/seamless-m4t-v2-large")
model = SeamlessM4Tv2Model.from_pretrained("facebook/seamless-m4t-v2-large")
# from audio
audio, orig_freq = torchaudio.load("my_audio.wav")
audio = torchaudio.functional.resample(audio, orig_freq=orig_freq, new_freq=16_000) # must be a 16 kHz waveform array
audio_inputs = processor(audios=audio, return_tensors="pt")
audio_array_from_audio = model.generate(**audio_inputs, tgt_lang="eng")[0].cpu().numpy().squeeze()
My audio has 4 minutes and 25MBs.
What are the minimal requirements to run the model?
Having same problem, any updates?