Killed when trying to execute the code

#1
by NamburiSrinath - opened

Hi,

I just pasted this code in a .py file and when I executed the python file, it downloaded the model and threw the output "Killed"

from transformers import pipeline
generator = pipeline('text-generation', model='EleutherAI/gpt-neo-2.7B')
generator("Describe a dog?", do_sample=True, min_length=50)

Attaching a screenshot for reference

Screen Shot 2022-11-03 at 5.27.56 PM.png

You likely ran out of memory.

how much memory does it need to run an inference ?

I think this one was about 20GB or so

Sign up or log in to comment