Runs out of memory on free tier Google Colab

#3
by sudhir2016 - opened

Tried the basic usage code on free tier Google Colab. Runs out of memory.

Mobius Labs GmbH org

Runs of RAM or VRAM? Can you please share your colab ?

Runs out of RAM. here is the link to my Colab.
https://gist.github.com/sudhir2016/0089af5519f9409d8addb5f4162c5fde

Mobius Labs GmbH org

Free colab has only 12.7GB of RAM, you'll need more to run this model due to the CPU offloading part, unfortunately. It was designed to reduce VRAM usage not RAM.

mobicham changed discussion status to closed

Sign up or log in to comment