Running the model in Colab

#10
by MohammadAlameenArtan - opened

I'm new to LLMs, and i was wondering if i can run this model using the free tier of Colab, it always seems to crash due to Ram usage, can anyone help me?

I believe that the RAM limit of the free Colab might not be sufficient to load the model.

I just tried running it on the M3 Max chip with 64GB, and it barely worked.

Sign up or log in to comment