Running the model in Colab
#10
by
MohammadAlameenArtan
- opened
I'm new to LLMs, and i was wondering if i can run this model using the free tier of Colab, it always seems to crash due to Ram usage, can anyone help me?
I believe that the RAM limit of the free Colab might not be sufficient to load the model.
I just tried running it on the M3 Max chip with 64GB, and it barely worked.