mlabonne
/

FineLlama-3.1-8B

CUDA out of memory in t4 gpu colab.

by subashpoudel - opened 23 days ago

23 days ago

Can you provide me a code by quantizing it, so i can run in t4 gpu colab?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment