4bit

/

llava-v1.5-13b-5GB

like 2

I'm guessing there is something wrong with the model, been trying to load it with @camenduru colab notebook.
The error that seems to be the center of it is:

NotImplementedError: Cannot copy out of meta tensor; no data!