13B 4bit 128g version

#1
by anon7463435254 - opened

Thank you for the 7b model. Could you please share the 13b inst chat model?

Thanks again.

Hello! Sorry I can't do it atm, because I get Out of Memory errors while quantizing (On my rtx 3060 12gb)

CyberTimon changed discussion status to closed

Sign up or log in to comment