What library was used to quantize the model?

#2
by KirillR - opened

Did you use AutoGPTQ to quantize the model or something else? I'm trying to replicate this myself but AutoGPTQ doesn't support cohere

Please see #1

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment