KeyError: ('torch._tensor', '_rebuild_from_type_v2')

#3
by xzuyn - opened

This model gives this error when trying to quantize to ggml, but it doesn't happen with the 7b version.

Sign up or log in to comment