What'd you do to convert this?
#2
by
xzuyn
- opened
When trying to convert I get KeyError: ('torch._tensor', '_rebuild_from_type_v2') with the 13B version, but not with the 7B version. Would very much like to know how to solve this so I can deal with it in the future.
It might be a llama.cpp version issue. I would try with a recent pull, esp after May 12th.