All models are ggml V1 with the latest llama-cpp-python 0.1.70 occurs error: object has no attribute 'model'

#1
by cdgaete - opened

All models are ggml V1 with the latest llama-cpp-python 0.1.70 occurs error: object has no attribute 'model'

AttributeError: 'LlamaCppModel' object has no attribute 'model'

Is there any known solution or do we have to downgrade llama-cpp-python until it works?
Thanks!

You can't use llama-cpp-python at all - it's not compatible with this kind of GGMLs. Please see the README for a list of compatible software.

I guess I should mention specifically that llama-cpp-python is also not compatible. llama-cpp-python only supports what llama.cpp supports, hence if llama.cpp can't support it, nor can llama-cpp-python. But in future I will make that explicit.

Sign up or log in to comment