any special config files?

#6
by ysdj - opened

Hey Justine,
Thanks for the upload!
I'm trying to run it on my local machine but (perhaps due to my limited knowledge in GGUF models), I can't get it to work. I'm trying to load it locally via transformers (I can't run Ctransformers), and using the original config files but getting an error:
Unrecognized configuration class <class 'transformers.models.llava.configuration_llava.LlavaConfig'> for this kind of AutoModel: AutoModelForCausalLM.
any advice?

Update your Transformers package. The one referenced does not support AutoModel

pip install -U transformers

Sign up or log in to comment