inference error: apply_chat_template

#2
by Forrest20231206 - opened

I use the example code in model card, and it occurs an error:
Traceback (most recent call last):
File "/home/work/forrest/github/dl_exp/mllm/scripts/test_base/test_llava_next.py", line 31, in
prompt = processor.apply_chat_template(conversation, add_generation_prompt=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'LlavaNextProcessor' object has no attribute 'apply_chat_template'

Llava Hugging Face org

@Forrest20231206 the chat templates just recently arrived, should work if you install transformers from GH

@merve I see. Thank you for explaining.

Forrest20231206 changed discussion status to closed

how to install transformers from GH

Llava Hugging Face org

To install from source (Github), you can do pip install git+https://github.com/huggingface/transformers.git

Sign up or log in to comment