System Prompt used ?
I saw in some code snippet that the system prompt of "Answer the questions" was used, however today I could not find that anymore.
In the evaluation code system is set to an empty string.
So for manually inferencing it, would that be equal to a pre-prompt of "<|start_header_id|>system<|end_header_id|>\n\n<|eot_id|>" ?
I guess using a custom system prompt is not recommended if it was trained entirely without one ?
@cmp-nct
Hi!
No system prompt was introduced during the training process. The prompt of 'Answer the questions' is intended for use with the official CLI of llava, as the conversion class in the llava repository does not allow for prompts without a system prompt.
https://github.com/haotian-liu/LLaVA/blob/3e337ad269da3245643a2724a1d694b5839c37f9/llava/conversation.py#L21
https://huggingface.co/xtuner/llava-llama-3-8b-v1_1-hf/discussions/1