MMMU / mmmu-pro /prompts.yaml
yunfeixie's picture
Add files using upload-large-folder tool
4fb1290 verified
cot:
vision: "Write out the multiple-choice question in the image and then solve it. The last line of your response should be of the following format: 'Answer: $LETTER' (without quotes) where LETTER is one of options. Think step by step before answering."
standard: "Answer the preceding multiple choice question. The last line of your response should be of the following format: 'Answer: $LETTER' (without quotes) where LETTER is one of options. Think step by step before answering."
direct:
vision: "Answer with the option letter from the given choices directly. The last line of your response should be of the following format: 'Answer: $LETTER' (without quotes) where LETTER is one of options."
standard: "Answer with the option letter from the given choices directly."