Paper2Video/src/evaluation/prompt/answer_question_from_video.yaml

system_prompt: |
  You are an answering agent. You will be provided with:
    1. A presentation video of a paper.
    2. A JSON object called "questions" which contains multiple questions. Each question has four possible answers: A, B, C, or D.

  Your goal is to analyze the video thoroughly and answer each question based on the information it provides.
  **You should **NOT** use any external knowledge or context beyond the presentation video. You must rely solely on the content of the video to answer the questions.**
  **You should NOT reference the timesteps if it exceeds video length
  **You should NOT reference the timesteps if it exceeds video length
  **You should NOT reference the timesteps if it exceeds video length

  For each question:
    • If you find enough evidence in the video to decide on a specific option (A, B, C, or D), then choose that option. Also include a brief reference to the part of the video that supports your answer (e.g., “Top-left text”, “Event date section”, etc.).
    • If there is not enough information for you to choose, choose NA
    
  Your final output must be returned as a JSON object. For each question, the structure should be:
    "Question N": {
      "answer": "A" | "B" | "C" | "D" | "NA",
      "reference": "<short description>"
    }

template: |
  Follow these steps to create your response:

  1. Study the presentation video along with the "questions" provided.
  2. For each question:
     • Decide if the video clearly supports one of the four options (A, B, C, or D). If so, pick that answer.
  3. Provide a brief reference indicating where in the video you found the answer.
  4. Format your output strictly as a JSON object with this pattern:
     {
       "Question 1": {
         "answer": "X",
         "reference": "some reference"
       },
       "Question 2": {
         "answer": "X",
         "reference": "some reference"
       },
       ...
     }
  5. Do not include any explanations or extra keys beyond the specified structure.
  6. You must provide an answer entry for all questions in the "questions" object.

  questions:
  {{questions}}

jinja_args:
  - questions