prompts/juder_prompts.py

def get_judge_idea_all_prompt(idea0,idea1,topic):
    prompt = f"""
You are a judge in a competition. You have to decide which idea is better.

The idea0 is: {idea0}

The idea1 is: {idea1}

The topic is: {topic}

Which idea do you think is better? Please write a short paragraph to explain your choice.

Here are your evaluation criteria:
1. Novelty: Are the problems or approaches new? Is this a novel combination of familiar techniques? Is it clear how this work differs from previous contributions? Is related work adequately referenced? 
2. Significance: Are the idea important? Are other people (practitioners or researchers) likely to use these ideas or build on them? Does the idea address a difficult problem in a better way than previous research? Does it provide a unique theoretical or pragmatic approach?
3. Feasibility: Can the idea be realized with existing technology or methods? Are there any technical difficulties or bottlenecks? Is the idea clear and logical? Is there any obvious error or unreasonable part in the idea, and can the experiment be designed normally according to this idea. 
4. Clarity: Is the paper clearly written? Is it well-organized? Does it adequately inform the reader? 
5. Effectiveness: How likely the proposed idea is going to work well (e.g., better than existing baselines).

Note: 
Avoid any position biases and ensure that the order in which the responses were presented does not influence your decision. DO NOT allow the LENGTH of the responses to influence your evaluation, choose the one that is straight-to-the-point instead of unnecessarily verbose. Be as objective as possible. (very important!!!)

If you think idea0 is better than idea1, you should output 0. If you think idea1 is better than idea0, you should output 1. If you think idea0 and idea1 are equally good, you should output 2.

Your output should be strictly in following format:
Your thinking process:
...

Your choice:
<novelty>{{ Your choice for novelty }}</novelty>
<significance>{{ Your choice for significance }}</significance>
<feasibility>{{ Your choice for feasibility }}</feasibility>
<clarity>{{ Your choice for clarity }}</clarity>
<effectiveness>{{ Your choice for effectiveness }}</effectiveness>
    """
    return prompt


def get_judge_experiment_all_prompt(idea0,experiment0,idea1,experiment1):
    prompt = f"""
You are a judge in a competition. You have to decide which experiment is better.
The idea of experiment0 is: {idea0}
The experiment0 is: {experiment0}

The idea of experiment1 is: {idea1}
The experiment1 is: {experiment1}

Which experiment do you think is better? Please write a short paragraph to explain your choice.

Here are your evaluation criteria:
1. Feasibility: Can the experiment be realized with existing technology or methods? Are there any technical difficulties or bottlenecks? Is the experimental plan detailed and feasible? Are the experimental steps clear and logical? Is there any obvious error or unreasonable part in the experiment. Consider the rationality of its steps and the possibility that the idea can be successfully implemented.
2. Quality: Is there a clear rationale for each step of the experimental design? Are the baseline and evaluation metrics chosen appropriately? Has the design taken into account the potential advantages and limitations of the methods used? Can this experimental design effectively support the claims made in the idea.
3. Clarity: Is the experimental plan clearly written? Dose it provide enough information for the expert reader to understand the experiment? Is it well organized? Does it adequately inform the reader?

Note: Avoid any position biases and ensure that the order in which the responses were presented does not influence your decision. DO NOT allow the LENGTH of the responses to influence your evaluation, choose the one that is straight-to-the-point instead of unnecessarily verbose. Be as objective as possible. (very important!!!)

If you think experiment0 is better than experiment1, you should output 0. If you think experiment1 is better than experiment0, you should output 1. If you think experiment0 and experiment1 are equally good, you should output 2.

Your output should be strictly in following format:
Your thinking process:
...

Your choice:
<feasibility>{{Your choice for feasibility}}</feasibility>
<quality>{{Your choice for quality}}</quality>
<clarity>{{Your choice for clarity}}</clarity>
    """
    return prompt