IliaLarchenko commited on
Commit
52a2b9b
1 Parent(s): 269ec40

Improved grader prompt

Browse files
Files changed (1) hide show
  1. tests/testing_prompts.py +2 -1
tests/testing_prompts.py CHANGED
@@ -57,10 +57,11 @@ You should evaluate the following aspects and return a JSON with these keys:
57
  "feedback_result": "The feedback accurately reflected the candidate's performance.",
58
  "feedback_hallucinations": "The feedback didn't contain any non-relevant information.",
59
 
60
- "comments": "Provide examples of mistakes made by the interviewer or areas for improvement, if there are some. List only bad things, don't list good."
61
 
62
  Return just True, False, or None (if no info was provided) for each key except "comments", "comments" is string.
63
  True is always a positive score, False is negative.
 
64
  """
65
 
66
 
 
57
  "feedback_result": "The feedback accurately reflected the candidate's performance.",
58
  "feedback_hallucinations": "The feedback didn't contain any non-relevant information.",
59
 
60
+ "comments": "Provide examples of mistakes made by the interviewer or areas for improvement, if there are some. List only bad things, don't list good. Keep it very short, or even empty"
61
 
62
  Return just True, False, or None (if no info was provided) for each key except "comments", "comments" is string.
63
  True is always a positive score, False is negative.
64
+ Keep comments empty if there are not huge mistakes or issues.
65
  """
66
 
67