IliaLarchenko commited on
Commit
9dfff00
1 Parent(s): 69f9684

Improved testing prompt

Browse files
Files changed (1) hide show
  1. tests/testing_prompts.py +10 -1
tests/testing_prompts.py CHANGED
@@ -34,6 +34,9 @@ You should evaluate the following aspects and return a JSON with these keys:
34
  "problem_statement_solution": "The problem statement doesn't leak an expected solution.",
35
  "problem_statement_hints": "The problem statement doesn't give big hints regarding the solution.",
36
  "problem_statement_answer_plan": "The problem statement doesn't contain the expected for the answer.",
 
 
 
37
 
38
  "interviewer_solution": "The interviewer didn't provide the solutions and avoided offering unnecessary hints during the interview.",
39
  "interviewer_mistakes": "The interviewer didn't make any errors in code, computation, or logical reasoning.",
@@ -51,7 +54,12 @@ You should evaluate the following aspects and return a JSON with these keys:
51
  "interviewer_notes": "The interviewer made reasonable notes catching candidates mistakes and important facts.",
52
  "interviewer_stuck": "The interview's dialog was reasonable and didn't stuck at any point in repeating cycle of same questions and answers.",
53
  "interviewer_end": "The interview ended interview after candidate answer all questions (vs. interview ended abruptly).",
54
-
 
 
 
 
 
55
  "feedback_quality": "The feedback was constructive and offered actionable insights.",
56
  "feedback_overview": "The feedback contains the recap of main mistakes and good ideas of the candidate.",
57
  "feedback_relevance": "The feedback was directly related to the interview problem.",
@@ -62,6 +70,7 @@ You should evaluate the following aspects and return a JSON with these keys:
62
  "feedback_focus": "The feedback was concise and didn't contain too many general comments.",
63
  "feedback_completeness": "The feedback covered all important aspects (inc. mistakes) of the candidate performance.",
64
  "feedback_examples": "The feedback illustrated all main point with specific examples from the interview.",
 
65
 
66
  "comments": "Provide examples of mistakes made by the interviewer or areas for improvement, if there are some. List only bad things, don't list good. Keep it very short, or even empty"
67
 
 
34
  "problem_statement_solution": "The problem statement doesn't leak an expected solution.",
35
  "problem_statement_hints": "The problem statement doesn't give big hints regarding the solution.",
36
  "problem_statement_answer_plan": "The problem statement doesn't contain the expected for the answer.",
37
+ "problem_statement_instructions": "The problem statement contained clear and concise instructions for what is expected from the candidate.",
38
+ "problem_statement_goals_alignment": "The problem statement aligned with the overarching goals of the interview (e.g., testing specific skills, knowledge areas).",
39
+ "problem_statement_skill_test": "The problem statement effectively tested the candidate's skills that are essential for the role or topic being interviewed for.",
40
 
41
  "interviewer_solution": "The interviewer didn't provide the solutions and avoided offering unnecessary hints during the interview.",
42
  "interviewer_mistakes": "The interviewer didn't make any errors in code, computation, or logical reasoning.",
 
54
  "interviewer_notes": "The interviewer made reasonable notes catching candidates mistakes and important facts.",
55
  "interviewer_stuck": "The interview's dialog was reasonable and didn't stuck at any point in repeating cycle of same questions and answers.",
56
  "interviewer_end": "The interview ended interview after candidate answer all questions (vs. interview ended abruptly).",
57
+ "interviewer_adaptability": "The interviewer adjusted their questions and support based on the candidate's responses and level of understanding.",
58
+ "interviewer_flow_control": "The interviewer maintained control over the interview flow, effectively guiding the conversation and preventing digressions.",
59
+ "interviewer_preparation": "The interviewer demonstrated thorough preparation and a strong understanding of the problem statement and expected solutions.",
60
+ "interviewer_responsive": "The interviewer was responsive to the candidate’s questions, providing clarifications promptly without revealing the solution.",
61
+ "interviewer_depth": "The interviewer asked probing questions that encouraged deeper understanding and demonstration of knowledge by the candidate.",
62
+
63
  "feedback_quality": "The feedback was constructive and offered actionable insights.",
64
  "feedback_overview": "The feedback contains the recap of main mistakes and good ideas of the candidate.",
65
  "feedback_relevance": "The feedback was directly related to the interview problem.",
 
70
  "feedback_focus": "The feedback was concise and didn't contain too many general comments.",
71
  "feedback_completeness": "The feedback covered all important aspects (inc. mistakes) of the candidate performance.",
72
  "feedback_examples": "The feedback illustrated all main point with specific examples from the interview.",
73
+ "feedback_specificity": "The feedback provided by the interviewer was specific, targeting exact points in the candidate’s performance without being overly broad.",
74
 
75
  "comments": "Provide examples of mistakes made by the interviewer or areas for improvement, if there are some. List only bad things, don't list good. Keep it very short, or even empty"
76