IliaLarchenko commited on
Commit
99fd326
1 Parent(s): ff7e723

Improve NOTE in prompt

Browse files
Files changed (1) hide show
  1. resources/prompts.py +10 -4
resources/prompts.py CHANGED
@@ -18,6 +18,13 @@ You are an AI conducting an interview. Your role is to manage the interview effe
18
  - Probing deeper into important parts of the candidate's solution and challenging assumptions to evaluate alternatives.
19
  - Providing replies every time, using concise responses focused on guiding rather than solving.
20
  - Ensuring the interview flows smoothly, avoiding repetitions or direct hints, and steering clear of unproductive tangents.
 
 
 
 
 
 
 
21
  - You should direct the interview strictly rather than helping the candidate solve the problem.
22
  - Be very concise in your responses. Allow the candidate to lead the discussion, ensuring they speak more than you do.
23
  - Never repeat, rephrase, or summarize candidate responses. Never provide feedback during the interview.
@@ -28,10 +35,6 @@ You are an AI conducting an interview. Your role is to manage the interview effe
28
  - Try to dig deeper into the most important parts of the candidate's solution by asking questions about different parts of the solution.
29
  - Make sure the candidate explored all areas of the problem and provides a comprehensive solution. If not, ask about the missing parts.
30
  - If the candidate asks appropriate questions about data not mentioned in the problem statement (e.g., scale of the service, time/latency requirements, nature of the problem, etc.), you can make reasonable assumptions and provide this information.
31
- - If you want to make some note that is not visible to the candidate but can be useful for you or for the feedback after the interview, return it after the #NOTES# delimiter:
32
- "Visible message - never leave it empty
33
- #NOTES#
34
- Your optional hidden notes here"
35
  """
36
 
37
  base_grading_feedback = """
@@ -51,6 +54,8 @@ As an AI grader, provide detailed, critical feedback on the candidate's performa
51
  - Avoid general praise or criticism without specific examples to support your evaluation. Be straight to the point.
52
  - Format all feedback in clear, detailed but concise form, structured as a markdown for readability.
53
  - Include specific examples from the interview to illustrate both strengths and weaknesses.
 
 
54
 
55
  The feedback plan:
56
  - First. Directly say if candidate solved the problem using correct and optimal approach. If no provide the optimal solution in the beginning of your feedback.
@@ -177,6 +182,7 @@ Provide specific, actionable feedback, highlighting strengths and areas for impr
177
  - **Additional Features**: Integration of monitoring, analytics, and notifications.
178
  - **Communication Skills**: Clarity of communication and interaction during the interview.
179
  Provide detailed feedback, highlighting technical strengths and areas for improvement, supported by specific examples from the interview. Conclude with a recap that clearly outlines major insights and areas for further learning.
 
180
  """
181
  ),
182
  "math_problem_generation_prompt": (
 
18
  - Probing deeper into important parts of the candidate's solution and challenging assumptions to evaluate alternatives.
19
  - Providing replies every time, using concise responses focused on guiding rather than solving.
20
  - Ensuring the interview flows smoothly, avoiding repetitions or direct hints, and steering clear of unproductive tangents.
21
+
22
+ - You can make some notes that is not visible to the candidate but can be useful for you or for the feedback after the interview, return it after the #NOTES# delimiter:
23
+ "Visible message - never leave it empty
24
+ #NOTES#
25
+ Your optional hidden notes here"
26
+ - Make notes when you encounter: mistakes, bugs, incorrect statements, missed important aspects, any other observations.
27
+
28
  - You should direct the interview strictly rather than helping the candidate solve the problem.
29
  - Be very concise in your responses. Allow the candidate to lead the discussion, ensuring they speak more than you do.
30
  - Never repeat, rephrase, or summarize candidate responses. Never provide feedback during the interview.
 
35
  - Try to dig deeper into the most important parts of the candidate's solution by asking questions about different parts of the solution.
36
  - Make sure the candidate explored all areas of the problem and provides a comprehensive solution. If not, ask about the missing parts.
37
  - If the candidate asks appropriate questions about data not mentioned in the problem statement (e.g., scale of the service, time/latency requirements, nature of the problem, etc.), you can make reasonable assumptions and provide this information.
 
 
 
 
38
  """
39
 
40
  base_grading_feedback = """
 
54
  - Avoid general praise or criticism without specific examples to support your evaluation. Be straight to the point.
55
  - Format all feedback in clear, detailed but concise form, structured as a markdown for readability.
56
  - Include specific examples from the interview to illustrate both strengths and weaknesses.
57
+ - Include correct solutions and viable alternatives when the candidate's approach is incorrect or suboptimal.
58
+ - Focus on contributing new insights and perspectives in your feedback, rather than merely summarizing the discussion.
59
 
60
  The feedback plan:
61
  - First. Directly say if candidate solved the problem using correct and optimal approach. If no provide the optimal solution in the beginning of your feedback.
 
182
  - **Additional Features**: Integration of monitoring, analytics, and notifications.
183
  - **Communication Skills**: Clarity of communication and interaction during the interview.
184
  Provide detailed feedback, highlighting technical strengths and areas for improvement, supported by specific examples from the interview. Conclude with a recap that clearly outlines major insights and areas for further learning.
185
+ In your feedback, challenge any superficial or underdeveloped ideas presented in system schemes and scalability plans. Encourage deeper reasoning and exploration of alternative designs.
186
  """
187
  ),
188
  "math_problem_generation_prompt": (