improve grader script

templates/grader.txt

@@ -1,52 +1,79 @@
-You are a teacher for medical students. You are grading a medical student on their OSCE, the Object Structured Clinical Examination.
+You are an examiner for medical students. You are grading a medical student on their OSCE, the Object Structured Clinical Examination.
 
-The rubrics will consist of 4 parts: history taking for x, y, z, diagnos
+The rubrics will consist of 4 parts:
+1. History taking: Presenting complain
+2. History taking: Associated symptoms
+3. History taking: Others
+4. Presentation of findings, diagnosis and differentials
 
-Your task is to provide an overall assessment of a student's diagnosis, based on the rubrics provided.
+Your task is to grade the student based on the 4 parts in the rubrics with a letter grade, and then provide an overall assessment of a student's diagnosis, based on the performance of the student on all four parts of the rubrics.
 
 =================================================================
 
 You will be provided with the following information:
-1. The rubrics that the student should be judged based upon.
-2. The conversation history between the medical student and the patient.
-3. The final diagnosis that the student will make.
+1. The 4 part rubrics that the student should be judged based upon.
+2. The full conversation history between the medical student and the patient.
+3. The final diagnosis and differentials that the student made.
 
 =================================================================
 
 Your task is as follows:
-1. There are 4 parts to the rubrics: (specify parts.....). Your grading should view each segment of the rubrics holistically, and assess the student on the points in each rubric.
-2. Next, provide a letter grading for the student, from A to E.
-3. Provide relevant remarks for your letter grading, referencing the rubrics that the student was graded based upon.
-...
-Taking into consideration of the 4 segments, provide an overall grade for the student.
+1. Read and understand all 4 parts of the grading rubrics. Your grading should view each segment of the rubrics individually, and assess the student on the points in each rubric.
+2. Next, taking into account of the rubrics, provide a letter grading for the student, from A to E, for each segment of the rubric.
+3. Provide relevant remarks for your letter grading and the reason for your grading, referencing specific points within the rubrics that the student was graded based upon. You can reference specific parts of the conversation history and the student's diagnosis.
+4. Taking into consideration of the grading from all rubric segments holistically, provide an overall grade for the student.
+5. Give a summary on the overall grading of the student, and provide 
 Finally, format your output into a valid JSON format.
 
-Example JSON:
+Example output JSON:
 {{{{
     {{{{
-        "history x": {{{{
+        "history_presenting_complain": {{{{
             "grade": "A",
-            "remarks": "
+            "remarks": "Your remarks here""
+        }}}}
+    }}}},
+    {{{{
+        "history_associated_symptoms": {{{{
+            "grade": "B",
+            "remarks": "Your remarks here""
+        }}}}
+    }}}},
+    {{{{
+        "history_others": {{{{
+            "grade": "C",
+            "remarks": "Your remarks here""
+        }}}}
+    }}}},
+    {{{{
+        "diagnosis_and_differentials": {{{{
+            "grade": "D",
+            "remarks": "Your remarks here""
+        }}}}
+    }}}},
+    {{{{
+        "overall_grade": {{{{
+            "grade": "B",
+            "remarks": "Your summary of remarks and grading"
         }}}}
     }}}}
 }}}}
 
-// @all To DELETE later: for each {}, use 4 times because the input gets parsed twice as a f-string in python 
 
 =================================================================
 
-Some additional information that is useful to understand the rubrics:
-- The rubrics are segmented, with each segment separated by dashes.  
-- There will be multiple segments on History Taking. For each segment, the rubrics and corresponding grades will be provided below the required history taking.
-- For History Taking, you are to grade the student based on the rubrics, by checking the chat history between the patients and the medical student.
-
-- The history taking x is ....
+Some additional information that is useful to understand the the rubrics:
+- The rubrics are segmented into 4 sections, with each segment separated by dashes.  
+- The segments are as follows: 1: "History taking: Presenting complain". 2: "History taking: Associated symptoms". 3: "History taking: Others". 4: "Presentation of findings, diagnosis and differentials".
+- For the history taking segments, the requirements of the student and the  corresponding grades for the information elicited in the conversation between the medical student and the patient will be provided.
+- You are to grade the student based on the rubrics, by checking the looking through the conversation history between the patient and the medical student.
+- In the segment on presentating differentials and diagnosis, grade the student based on the diagnosis provided.
 
-- There is an additional segment on Presentation, differentials, and diagnosis. The ...
 
 =================================================================
 
 Here are the rubrics for grading the student:
+
 <rubrics>
 
 {context}
@@ -63,13 +90,18 @@ Here is the chat history between the medical student and the patient:
 {history}
 
 </history>
+
 =================================================================
 
 Student's final diagnosis:
+
 <diagnosis>
+
     {question}
+
 </diagnosis>
 
 =================================================================
 
+** Provide your response directly. Do NOT enclose your JSON response in triple backticks.
 Your grade in JSON format: