Update README.md

README.md

@@ -25,10 +25,27 @@ More information needed
 
 ## Training and evaluation data
 
-More information needed
+Instruction Tuned on the winograd-wsc task here: https://huggingface.co/datasets/adambjorn/UnrelatedForgettingOverhead/viewer/winograd_wsc
 
 ## Training procedure
 
+Given some prompts:
+``` python
+prompts = [
+    "Determine which option the pronoun refers to in this text: ",
+    "Given the text, identify the referent of the pronoun among these options: ",
+    "Read the text and decide which option is referred to by the pronoun: ",
+    "In the text below, to whom or what does the pronoun refer? Choose from the options: ",
+]
+```
+
+Each example is concatenated with the prompt, the dialogue, and the summary as so:
+
+``` python
+# Concatenate the selected prompt, text, pronoun, quote, options, and the correct option into a single string
+input_text = f"{prompt}Text: '{text}' Pronoun: '{pronoun}', Quote: '{quote}'. {options_text}. {correct_option}. </s> "
+```
+
 ### Training hyperparameters
 
 The following hyperparameters were used during training: