adorkin commited on
Commit
bce7032
1 Parent(s): 12d4d22

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +34 -2
README.md CHANGED
@@ -27,10 +27,42 @@ with corresponding options filled in were separated, shuffled and classified ind
27
  ## Training data
28
 
29
  [WinoGrande-XL](https://huggingface.co/datasets/winogrande) reformatted the following way:
30
- 1. Each sentence was split on `_` placeholder symbol.
31
  2. Each option was concatenated with the second part of the split, thus transforming each example into two text segment pairs.
32
  3. Text segment pairs corresponding to correct and incorrect options were marked with `True` and `False` labels accordingly.
33
- 4. Text segment pairs were shuffled thereafter.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
34
 
35
  ### BibTeX entry and citation info
36
 
 
27
  ## Training data
28
 
29
  [WinoGrande-XL](https://huggingface.co/datasets/winogrande) reformatted the following way:
30
+ 1. Each sentence was split on "`_`" placeholder symbol.
31
  2. Each option was concatenated with the second part of the split, thus transforming each example into two text segment pairs.
32
  3. Text segment pairs corresponding to correct and incorrect options were marked with `True` and `False` labels accordingly.
33
+ 4. Text segment pairs were shuffled thereafter.
34
+
35
+ For example,
36
+
37
+ ```json
38
+ {
39
+ "answer": "2",
40
+ "option1": "plant",
41
+ "option2": "urn",
42
+ "sentence": "The plant took up too much room in the urn, because the _ was small."
43
+ }
44
+ ```
45
+
46
+ becomes
47
+
48
+ ```json
49
+ {
50
+ "sentence1": "The plant took up too much room in the urn, because the ",
51
+ "sentence2": "plant was small.",
52
+ "label": false
53
+ }
54
+ ```
55
+
56
+ and
57
+
58
+ ```json
59
+ {
60
+ "sentence1": "The plant took up too much room in the urn, because the ",
61
+ "sentence2": "urn was small.",
62
+ "label": true
63
+ }
64
+ ```
65
+ These sentence pairs are then treated as independent examples.
66
 
67
  ### BibTeX entry and citation info
68