Update README.md

README.md

@@ -16,7 +16,7 @@ In this task, the model gets the string with text with the error and the exact s
 
 ## Model training details
 
-### Data
+#### Data
 
 The data was provided in the following way
 
@@ -34,7 +34,7 @@ I want to stop smoking during driving bicycle .	23:29	A <gerund> does not normal
 
 Grammar termins are highlighted with '< ... >' marks and word examples - with '<< ... >>'
 
-### Data preprocessing
+####  Data preprocessing
 
 We lowercased the text, split it from any punctuation, including task specific marks (<< >>) and explicitly pointed out the error in the original text using << >>.
 
@@ -44,6 +44,11 @@ the smoke < < flow > > < < my > > face .	10:17 When the < verb > < < flow > > is
 i want to stop smoking < < during > > driving bicycle .	23:29	a < gerund > does not normally follow the < preposition > < < during > > . think of an expression using the < conjunction > ' while ' instead of a < preposition > .
 ```
 
+####  Data augmentation
+
+The main feature of our training pipeline was data augmentation. The idea of the augmentation is as follows: we cut the existing text with error after the last word which was syntactically connected to the words inside the error span (syntactic dependencies were automatically parsed with spacy) and this cut version of the text with error was used as a prompt for language model (we used [GPT-Neo 1.3B](https://huggingface.co/EleutherAI/gpt-neo-1.3B)).
+
+Using both initial and augmented data we fine-tuned [t5-large](https://huggingface.co/t5-large).
 
 ## How to use
 
@@ -86,4 +91,14 @@ def paraphrase(text, model, temperature=1.0, beams=3):
  # expected output: ["a  gerund > does not normally follow the  preposition >   during > >. think of an expression using the  conjunction >'while'instead of a  preposition >."]
 
 
-```
+```
+
+
+## Licensing Information
+
+[Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License][cc-by-nc-sa].
+
+[![CC BY-NC-SA 4.0][cc-by-nc-sa-image]][cc-by-nc-sa]
+
+[cc-by-nc-sa]: http://creativecommons.org/licenses/by-nc-sa/4.0/
+[cc-by-nc-sa-image]: https://i.creativecommons.org/l/by-nc-sa/4.0/88x31.png