Update README.md

README.md

@@ -1,10 +1,11 @@
 ---
 language: ar
 datasets:
- - wikipedia
- - OSIAN
- - 1.5B Arabic Corpus
- - OSCAR Arabic Unshuffled
+- wikipedia
+- Osian
+- 1.5B-Arabic-Corpus
+- oscar-arabic-unshuffled
+- Assafir(private)
 widget:
  - text: "يحكى أن مزارعا مخادعا قام ببيع بئر الماء الموجود في أرضه لجاره مقابل مبلغ كبير من المال"
  - text: "القدس مدينة تاريخية، بناها الكنعانيون في"
@@ -36,6 +37,7 @@ from transformers import GPT2TokenizerFast, pipeline
 #for base and medium
 from transformers import GPT2LMHeadModel
 #for large and mega
+# pip install arabert
 from arabert.aragpt2.grover.modeling_gpt2 import GPT2LMHeadModel
 
 from arabert.preprocess import ArabertPreprocessor
@@ -50,7 +52,7 @@ model = GPT2LMHeadModel.from_pretrained(MODEL_NAME)
 tokenizer = GPT2TokenizerFast.from_pretrained(MODEL_NAME)
 generation_pipeline = pipeline("text-generation",model=model,tokenizer=tokenizer)
 
-#feel free to try different decodinn settings
+#feel free to try different decoding settings
 generation_pipeline(text,
     pad_token_id=tokenizer.eos_token_id,
     num_beams=10,
@@ -68,7 +70,7 @@ Follow the guide linked [here](https://towardsdatascience.com/fine-tuning-gpt2-o
 Create the Training TFRecords:
 ```bash
 python create_pretraining_data.py
- --input_file=<RAW TEXT FILE with documents/article sperated by an empty line>
+ --input_file=<RAW TEXT FILE with documents/article separated by an empty line>
  --output_file=<OUTPUT TFRecord>
  --tokenizer_dir=<Directory with the GPT2 Tokenizer files>
  ```
@@ -133,7 +135,7 @@ The text generated by AraGPT2 is automatically generated by a neural network mod
 ```
 
 # Acknowledgments
-Thanks to TensorFlow Research Cloud (TFRC) for the free access to Cloud TPUs, couldn't have done it without this program, and to the [AUB MIND Lab](https://sites.aub.edu.lb/mindlab/) Members for the continous support. Also thanks to [Yakshof](https://www.yakshof.com/#/) and Assafir for data and storage access. Another thanks for Habib Rahal (https://www.behance.net/rahalhabib), for putting a face to AraBERT.
+Thanks to TensorFlow Research Cloud (TFRC) for the free access to Cloud TPUs, couldn't have done it without this program, and to the [AUB MIND Lab](https://sites.aub.edu.lb/mindlab/) Members for the continuous support. Also thanks to [Yakshof](https://www.yakshof.com/#/) and Assafir for data and storage access. Another thanks for Habib Rahal (https://www.behance.net/rahalhabib), for putting a face to AraBERT.
 
 # Contacts
 **Wissam Antoun**: [Linkedin](https://www.linkedin.com/in/wissam-antoun-622142b4/) | [Twitter](https://twitter.com/wissam_antoun) | [Github](https://github.com/WissamAntoun) | <wfa07@mail.aub.edu> | <wissam.antoun@gmail.com>