Create README.md

README.md

@@ -0,0 +1,3 @@
+ArabicTransformer small model (B6-6-6 with decoder)
+
+This model was pre-trained on 44GB of Arabic corpora using [Funnel Transformer with ELECTRA objective](https://arxiv.org/abs/2006.03236). We will update you with more details about the model and our accepted paper later.