Update README.md

README.md

@@ -10,12 +10,15 @@ language:
 license: "apache-2.0"
 ---
 
+## CINO: Pre-trained Language Models for Chinese Minority
 
-### Chinese ELECTRA
+Multilingual Pre-trained Language Model, such as mBERT, XLM-R, provide multilingual and cross-lingual ability for language understanding.
+We have seen rapid progress on building multilingual PLMs in recent year.
+However, there is a lack of contributions on building PLMs on Chines minority languages, which hinders researchers from building powerful NLP systems.
 
-Google and Stanford University released a new pre-trained model called ELECTRA, which has a much compact model size and relatively competitive performance compared to BERT and its variants. For further accelerating the research of the Chinese pre-trained model, the Joint Laboratory of HIT and iFLYTEK Research (HFL) has released the Chinese ELECTRA models based on the official code of ELECTRA. ELECTRA-small could reach similar or even higher scores on several NLP tasks with only 1/10 parameters compared to BERT and its variants.
+To address the absence of Chinese minority PLMs, Joint Laboratory of HIT and iFLYTEK Research (HFL) proposes CINO (Chinese-miNOrity pre-trained language model), which is built on XLM-R with additional pre-training using Chinese minority corpus, such as Tibetan, Mongolian (Uighur form), Uyghur, Kazakh (Arabic form), Korean, Zhuang, Cantonese, etc.
 
-This project is based on the official code of ELECTRA: https://github.com/google-research/electra
+Please read our GitHub repository for more details (Chinese): https://github.com/ymcui/Chinese-Minority-PLM
 
 You may also interested in,