guoqiang wang
commited on
Commit
•
a708cf5
1
Parent(s):
7dede40
Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
GLM is a General Language Model pretrained with an autoregressive blank-filling objective and can be finetuned on various natural language understanding and generation tasks.
|
| 2 |
+
|
| 3 |
+
Please refer to our paper for a detailed description of GLM:
|
| 4 |
+
|
| 5 |
+
All NLP Tasks Are Generation Tasks: A General Pretraining Framework
|
| 6 |
+
|
| 7 |
+
Zhengxiao Du*, Yujie Qian*, Xiao Liu, Ming Ding, Jiezhong Qiu, Zhilin Yang, Jie Tang (*: equal contribution)
|
| 8 |
+
|
| 9 |
+
Part of the code is based on Megatron-LM and PET.
|